2026-03-30 07:35:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-30 07:35:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-30 07:35:05 [auto1.de] INFO: Batch mode enabled: batch 2/2
2026-03-30 07:35:05 [auto1.de] INFO: Starting spider auto1.de
2026-03-30 07:35:05 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-30 07:35:05 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-30 07:35:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-30 07:35:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-30 07:35:05 [scrapy.extensions.telnet] INFO: Telnet Password: 375e4b694d991593
2026-03-30 07:35:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-30 07:35:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.de/task_18_2026-03-30T07_35_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-30 07:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 07:35:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-30 07:35:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-30 07:35:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-30 07:35:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-30 07:35:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2115
2026-03-30 07:35:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-30 07:35:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-30 07:35:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-30 07:35:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-30 07:35:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-30 07:35:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-30 07:35:06 [scrapy.core.engine] INFO: Spider opened
2026-03-30 07:35:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-30 07:35:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-30 07:35:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-30 07:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 07:35:06 [scrapy-playwright] INFO: Starting download handler
2026-03-30 07:35:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-30 07:35:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-30 07:35:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-30 07:35:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-30 07:35:19 [auto1.de] INFO: Channel: 24h | Page: 0 | totalHits: 7564 | hits on page: 40
2026-03-30 07:35:19 [auto1.de] INFO: Found listing with ID: CP67844
2026-03-30 07:35:19 [auto1.de] INFO: Found listing with ID: JW60141
2026-03-30 07:35:19 [auto1.de] INFO: Found listing with ID: PL37483
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL37483%27 HTTP/1.1" 200 None
2026-03-30 07:35:19 [auto1.de] INFO: Scrape type for PL37483: 2
2026-03-30 07:35:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 937195f9-4f25-5281-99eb-df225dd67dbb with identifier: PL37483
2026-03-30 07:35:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 937195f9-4f25-5281-99eb-df225dd67dbb with scrape type 2
2026-03-30 07:35:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 937195f9-4f25-5281-99eb-df225dd67dbb with scrape type 2
2026-03-30 07:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 937195f9-4f25-5281-99eb-df225dd67dbb, identifier: PL37483
2026-03-30 07:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 937195f9-4f25-5281-99eb-df225dd67dbb with identifier: PL37483
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-30 07:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-30 07:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 937195f9-4f25-5281-99eb-df225dd67dbb with identifier: PL37483
2026-03-30 07:35:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 937195f9-4f25-5281-99eb-df225dd67dbb with identifier: PL37483 to the API
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:16:22Z',
 'fuel_type': 'petrol',
 'id': '937195f9-4f25-5281-99eb-df225dd67dbb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL37483',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 143833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-23',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2012}
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL37483%27 HTTP/1.1" 200 None
2026-03-30 07:35:20 [auto1.de] INFO: Saving data for PL37483: {'auction_closing_time': 1774970182.0, 'created_time': 1773689021.020103, 'last_price_update_time': 1774856120.673023}
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL37483') HTTP/1.1" 204 0
2026-03-30 07:35:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:20 [auto1.de] INFO: Found listing with ID: SR56375
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR56375%27 HTTP/1.1" 200 None
2026-03-30 07:35:20 [auto1.de] INFO: Scrape type for SR56375: 2
2026-03-30 07:35:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df101a7e-34b9-56ea-b6ff-2e4f23c34818 with identifier: SR56375
2026-03-30 07:35:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df101a7e-34b9-56ea-b6ff-2e4f23c34818 with scrape type 2
2026-03-30 07:35:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df101a7e-34b9-56ea-b6ff-2e4f23c34818 with scrape type 2
2026-03-30 07:35:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df101a7e-34b9-56ea-b6ff-2e4f23c34818, identifier: SR56375
2026-03-30 07:35:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df101a7e-34b9-56ea-b6ff-2e4f23c34818 with identifier: SR56375
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-30 07:35:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-30 07:35:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df101a7e-34b9-56ea-b6ff-2e4f23c34818 with identifier: SR56375
2026-03-30 07:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df101a7e-34b9-56ea-b6ff-2e4f23c34818 with identifier: SR56375 to the API
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:42:23Z',
 'fuel_type': 'diesel',
 'id': 'df101a7e-34b9-56ea-b6ff-2e4f23c34818',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR56375',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 186937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-14',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style BlueMotion Tech',
 'year': 2012}
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR56375%27 HTTP/1.1" 200 None
2026-03-30 07:35:21 [auto1.de] INFO: Saving data for SR56375: {'auction_closing_time': 1774971743.0, 'created_time': 1774463883.203203, 'last_price_update_time': 1774856121.421872}
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR56375') HTTP/1.1" 204 0
2026-03-30 07:35:21 [auto1.de] INFO: Found listing with ID: LD36602
2026-03-30 07:35:21 [auto1.de] INFO: Found listing with ID: XH94103
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH94103%27 HTTP/1.1" 200 None
2026-03-30 07:35:21 [auto1.de] INFO: Scrape type for XH94103: 2
2026-03-30 07:35:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52edcbe3-3ed0-5482-9fff-96c0d5d47d49 with identifier: XH94103
2026-03-30 07:35:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52edcbe3-3ed0-5482-9fff-96c0d5d47d49 with scrape type 2
2026-03-30 07:35:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52edcbe3-3ed0-5482-9fff-96c0d5d47d49 with scrape type 2
2026-03-30 07:35:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52edcbe3-3ed0-5482-9fff-96c0d5d47d49, identifier: XH94103
2026-03-30 07:35:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52edcbe3-3ed0-5482-9fff-96c0d5d47d49 with identifier: XH94103
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-30 07:35:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52edcbe3-3ed0-5482-9fff-96c0d5d47d49 with identifier: XH94103
2026-03-30 07:35:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52edcbe3-3ed0-5482-9fff-96c0d5d47d49 with identifier: XH94103 to the API
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:21:58Z',
 'fuel_type': 'petrol',
 'id': '52edcbe3-3ed0-5482-9fff-96c0d5d47d49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH94103',
 'listing': 'auction',
 'make': 'Porsche',
 'model': '924',
 'odometer': 94725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1979-04-23',
 'seller_name': None,
 'title': 'Porsche 924 Basis',
 'transmission': 'manual',
 'trim': '',
 'year': 1979}
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH94103%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Saving data for XH94103: {'auction_closing_time': 1774970518.0, 'created_time': 1773725738.712961, 'last_price_update_time': 1774856122.046607}
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH94103') HTTP/1.1" 204 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: LW48159
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: CX13675
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX13675%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for CX13675: 2
2026-03-30 07:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e44aaac2-7579-5df7-b228-8841eb446c82 with identifier: CX13675
2026-03-30 07:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e44aaac2-7579-5df7-b228-8841eb446c82 with scrape type 2
2026-03-30 07:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e44aaac2-7579-5df7-b228-8841eb446c82 with scrape type 2
2026-03-30 07:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e44aaac2-7579-5df7-b228-8841eb446c82, identifier: CX13675
2026-03-30 07:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e44aaac2-7579-5df7-b228-8841eb446c82 with identifier: CX13675
2026-03-30 07:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e44aaac2-7579-5df7-b228-8841eb446c82 with identifier: CX13675
2026-03-30 07:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e44aaac2-7579-5df7-b228-8841eb446c82 with identifier: CX13675 to the API
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:02:43Z',
 'fuel_type': 'diesel',
 'id': 'e44aaac2-7579-5df7-b228-8841eb446c82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX13675',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 310815,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-26',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2006}
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX13675%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Saving data for CX13675: {'auction_closing_time': 1774969363.0, 'created_time': 1774381398.865082, 'last_price_update_time': 1774856122.592723}
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX13675') HTTP/1.1" 204 0
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: WP33305
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: RZ13865
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: WB34474
2026-03-30 07:35:22 [auto1.de] INFO: Found listing with ID: MD28081
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD28081%27 HTTP/1.1" 200 None
2026-03-30 07:35:22 [auto1.de] INFO: Scrape type for MD28081: 2
2026-03-30 07:35:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7eb00d8c-a14d-5439-a232-46e387000cda with identifier: MD28081
2026-03-30 07:35:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7eb00d8c-a14d-5439-a232-46e387000cda with scrape type 2
2026-03-30 07:35:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7eb00d8c-a14d-5439-a232-46e387000cda with scrape type 2
2026-03-30 07:35:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7eb00d8c-a14d-5439-a232-46e387000cda, identifier: MD28081
2026-03-30 07:35:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7eb00d8c-a14d-5439-a232-46e387000cda with identifier: MD28081
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-30 07:35:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7eb00d8c-a14d-5439-a232-46e387000cda with identifier: MD28081
2026-03-30 07:35:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7eb00d8c-a14d-5439-a232-46e387000cda with identifier: MD28081 to the API
2026-03-30 07:35:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:19:09Z',
 'fuel_type': 'petrol',
 'id': '7eb00d8c-a14d-5439-a232-46e387000cda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD28081',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 45243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2021}
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD28081%27 HTTP/1.1" 200 None
2026-03-30 07:35:23 [auto1.de] INFO: Saving data for MD28081: {'auction_closing_time': 1774970349.0, 'created_time': 1773725752.998015, 'last_price_update_time': 1774856123.21766}
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD28081') HTTP/1.1" 204 0
2026-03-30 07:35:23 [auto1.de] INFO: Found listing with ID: ES68106
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68106%27 HTTP/1.1" 200 None
2026-03-30 07:35:23 [auto1.de] INFO: Scrape type for ES68106: 2
2026-03-30 07:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc297674-1692-540e-8981-cafa57799291 with identifier: ES68106
2026-03-30 07:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc297674-1692-540e-8981-cafa57799291 with scrape type 2
2026-03-30 07:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc297674-1692-540e-8981-cafa57799291 with scrape type 2
2026-03-30 07:35:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc297674-1692-540e-8981-cafa57799291, identifier: ES68106
2026-03-30 07:35:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc297674-1692-540e-8981-cafa57799291 with identifier: ES68106
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-30 07:35:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc297674-1692-540e-8981-cafa57799291 with identifier: ES68106
2026-03-30 07:35:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc297674-1692-540e-8981-cafa57799291 with identifier: ES68106 to the API
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-31T15:57:03Z',
 'fuel_type': 'petrol',
 'id': 'fc297674-1692-540e-8981-cafa57799291',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES68106',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 151247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG T 4Matic',
 'transmission': 'automatic',
 'trim': 'T 4Matic',
 'year': 2017}
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68106%27 HTTP/1.1" 200 None
2026-03-30 07:35:23 [auto1.de] INFO: Saving data for ES68106: {'auction_closing_time': 1774972623.0, 'created_time': 1773305398.017529, 'last_price_update_time': 1774856123.901736}
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES68106') HTTP/1.1" 204 0
2026-03-30 07:35:23 [auto1.de] INFO: Found listing with ID: FN23082
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN23082%27 HTTP/1.1" 200 None
2026-03-30 07:35:23 [auto1.de] INFO: Scrape type for FN23082: 2
2026-03-30 07:35:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0276c453-b350-5793-b6ec-dcb50ec3dd96 with identifier: FN23082
2026-03-30 07:35:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0276c453-b350-5793-b6ec-dcb50ec3dd96 with scrape type 2
2026-03-30 07:35:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0276c453-b350-5793-b6ec-dcb50ec3dd96 with scrape type 2
2026-03-30 07:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0276c453-b350-5793-b6ec-dcb50ec3dd96, identifier: FN23082
2026-03-30 07:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0276c453-b350-5793-b6ec-dcb50ec3dd96 with identifier: FN23082
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-30 07:35:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0276c453-b350-5793-b6ec-dcb50ec3dd96 with identifier: FN23082
2026-03-30 07:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0276c453-b350-5793-b6ec-dcb50ec3dd96 with identifier: FN23082 to the API
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:23:18Z',
 'fuel_type': 'diesel',
 'id': '0276c453-b350-5793-b6ec-dcb50ec3dd96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN23082',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 178255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi Energy L1H1 2,7t Expression',
 'transmission': 'manual',
 'trim': 'L1H1 2,7t Expression',
 'year': 2017}
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN23082%27 HTTP/1.1" 200 None
2026-03-30 07:35:24 [auto1.de] INFO: Saving data for FN23082: {'auction_closing_time': 1774970598.0, 'created_time': 1773344579.78135, 'last_price_update_time': 1774856124.543157}
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN23082') HTTP/1.1" 204 0
2026-03-30 07:35:24 [auto1.de] INFO: Found listing with ID: DE92254
2026-03-30 07:35:24 [auto1.de] INFO: Found listing with ID: FF42934
2026-03-30 07:35:24 [auto1.de] INFO: Found listing with ID: HS86233
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS86233%27 HTTP/1.1" 200 None
2026-03-30 07:35:24 [auto1.de] INFO: Scrape type for HS86233: 2
2026-03-30 07:35:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b1de39a-9703-5f5a-8703-62f1baf08baf with identifier: HS86233
2026-03-30 07:35:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b1de39a-9703-5f5a-8703-62f1baf08baf with scrape type 2
2026-03-30 07:35:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b1de39a-9703-5f5a-8703-62f1baf08baf with scrape type 2
2026-03-30 07:35:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b1de39a-9703-5f5a-8703-62f1baf08baf, identifier: HS86233
2026-03-30 07:35:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b1de39a-9703-5f5a-8703-62f1baf08baf with identifier: HS86233
2026-03-30 07:35:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b1de39a-9703-5f5a-8703-62f1baf08baf with identifier: HS86233
2026-03-30 07:35:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b1de39a-9703-5f5a-8703-62f1baf08baf with identifier: HS86233 to the API
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:59:33Z',
 'fuel_type': 'diesel',
 'id': '8b1de39a-9703-5f5a-8703-62f1baf08baf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS86233',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 212460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-16',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS86233%27 HTTP/1.1" 200 None
2026-03-30 07:35:25 [auto1.de] INFO: Saving data for HS86233: {'auction_closing_time': 1774972773.0, 'created_time': 1773402764.263575, 'last_price_update_time': 1774856125.023452}
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS86233') HTTP/1.1" 204 0
2026-03-30 07:35:25 [auto1.de] INFO: Found listing with ID: LJ09333
2026-03-30 07:35:25 [auto1.de] INFO: Found listing with ID: VH09784
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH09784%27 HTTP/1.1" 200 None
2026-03-30 07:35:25 [auto1.de] INFO: Scrape type for VH09784: 2
2026-03-30 07:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f55dd843-95bb-5f36-ac46-5bee34f61f00 with identifier: VH09784
2026-03-30 07:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f55dd843-95bb-5f36-ac46-5bee34f61f00 with scrape type 2
2026-03-30 07:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f55dd843-95bb-5f36-ac46-5bee34f61f00 with scrape type 2
2026-03-30 07:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f55dd843-95bb-5f36-ac46-5bee34f61f00, identifier: VH09784
2026-03-30 07:35:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f55dd843-95bb-5f36-ac46-5bee34f61f00 with identifier: VH09784
2026-03-30 07:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f55dd843-95bb-5f36-ac46-5bee34f61f00 with identifier: VH09784
2026-03-30 07:35:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f55dd843-95bb-5f36-ac46-5bee34f61f00 with identifier: VH09784 to the API
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:07:38Z',
 'fuel_type': 'diesel',
 'id': 'f55dd843-95bb-5f36-ac46-5bee34f61f00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH09784',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 131610,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-11',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2016}
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH09784%27 HTTP/1.1" 200 None
2026-03-30 07:35:25 [auto1.de] INFO: Saving data for VH09784: {'auction_closing_time': 1774969658.0, 'created_time': 1774380478.886982, 'last_price_update_time': 1774856125.55183}
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH09784') HTTP/1.1" 204 0
2026-03-30 07:35:25 [auto1.de] INFO: Found listing with ID: HL66127
2026-03-30 07:35:25 [auto1.de] INFO: Found listing with ID: RT03172
2026-03-30 07:35:25 [auto1.de] INFO: Found listing with ID: FL34122
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL34122%27 HTTP/1.1" 200 None
2026-03-30 07:35:25 [auto1.de] INFO: Scrape type for FL34122: 2
2026-03-30 07:35:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7503d727-3ed8-5419-bc68-2ae0f1e8ab03 with identifier: FL34122
2026-03-30 07:35:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7503d727-3ed8-5419-bc68-2ae0f1e8ab03 with scrape type 2
2026-03-30 07:35:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7503d727-3ed8-5419-bc68-2ae0f1e8ab03 with scrape type 2
2026-03-30 07:35:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7503d727-3ed8-5419-bc68-2ae0f1e8ab03, identifier: FL34122
2026-03-30 07:35:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7503d727-3ed8-5419-bc68-2ae0f1e8ab03 with identifier: FL34122
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-30 07:35:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-30 07:35:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7503d727-3ed8-5419-bc68-2ae0f1e8ab03 with identifier: FL34122
2026-03-30 07:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7503d727-3ed8-5419-bc68-2ae0f1e8ab03 with identifier: FL34122 to the API
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-31T15:37:54Z',
 'fuel_type': 'hybrid',
 'id': '7503d727-3ed8-5419-bc68-2ae0f1e8ab03',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL34122',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 56350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-18',
 'seller_name': None,
 'title': 'BMW 3er 330e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL34122%27 HTTP/1.1" 200 None
2026-03-30 07:35:26 [auto1.de] INFO: Saving data for FL34122: {'auction_closing_time': 1774971474.0, 'created_time': 1773689148.158341, 'last_price_update_time': 1774856126.301513}
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FL34122') HTTP/1.1" 204 0
2026-03-30 07:35:26 [auto1.de] INFO: Found listing with ID: MU80081
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU80081%27 HTTP/1.1" 200 None
2026-03-30 07:35:26 [auto1.de] INFO: Scrape type for MU80081: 2
2026-03-30 07:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10f2d92e-21ea-5d5b-b719-e4c8bed299e5 with identifier: MU80081
2026-03-30 07:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10f2d92e-21ea-5d5b-b719-e4c8bed299e5 with scrape type 2
2026-03-30 07:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10f2d92e-21ea-5d5b-b719-e4c8bed299e5 with scrape type 2
2026-03-30 07:35:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10f2d92e-21ea-5d5b-b719-e4c8bed299e5, identifier: MU80081
2026-03-30 07:35:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10f2d92e-21ea-5d5b-b719-e4c8bed299e5 with identifier: MU80081
2026-03-30 07:35:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10f2d92e-21ea-5d5b-b719-e4c8bed299e5 with identifier: MU80081
2026-03-30 07:35:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10f2d92e-21ea-5d5b-b719-e4c8bed299e5 with identifier: MU80081 to the API
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:03:26Z',
 'fuel_type': 'petrol',
 'id': '10f2d92e-21ea-5d5b-b719-e4c8bed299e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU80081',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 155970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-13',
 'seller_name': None,
 'title': 'Audi Q2 1.0 TFSI Sport ultra',
 'transmission': 'manual',
 'trim': 'Sport ultra',
 'year': 2018}
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU80081%27 HTTP/1.1" 200 None
2026-03-30 07:35:26 [auto1.de] INFO: Saving data for MU80081: {'auction_closing_time': 1774969406.0, 'created_time': 1774380914.699552, 'last_price_update_time': 1774856126.780421}
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU80081') HTTP/1.1" 204 0
2026-03-30 07:35:26 [auto1.de] INFO: Channel: 24h | Page: 1 | totalHits: 7566 | hits on page: 40
2026-03-30 07:35:26 [auto1.de] INFO: Found listing with ID: BP88986
2026-03-30 07:35:26 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-30 07:35:26 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP08791%27 HTTP/1.1" 200 None
2026-03-30 07:35:26 [auto1.de] INFO: Scrape type for BP08791: 2
2026-03-30 07:35:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fed54cd2-7573-5a43-b4e2-0f8f0f515354 with identifier: BP08791
2026-03-30 07:35:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fed54cd2-7573-5a43-b4e2-0f8f0f515354 with scrape type 2
2026-03-30 07:35:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fed54cd2-7573-5a43-b4e2-0f8f0f515354 with scrape type 2
2026-03-30 07:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fed54cd2-7573-5a43-b4e2-0f8f0f515354, identifier: BP08791
2026-03-30 07:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fed54cd2-7573-5a43-b4e2-0f8f0f515354 with identifier: BP08791
2026-03-30 07:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fed54cd2-7573-5a43-b4e2-0f8f0f515354 with identifier: BP08791
2026-03-30 07:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fed54cd2-7573-5a43-b4e2-0f8f0f515354 with identifier: BP08791 to the API
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:54:16Z',
 'fuel_type': 'petrol',
 'id': 'fed54cd2-7573-5a43-b4e2-0f8f0f515354',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP08791',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 85394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-29',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2012}
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP08791%27 HTTP/1.1" 200 None
2026-03-30 07:35:27 [auto1.de] INFO: Saving data for BP08791: {'auction_closing_time': 1774972456.0, 'created_time': 1773138452.70583, 'last_price_update_time': 1774856127.395935}
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP08791') HTTP/1.1" 204 0
2026-03-30 07:35:27 [auto1.de] INFO: Found listing with ID: FP43907
2026-03-30 07:35:27 [auto1.de] INFO: Found listing with ID: LE88532
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE88532%27 HTTP/1.1" 200 None
2026-03-30 07:35:27 [auto1.de] INFO: Scrape type for LE88532: 2
2026-03-30 07:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e164e81b-d7dd-59c9-ab0b-b5e018b25c45 with identifier: LE88532
2026-03-30 07:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e164e81b-d7dd-59c9-ab0b-b5e018b25c45 with scrape type 2
2026-03-30 07:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e164e81b-d7dd-59c9-ab0b-b5e018b25c45 with scrape type 2
2026-03-30 07:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e164e81b-d7dd-59c9-ab0b-b5e018b25c45, identifier: LE88532
2026-03-30 07:35:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:27 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ10280%27 HTTP/1.1" 200 None
2026-03-30 07:35:27 [auto1.de] INFO: Scrape type for YJ10280: 2
2026-03-30 07:35:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4b55f0b-9487-50ef-befe-ebc07e00e869 with identifier: YJ10280
2026-03-30 07:35:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4b55f0b-9487-50ef-befe-ebc07e00e869 with scrape type 2
2026-03-30 07:35:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4b55f0b-9487-50ef-befe-ebc07e00e869 with scrape type 2
2026-03-30 07:35:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4b55f0b-9487-50ef-befe-ebc07e00e869, identifier: YJ10280
2026-03-30 07:35:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e164e81b-d7dd-59c9-ab0b-b5e018b25c45 with identifier: LE88532
2026-03-30 07:35:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e164e81b-d7dd-59c9-ab0b-b5e018b25c45 with identifier: LE88532
2026-03-30 07:35:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e164e81b-d7dd-59c9-ab0b-b5e018b25c45 with identifier: LE88532 to the API
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:41:42Z',
 'fuel_type': 'petrol',
 'id': 'e164e81b-d7dd-59c9-ab0b-b5e018b25c45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE88532',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 167471,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-26',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Innovation ecoFlex 4x4',
 'transmission': 'manual',
 'trim': 'Innovation ecoFlex 4x4',
 'year': 2014}
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE88532%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Saving data for LE88532: {'auction_closing_time': 1774971702.0, 'created_time': 1774464188.138092, 'last_price_update_time': 1774856128.113501}
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE88532') HTTP/1.1" 204 0
2026-03-30 07:35:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4b55f0b-9487-50ef-befe-ebc07e00e869 with identifier: YJ10280
2026-03-30 07:35:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4b55f0b-9487-50ef-befe-ebc07e00e869 with identifier: YJ10280
2026-03-30 07:35:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4b55f0b-9487-50ef-befe-ebc07e00e869 with identifier: YJ10280 to the API
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:53:05Z',
 'fuel_type': 'diesel',
 'id': 'e4b55f0b-9487-50ef-befe-ebc07e00e869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ10280',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 116433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-19',
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 Diesel M Selection L2',
 'transmission': 'manual',
 'trim': 'M Selection L2',
 'year': 2020}
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ10280%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Saving data for YJ10280: {'auction_closing_time': 1774972385.0, 'created_time': 1774463903.679252, 'last_price_update_time': 1774856128.566572}
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ10280') HTTP/1.1" 204 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: CP67844
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: PL37483
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL37483%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for PL37483: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: JW60141
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: SR56375
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR56375%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for SR56375: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: LD36602
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: XH94103
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH94103%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for XH94103: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: LW48159
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: CX13675
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX13675%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for CX13675: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: WP33305
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: RZ13865
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: WB34474
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: MD28081
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD28081%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for MD28081: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: ES68106
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68106%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for ES68106: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: FN23082
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN23082%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for FN23082: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: HS86233
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS86233%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for HS86233: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: DE92254
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: FF42934
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: LJ09333
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: VH09784
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH09784%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for VH09784: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: HL66127
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: RT03172
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: FL34122
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL34122%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for FL34122: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: MU80081
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU80081%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for MU80081: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: BP88986
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: PK44731
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP08791%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for BP08791: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ10280%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for YJ10280: 0
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: CE25056
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE25056%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for CE25056: 2
2026-03-30 07:35:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f321eea-1179-57b1-bef2-c8003a68b88d with identifier: CE25056
2026-03-30 07:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f321eea-1179-57b1-bef2-c8003a68b88d with scrape type 2
2026-03-30 07:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f321eea-1179-57b1-bef2-c8003a68b88d with scrape type 2
2026-03-30 07:35:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f321eea-1179-57b1-bef2-c8003a68b88d, identifier: CE25056
2026-03-30 07:35:28 [auto1.de] INFO: Found listing with ID: CE25056
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE25056%27 HTTP/1.1" 200 None
2026-03-30 07:35:28 [auto1.de] INFO: Scrape type for CE25056: 2
2026-03-30 07:35:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f321eea-1179-57b1-bef2-c8003a68b88d with scrape type 2
2026-03-30 07:35:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f321eea-1179-57b1-bef2-c8003a68b88d with scrape type 2
2026-03-30 07:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f321eea-1179-57b1-bef2-c8003a68b88d, identifier: CE25056
2026-03-30 07:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f321eea-1179-57b1-bef2-c8003a68b88d with identifier: CE25056
2026-03-30 07:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f321eea-1179-57b1-bef2-c8003a68b88d with identifier: CE25056
2026-03-30 07:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f321eea-1179-57b1-bef2-c8003a68b88d with identifier: CE25056 to the API
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:04:29Z',
 'fuel_type': 'diesel',
 'id': '1f321eea-1179-57b1-bef2-c8003a68b88d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE25056',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 111917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-27',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2018}
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE25056%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Saving data for CE25056: {'auction_closing_time': 1774969469.0, 'created_time': 1774380776.188573, 'last_price_update_time': 1774856129.444683}
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE25056') HTTP/1.1" 204 0
2026-03-30 07:35:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f321eea-1179-57b1-bef2-c8003a68b88d with identifier: CE25056
2026-03-30 07:35:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f321eea-1179-57b1-bef2-c8003a68b88d with identifier: CE25056
2026-03-30 07:35:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f321eea-1179-57b1-bef2-c8003a68b88d with identifier: CE25056 to the API
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:04:29Z',
 'fuel_type': 'diesel',
 'id': '1f321eea-1179-57b1-bef2-c8003a68b88d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE25056',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 111917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-27',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2018}
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE25056%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Saving data for CE25056: {'auction_closing_time': 1774969469.0, 'created_time': 1774380776.188573, 'last_price_update_time': 1774856129.832909}
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE25056') HTTP/1.1" 204 0
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: FK56908
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK56908%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for FK56908: 2
2026-03-30 07:35:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a36d06e5-746d-5d68-ac41-342b3788a968 with identifier: FK56908
2026-03-30 07:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a36d06e5-746d-5d68-ac41-342b3788a968 with scrape type 2
2026-03-30 07:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a36d06e5-746d-5d68-ac41-342b3788a968 with scrape type 2
2026-03-30 07:35:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a36d06e5-746d-5d68-ac41-342b3788a968, identifier: FK56908
2026-03-30 07:35:29 [auto1.de] INFO: Found listing with ID: FK56908
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK56908%27 HTTP/1.1" 200 None
2026-03-30 07:35:29 [auto1.de] INFO: Scrape type for FK56908: 2
2026-03-30 07:35:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a36d06e5-746d-5d68-ac41-342b3788a968 with scrape type 2
2026-03-30 07:35:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a36d06e5-746d-5d68-ac41-342b3788a968 with scrape type 2
2026-03-30 07:35:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a36d06e5-746d-5d68-ac41-342b3788a968, identifier: FK56908
2026-03-30 07:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a36d06e5-746d-5d68-ac41-342b3788a968 with identifier: FK56908
2026-03-30 07:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a36d06e5-746d-5d68-ac41-342b3788a968 with identifier: FK56908
2026-03-30 07:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a36d06e5-746d-5d68-ac41-342b3788a968 with identifier: FK56908 to the API
2026-03-30 07:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:57:34Z',
 'fuel_type': 'diesel',
 'id': 'a36d06e5-746d-5d68-ac41-342b3788a968',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK56908',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 283144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-14',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2015}
2026-03-30 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK56908%27 HTTP/1.1" 200 None
2026-03-30 07:35:30 [auto1.de] INFO: Saving data for FK56908: {'auction_closing_time': 1774972654.0, 'created_time': 1773689254.015822, 'last_price_update_time': 1774856130.483544}
2026-03-30 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK56908') HTTP/1.1" 204 0
2026-03-30 07:35:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a36d06e5-746d-5d68-ac41-342b3788a968 with identifier: FK56908
2026-03-30 07:35:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a36d06e5-746d-5d68-ac41-342b3788a968 with identifier: FK56908
2026-03-30 07:35:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a36d06e5-746d-5d68-ac41-342b3788a968 with identifier: FK56908 to the API
2026-03-30 07:35:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:57:34Z',
 'fuel_type': 'diesel',
 'id': 'a36d06e5-746d-5d68-ac41-342b3788a968',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK56908',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 283144,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-14',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2015}
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK56908%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Saving data for FK56908: {'auction_closing_time': 1774972654.0, 'created_time': 1773689254.015822, 'last_price_update_time': 1774856131.32968}
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK56908') HTTP/1.1" 204 0
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35501%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for ZU35501: 2
2026-03-30 07:35:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a00be17-140e-52a3-9d97-d38170a0b561 with identifier: ZU35501
2026-03-30 07:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a00be17-140e-52a3-9d97-d38170a0b561 with scrape type 2
2026-03-30 07:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a00be17-140e-52a3-9d97-d38170a0b561 with scrape type 2
2026-03-30 07:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a00be17-140e-52a3-9d97-d38170a0b561, identifier: ZU35501
2026-03-30 07:35:31 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35501%27 HTTP/1.1" 200 None
2026-03-30 07:35:31 [auto1.de] INFO: Scrape type for ZU35501: 2
2026-03-30 07:35:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a00be17-140e-52a3-9d97-d38170a0b561 with scrape type 2
2026-03-30 07:35:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a00be17-140e-52a3-9d97-d38170a0b561 with scrape type 2
2026-03-30 07:35:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a00be17-140e-52a3-9d97-d38170a0b561, identifier: ZU35501
2026-03-30 07:35:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a00be17-140e-52a3-9d97-d38170a0b561 with identifier: ZU35501
2026-03-30 07:35:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a00be17-140e-52a3-9d97-d38170a0b561 with identifier: ZU35501
2026-03-30 07:35:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a00be17-140e-52a3-9d97-d38170a0b561 with identifier: ZU35501 to the API
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:52:01Z',
 'fuel_type': 'diesel',
 'id': '6a00be17-140e-52a3-9d97-d38170a0b561',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU35501',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 317978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-15',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 1.9 TDI Startline',
 'transmission': 'manual',
 'trim': 'Startline',
 'year': 2008}
2026-03-30 07:35:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35501%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Saving data for ZU35501: {'auction_closing_time': 1774972321.0, 'created_time': 1773305990.971153, 'last_price_update_time': 1774856132.003568}
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU35501') HTTP/1.1" 204 0
2026-03-30 07:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a00be17-140e-52a3-9d97-d38170a0b561 with identifier: ZU35501
2026-03-30 07:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a00be17-140e-52a3-9d97-d38170a0b561 with identifier: ZU35501
2026-03-30 07:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a00be17-140e-52a3-9d97-d38170a0b561 with identifier: ZU35501 to the API
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:52:01Z',
 'fuel_type': 'diesel',
 'id': '6a00be17-140e-52a3-9d97-d38170a0b561',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU35501',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 317978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-15',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 1.9 TDI Startline',
 'transmission': 'manual',
 'trim': 'Startline',
 'year': 2008}
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35501%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Saving data for ZU35501: {'auction_closing_time': 1774972321.0, 'created_time': 1773305990.971153, 'last_price_update_time': 1774856132.294919}
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU35501') HTTP/1.1" 204 0
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: FV09782
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: CW81112
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW81112%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for CW81112: 2
2026-03-30 07:35:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76001f56-0c02-5475-95d5-a7394271b398 with identifier: CW81112
2026-03-30 07:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76001f56-0c02-5475-95d5-a7394271b398 with scrape type 2
2026-03-30 07:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76001f56-0c02-5475-95d5-a7394271b398 with scrape type 2
2026-03-30 07:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76001f56-0c02-5475-95d5-a7394271b398, identifier: CW81112
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: FV09782
2026-03-30 07:35:32 [auto1.de] INFO: Found listing with ID: CW81112
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW81112%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Scrape type for CW81112: 2
2026-03-30 07:35:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76001f56-0c02-5475-95d5-a7394271b398 with scrape type 2
2026-03-30 07:35:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76001f56-0c02-5475-95d5-a7394271b398 with scrape type 2
2026-03-30 07:35:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 76001f56-0c02-5475-95d5-a7394271b398, identifier: CW81112
2026-03-30 07:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76001f56-0c02-5475-95d5-a7394271b398 with identifier: CW81112
2026-03-30 07:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76001f56-0c02-5475-95d5-a7394271b398 with identifier: CW81112
2026-03-30 07:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76001f56-0c02-5475-95d5-a7394271b398 with identifier: CW81112 to the API
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:07:51Z',
 'fuel_type': 'petrol',
 'id': '76001f56-0c02-5475-95d5-a7394271b398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW81112',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 222551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2004}
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW81112%27 HTTP/1.1" 200 None
2026-03-30 07:35:32 [auto1.de] INFO: Saving data for CW81112: {'auction_closing_time': 1774969671.0, 'created_time': 1774350747.101455, 'last_price_update_time': 1774856132.874169}
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW81112') HTTP/1.1" 204 0
2026-03-30 07:35:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 76001f56-0c02-5475-95d5-a7394271b398 with identifier: CW81112
2026-03-30 07:35:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 76001f56-0c02-5475-95d5-a7394271b398 with identifier: CW81112
2026-03-30 07:35:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 76001f56-0c02-5475-95d5-a7394271b398 with identifier: CW81112 to the API
2026-03-30 07:35:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:07:51Z',
 'fuel_type': 'petrol',
 'id': '76001f56-0c02-5475-95d5-a7394271b398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW81112',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 222551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-07-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2004}
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW81112%27 HTTP/1.1" 200 None
2026-03-30 07:35:33 [auto1.de] INFO: Saving data for CW81112: {'auction_closing_time': 1774969671.0, 'created_time': 1774350747.101455, 'last_price_update_time': 1774856133.169205}
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW81112') HTTP/1.1" 204 0
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: HW93090
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93090%27 HTTP/1.1" 200 None
2026-03-30 07:35:33 [auto1.de] INFO: Scrape type for HW93090: 2
2026-03-30 07:35:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35581b18-56bd-5501-b239-892592f7c287 with identifier: HW93090
2026-03-30 07:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35581b18-56bd-5501-b239-892592f7c287 with scrape type 2
2026-03-30 07:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35581b18-56bd-5501-b239-892592f7c287 with scrape type 2
2026-03-30 07:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35581b18-56bd-5501-b239-892592f7c287, identifier: HW93090
2026-03-30 07:35:33 [auto1.de] INFO: Found listing with ID: HW93090
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93090%27 HTTP/1.1" 200 None
2026-03-30 07:35:33 [auto1.de] INFO: Scrape type for HW93090: 2
2026-03-30 07:35:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35581b18-56bd-5501-b239-892592f7c287 with scrape type 2
2026-03-30 07:35:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35581b18-56bd-5501-b239-892592f7c287 with scrape type 2
2026-03-30 07:35:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35581b18-56bd-5501-b239-892592f7c287, identifier: HW93090
2026-03-30 07:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35581b18-56bd-5501-b239-892592f7c287 with identifier: HW93090
2026-03-30 07:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35581b18-56bd-5501-b239-892592f7c287 with identifier: HW93090
2026-03-30 07:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35581b18-56bd-5501-b239-892592f7c287 with identifier: HW93090 to the API
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:30:58Z',
 'fuel_type': 'diesel',
 'id': '35581b18-56bd-5501-b239-892592f7c287',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW93090',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 130671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI IQ.DRIVE 4Motion',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE 4Motion',
 'year': 2019}
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93090%27 HTTP/1.1" 200 None
2026-03-30 07:35:33 [auto1.de] INFO: Saving data for HW93090: {'auction_closing_time': 1774971058.0, 'created_time': 1773303005.246487, 'last_price_update_time': 1774856133.767183}
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW93090') HTTP/1.1" 204 0
2026-03-30 07:35:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35581b18-56bd-5501-b239-892592f7c287 with identifier: HW93090
2026-03-30 07:35:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35581b18-56bd-5501-b239-892592f7c287 with identifier: HW93090
2026-03-30 07:35:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35581b18-56bd-5501-b239-892592f7c287 with identifier: HW93090 to the API
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:30:58Z',
 'fuel_type': 'diesel',
 'id': '35581b18-56bd-5501-b239-892592f7c287',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW93090',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 130671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI IQ.DRIVE 4Motion',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE 4Motion',
 'year': 2019}
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93090%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Saving data for HW93090: {'auction_closing_time': 1774971058.0, 'created_time': 1773303005.246487, 'last_price_update_time': 1774856134.080846}
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW93090') HTTP/1.1" 204 0
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: XW62515
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: NC54536
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ91538%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for UJ91538: 2
2026-03-30 07:35:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29458453-1820-5657-8f25-7577d208720e with identifier: UJ91538
2026-03-30 07:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29458453-1820-5657-8f25-7577d208720e with scrape type 2
2026-03-30 07:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29458453-1820-5657-8f25-7577d208720e with scrape type 2
2026-03-30 07:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29458453-1820-5657-8f25-7577d208720e, identifier: UJ91538
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: XW62515
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: NC54536
2026-03-30 07:35:34 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ91538%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Scrape type for UJ91538: 2
2026-03-30 07:35:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29458453-1820-5657-8f25-7577d208720e with scrape type 2
2026-03-30 07:35:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29458453-1820-5657-8f25-7577d208720e with scrape type 2
2026-03-30 07:35:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29458453-1820-5657-8f25-7577d208720e, identifier: UJ91538
2026-03-30 07:35:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29458453-1820-5657-8f25-7577d208720e with identifier: UJ91538
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-30 07:35:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29458453-1820-5657-8f25-7577d208720e with identifier: UJ91538
2026-03-30 07:35:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29458453-1820-5657-8f25-7577d208720e with identifier: UJ91538 to the API
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:57:33Z',
 'fuel_type': 'diesel',
 'id': '29458453-1820-5657-8f25-7577d208720e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ91538',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 277655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-11',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2007}
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ91538%27 HTTP/1.1" 200 None
2026-03-30 07:35:34 [auto1.de] INFO: Saving data for UJ91538: {'auction_closing_time': 1774972653.0, 'created_time': 1773344022.484539, 'last_price_update_time': 1774856134.964843}
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ91538') HTTP/1.1" 204 0
2026-03-30 07:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29458453-1820-5657-8f25-7577d208720e with identifier: UJ91538
2026-03-30 07:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29458453-1820-5657-8f25-7577d208720e with identifier: UJ91538
2026-03-30 07:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29458453-1820-5657-8f25-7577d208720e with identifier: UJ91538 to the API
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:57:33Z',
 'fuel_type': 'diesel',
 'id': '29458453-1820-5657-8f25-7577d208720e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ91538',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 277655,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-11',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2007}
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ91538%27 HTTP/1.1" 200 None
2026-03-30 07:35:35 [auto1.de] INFO: Saving data for UJ91538: {'auction_closing_time': 1774972653.0, 'created_time': 1773344022.484539, 'last_price_update_time': 1774856135.369527}
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ91538') HTTP/1.1" 204 0
2026-03-30 07:35:35 [auto1.de] INFO: Found listing with ID: ZC81938
2026-03-30 07:35:35 [auto1.de] INFO: Found listing with ID: VL46234
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46234%27 HTTP/1.1" 200 None
2026-03-30 07:35:35 [auto1.de] INFO: Scrape type for VL46234: 1
2026-03-30 07:35:35 [auto1.de] INFO: Found listing with ID: ZC81938
2026-03-30 07:35:35 [auto1.de] INFO: Found listing with ID: VL46234
2026-03-30 07:35:35 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/VL46234/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-30 07:35:35 [auto1.de] INFO: Found listing with ID: CA30799
2026-03-30 07:35:35 [auto1.de] INFO: Found listing with ID: BY18801
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18801%27 HTTP/1.1" 200 None
2026-03-30 07:35:35 [auto1.de] INFO: Scrape type for BY18801: 2
2026-03-30 07:35:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83262893-39aa-5016-874c-6a0f4df2ac5a with identifier: BY18801
2026-03-30 07:35:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83262893-39aa-5016-874c-6a0f4df2ac5a with scrape type 2
2026-03-30 07:35:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83262893-39aa-5016-874c-6a0f4df2ac5a with scrape type 2
2026-03-30 07:35:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83262893-39aa-5016-874c-6a0f4df2ac5a, identifier: BY18801
2026-03-30 07:35:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83262893-39aa-5016-874c-6a0f4df2ac5a with identifier: BY18801
2026-03-30 07:35:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83262893-39aa-5016-874c-6a0f4df2ac5a with identifier: BY18801
2026-03-30 07:35:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83262893-39aa-5016-874c-6a0f4df2ac5a with identifier: BY18801 to the API
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:35:14Z',
 'fuel_type': 'diesel',
 'id': '83262893-39aa-5016-874c-6a0f4df2ac5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY18801',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit Connect',
 'odometer': 126451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-30',
 'seller_name': None,
 'title': 'Ford Transit Connect 1.5 EcoBlue TDCi Kasten Trend lang',
 'transmission': 'manual',
 'trim': 'Kasten Trend lang',
 'year': 2019}
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18801%27 HTTP/1.1" 200 None
2026-03-30 07:35:35 [auto1.de] INFO: Saving data for BY18801: {'auction_closing_time': 1774971314.0, 'created_time': 1773775352.655526, 'last_price_update_time': 1774856135.897583}
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY18801') HTTP/1.1" 204 0
2026-03-30 07:35:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:36 [auto1.de] INFO: Channel: 24h | Page: 2 | totalHits: 7579 | hits on page: 40
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: BP08791
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP08791%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for BP08791: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: YJ10280
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ10280%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for YJ10280: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: CE25056
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE25056%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for CE25056: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: FK56908
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK56908%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for FK56908: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: ZU35501
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU35501%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for ZU35501: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: FV09782
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: CW81112
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW81112%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for CW81112: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: HW93090
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW93090%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for HW93090: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: XW62515
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: NC54536
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: UJ91538
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ91538%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for UJ91538: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: ZC81938
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: VL46234
2026-03-30 07:35:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: CA30799
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: BY18801
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY18801%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for BY18801: 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: LE94201
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE94201%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for LE94201: 2
2026-03-30 07:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e89efe4-bf69-5f68-a1a4-c6fb7a567e08 with identifier: LE94201
2026-03-30 07:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e89efe4-bf69-5f68-a1a4-c6fb7a567e08 with scrape type 2
2026-03-30 07:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e89efe4-bf69-5f68-a1a4-c6fb7a567e08 with scrape type 2
2026-03-30 07:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e89efe4-bf69-5f68-a1a4-c6fb7a567e08, identifier: LE94201
2026-03-30 07:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e89efe4-bf69-5f68-a1a4-c6fb7a567e08 with identifier: LE94201
2026-03-30 07:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e89efe4-bf69-5f68-a1a4-c6fb7a567e08 with identifier: LE94201
2026-03-30 07:35:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e89efe4-bf69-5f68-a1a4-c6fb7a567e08 with identifier: LE94201 to the API
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:53:27Z',
 'fuel_type': 'petrol',
 'id': '8e89efe4-bf69-5f68-a1a4-c6fb7a567e08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE94201',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Opirus',
 'odometer': 103791,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-16',
 'seller_name': None,
 'title': 'Kia Opirus 3.8 V6 EX',
 'transmission': 'automatic',
 'trim': 'EX',
 'year': 2010}
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE94201%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Saving data for LE94201: {'auction_closing_time': 1774972407.0, 'created_time': 1773381101.810532, 'last_price_update_time': 1774856136.696093}
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE94201') HTTP/1.1" 204 0
2026-03-30 07:35:36 [auto1.de] INFO: Found listing with ID: YU07668
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU07668%27 HTTP/1.1" 200 None
2026-03-30 07:35:36 [auto1.de] INFO: Scrape type for YU07668: 2
2026-03-30 07:35:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c84638f-8b04-5a29-9fad-64ae177208f4 with identifier: YU07668
2026-03-30 07:35:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c84638f-8b04-5a29-9fad-64ae177208f4 with scrape type 2
2026-03-30 07:35:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c84638f-8b04-5a29-9fad-64ae177208f4 with scrape type 2
2026-03-30 07:35:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c84638f-8b04-5a29-9fad-64ae177208f4, identifier: YU07668
2026-03-30 07:35:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c84638f-8b04-5a29-9fad-64ae177208f4 with identifier: YU07668
2026-03-30 07:35:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c84638f-8b04-5a29-9fad-64ae177208f4 with identifier: YU07668
2026-03-30 07:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c84638f-8b04-5a29-9fad-64ae177208f4 with identifier: YU07668 to the API
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:13:48Z',
 'fuel_type': 'petrol',
 'id': '5c84638f-8b04-5a29-9fad-64ae177208f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU07668',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 135888,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-11-28',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 4.7 V8 Limited',
 'transmission': 'automatic',
 'trim': 'Limited',
 'year': 1999}
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU07668%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Saving data for YU07668: {'auction_closing_time': 1774970028.0, 'created_time': 1774337744.702191, 'last_price_update_time': 1774856137.295549}
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU07668') HTTP/1.1" 204 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: GR50767
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR50767%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for GR50767: 2
2026-03-30 07:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42e58422-44fa-5648-91eb-bac738554993 with identifier: GR50767
2026-03-30 07:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42e58422-44fa-5648-91eb-bac738554993 with scrape type 2
2026-03-30 07:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42e58422-44fa-5648-91eb-bac738554993 with scrape type 2
2026-03-30 07:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42e58422-44fa-5648-91eb-bac738554993, identifier: GR50767
2026-03-30 07:35:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL46234/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42e58422-44fa-5648-91eb-bac738554993 with identifier: GR50767
2026-03-30 07:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42e58422-44fa-5648-91eb-bac738554993 with identifier: GR50767
2026-03-30 07:35:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42e58422-44fa-5648-91eb-bac738554993 with identifier: GR50767 to the API
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:56:14Z',
 'fuel_type': 'petrol',
 'id': '42e58422-44fa-5648-91eb-bac738554993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR50767',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 169394,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-04',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2012}
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR50767%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Saving data for GR50767: {'auction_closing_time': 1774972574.0, 'created_time': 1773946439.8469, 'last_price_update_time': 1774856137.780678}
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR50767') HTTP/1.1" 204 0
2026-03-30 07:35:37 [auto1.de] INFO: Found listing with ID: GG43334
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG43334%27 HTTP/1.1" 200 None
2026-03-30 07:35:37 [auto1.de] INFO: Scrape type for GG43334: 2
2026-03-30 07:35:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00d0c892-3d6c-5ed2-aec7-48847255f299 with identifier: GG43334
2026-03-30 07:35:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00d0c892-3d6c-5ed2-aec7-48847255f299 with scrape type 2
2026-03-30 07:35:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00d0c892-3d6c-5ed2-aec7-48847255f299 with scrape type 2
2026-03-30 07:35:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00d0c892-3d6c-5ed2-aec7-48847255f299, identifier: GG43334
2026-03-30 07:35:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00d0c892-3d6c-5ed2-aec7-48847255f299 with identifier: GG43334
2026-03-30 07:35:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00d0c892-3d6c-5ed2-aec7-48847255f299 with identifier: GG43334
2026-03-30 07:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00d0c892-3d6c-5ed2-aec7-48847255f299 with identifier: GG43334 to the API
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:36:18Z',
 'fuel_type': 'petrol',
 'id': '00d0c892-3d6c-5ed2-aec7-48847255f299',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG43334',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 186771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-04-22',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 1998}
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG43334%27 HTTP/1.1" 200 None
2026-03-30 07:35:38 [auto1.de] INFO: Saving data for GG43334: {'auction_closing_time': 1774971378.0, 'created_time': 1774262676.175775, 'last_price_update_time': 1774856138.25432}
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG43334') HTTP/1.1" 204 0
2026-03-30 07:35:38 [auto1.de] INFO: Found listing with ID: ZL47575
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL47575%27 HTTP/1.1" 200 None
2026-03-30 07:35:38 [auto1.de] INFO: Scrape type for ZL47575: 2
2026-03-30 07:35:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec2a3c08-5172-5ced-91d6-e205f253e258 with identifier: ZL47575
2026-03-30 07:35:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec2a3c08-5172-5ced-91d6-e205f253e258 with scrape type 2
2026-03-30 07:35:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec2a3c08-5172-5ced-91d6-e205f253e258 with scrape type 2
2026-03-30 07:35:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec2a3c08-5172-5ced-91d6-e205f253e258, identifier: ZL47575
2026-03-30 07:35:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec2a3c08-5172-5ced-91d6-e205f253e258 with identifier: ZL47575
2026-03-30 07:35:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec2a3c08-5172-5ced-91d6-e205f253e258 with identifier: ZL47575
2026-03-30 07:35:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec2a3c08-5172-5ced-91d6-e205f253e258 with identifier: ZL47575 to the API
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:54:17Z',
 'fuel_type': 'diesel',
 'id': 'ec2a3c08-5172-5ced-91d6-e205f253e258',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL47575',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 396968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-15',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL47575%27 HTTP/1.1" 200 None
2026-03-30 07:35:39 [auto1.de] INFO: Saving data for ZL47575: {'auction_closing_time': 1774972457.0, 'created_time': 1773307950.483106, 'last_price_update_time': 1774856139.071071}
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL47575') HTTP/1.1" 204 0
2026-03-30 07:35:39 [auto1.de] INFO: Found listing with ID: KY88001
2026-03-30 07:35:39 [auto1.de] INFO: Found listing with ID: LN11972
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11972%27 HTTP/1.1" 200 None
2026-03-30 07:35:39 [auto1.de] INFO: Scrape type for LN11972: 2
2026-03-30 07:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ef583a3-46df-58a7-8157-9f77240a9420 with identifier: LN11972
2026-03-30 07:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ef583a3-46df-58a7-8157-9f77240a9420 with scrape type 2
2026-03-30 07:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ef583a3-46df-58a7-8157-9f77240a9420 with scrape type 2
2026-03-30 07:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ef583a3-46df-58a7-8157-9f77240a9420, identifier: LN11972
2026-03-30 07:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ef583a3-46df-58a7-8157-9f77240a9420 with identifier: LN11972
2026-03-30 07:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ef583a3-46df-58a7-8157-9f77240a9420 with identifier: LN11972
2026-03-30 07:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ef583a3-46df-58a7-8157-9f77240a9420 with identifier: LN11972 to the API
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:21:46Z',
 'fuel_type': 'diesel',
 'id': '2ef583a3-46df-58a7-8157-9f77240a9420',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN11972',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 207170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.9 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2004}
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN11972%27 HTTP/1.1" 200 None
2026-03-30 07:35:39 [auto1.de] INFO: Saving data for LN11972: {'auction_closing_time': 1774970506.0, 'created_time': 1774291916.976615, 'last_price_update_time': 1774856139.746743}
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN11972') HTTP/1.1" 204 0
2026-03-30 07:35:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:39 [auto1.de] INFO: Found listing with ID: RN93387
2026-03-30 07:35:39 [auto1.de] INFO: Found listing with ID: ZZ22411
2026-03-30 07:35:39 [auto1.de] INFO: Found listing with ID: CS08298
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS08298%27 HTTP/1.1" 200 None
2026-03-30 07:35:39 [auto1.de] INFO: Scrape type for CS08298: 2
2026-03-30 07:35:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1f2cdc-ca7f-5eb2-b06d-b47c7e2edcd5 with identifier: CS08298
2026-03-30 07:35:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc1f2cdc-ca7f-5eb2-b06d-b47c7e2edcd5 with scrape type 2
2026-03-30 07:35:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc1f2cdc-ca7f-5eb2-b06d-b47c7e2edcd5 with scrape type 2
2026-03-30 07:35:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc1f2cdc-ca7f-5eb2-b06d-b47c7e2edcd5, identifier: CS08298
2026-03-30 07:35:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc1f2cdc-ca7f-5eb2-b06d-b47c7e2edcd5 with identifier: CS08298
2026-03-30 07:35:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc1f2cdc-ca7f-5eb2-b06d-b47c7e2edcd5 with identifier: CS08298
2026-03-30 07:35:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc1f2cdc-ca7f-5eb2-b06d-b47c7e2edcd5 with identifier: CS08298 to the API
2026-03-30 07:35:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:15:21Z',
 'fuel_type': 'petrol',
 'id': 'dc1f2cdc-ca7f-5eb2-b06d-b47c7e2edcd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS08298',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500L',
 'odometer': 163277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-28',
 'seller_name': None,
 'title': 'Fiat 500L 1.4 Turbo Trekking',
 'transmission': 'manual',
 'trim': 'Trekking',
 'year': 2015}
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS08298%27 HTTP/1.1" 200 None
2026-03-30 07:35:40 [auto1.de] INFO: Saving data for CS08298: {'auction_closing_time': 1774970121.0, 'created_time': 1773307996.483893, 'last_price_update_time': 1774856140.479852}
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS08298') HTTP/1.1" 204 0
2026-03-30 07:35:40 [auto1.de] INFO: Found listing with ID: EL87499
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL87499%27 HTTP/1.1" 200 None
2026-03-30 07:35:40 [auto1.de] INFO: Scrape type for EL87499: 2
2026-03-30 07:35:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a695b57d-c573-58a3-be2e-27723c2cf743 with identifier: EL87499
2026-03-30 07:35:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a695b57d-c573-58a3-be2e-27723c2cf743 with scrape type 2
2026-03-30 07:35:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a695b57d-c573-58a3-be2e-27723c2cf743 with scrape type 2
2026-03-30 07:35:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a695b57d-c573-58a3-be2e-27723c2cf743, identifier: EL87499
2026-03-30 07:35:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a695b57d-c573-58a3-be2e-27723c2cf743 with identifier: EL87499
2026-03-30 07:35:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a695b57d-c573-58a3-be2e-27723c2cf743 with identifier: EL87499
2026-03-30 07:35:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a695b57d-c573-58a3-be2e-27723c2cf743 with identifier: EL87499 to the API
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:29:53Z',
 'fuel_type': 'diesel',
 'id': 'a695b57d-c573-58a3-be2e-27723c2cf743',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL87499',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 164036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-08',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2015}
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL87499%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Saving data for EL87499: {'auction_closing_time': 1774970993.0, 'created_time': 1773301701.27483, 'last_price_update_time': 1774856141.068714}
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL87499') HTTP/1.1" 204 0
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: CU51755
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51755%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for CU51755: 2
2026-03-30 07:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b05b94a0-4f78-5527-b736-960b3bcfda9b with identifier: CU51755
2026-03-30 07:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b05b94a0-4f78-5527-b736-960b3bcfda9b with scrape type 2
2026-03-30 07:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b05b94a0-4f78-5527-b736-960b3bcfda9b with scrape type 2
2026-03-30 07:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b05b94a0-4f78-5527-b736-960b3bcfda9b, identifier: CU51755
2026-03-30 07:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b05b94a0-4f78-5527-b736-960b3bcfda9b with identifier: CU51755
2026-03-30 07:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b05b94a0-4f78-5527-b736-960b3bcfda9b with identifier: CU51755
2026-03-30 07:35:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b05b94a0-4f78-5527-b736-960b3bcfda9b with identifier: CU51755 to the API
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:13:47Z',
 'fuel_type': 'hybrid',
 'id': 'b05b94a0-4f78-5527-b736-960b3bcfda9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU51755',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 85511,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'Skoda Superb 1.4 Plug-in Hybrid Sportline iV',
 'transmission': 'automatic',
 'trim': 'Sportline iV',
 'year': 2020}
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU51755%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Saving data for CU51755: {'auction_closing_time': 1774970027.0, 'created_time': 1773658101.012621, 'last_price_update_time': 1774856141.764542}
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU51755') HTTP/1.1" 204 0
2026-03-30 07:35:41 [auto1.de] INFO: Channel: 24h | Page: 3 | totalHits: 7583 | hits on page: 40
2026-03-30 07:35:41 [auto1.de] INFO: Found listing with ID: LE51560
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE51560%27 HTTP/1.1" 200 None
2026-03-30 07:35:41 [auto1.de] INFO: Scrape type for LE51560: 2
2026-03-30 07:35:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06ff19ce-5a0d-5c79-86d4-657a35397172 with identifier: LE51560
2026-03-30 07:35:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06ff19ce-5a0d-5c79-86d4-657a35397172 with scrape type 2
2026-03-30 07:35:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06ff19ce-5a0d-5c79-86d4-657a35397172 with scrape type 2
2026-03-30 07:35:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06ff19ce-5a0d-5c79-86d4-657a35397172, identifier: LE51560
2026-03-30 07:35:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06ff19ce-5a0d-5c79-86d4-657a35397172 with identifier: LE51560
2026-03-30 07:35:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06ff19ce-5a0d-5c79-86d4-657a35397172 with identifier: LE51560
2026-03-30 07:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06ff19ce-5a0d-5c79-86d4-657a35397172 with identifier: LE51560 to the API
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:34:33Z',
 'fuel_type': 'petrol',
 'id': '06ff19ce-5a0d-5c79-86d4-657a35397172',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE51560',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 96781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-29',
 'seller_name': None,
 'title': 'Toyota Auris 1.6 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2009}
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE51560%27 HTTP/1.1" 200 None
2026-03-30 07:35:42 [auto1.de] INFO: Saving data for LE51560: {'auction_closing_time': 1774971273.0, 'created_time': 1774435942.969044, 'last_price_update_time': 1774856142.468058}
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE51560') HTTP/1.1" 204 0
2026-03-30 07:35:42 [auto1.de] INFO: Found listing with ID: VD73221
2026-03-30 07:35:42 [auto1.de] INFO: Found listing with ID: FM79917
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM79917%27 HTTP/1.1" 200 None
2026-03-30 07:35:42 [auto1.de] INFO: Scrape type for FM79917: 2
2026-03-30 07:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fa6c351-45e1-524a-8378-e98f3ca8b75f with identifier: FM79917
2026-03-30 07:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fa6c351-45e1-524a-8378-e98f3ca8b75f with scrape type 2
2026-03-30 07:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fa6c351-45e1-524a-8378-e98f3ca8b75f with scrape type 2
2026-03-30 07:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fa6c351-45e1-524a-8378-e98f3ca8b75f, identifier: FM79917
2026-03-30 07:35:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:42 [auto1.de] INFO: Found listing with ID: PY43658
2026-03-30 07:35:42 [auto1.de] INFO: Found listing with ID: PH95596
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH95596%27 HTTP/1.1" 200 None
2026-03-30 07:35:42 [auto1.de] INFO: Scrape type for PH95596: 2
2026-03-30 07:35:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3244ae7d-1c0a-5007-ace1-4b1f2280f7b7 with identifier: PH95596
2026-03-30 07:35:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3244ae7d-1c0a-5007-ace1-4b1f2280f7b7 with scrape type 2
2026-03-30 07:35:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3244ae7d-1c0a-5007-ace1-4b1f2280f7b7 with scrape type 2
2026-03-30 07:35:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3244ae7d-1c0a-5007-ace1-4b1f2280f7b7, identifier: PH95596
2026-03-30 07:35:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fa6c351-45e1-524a-8378-e98f3ca8b75f with identifier: FM79917
2026-03-30 07:35:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fa6c351-45e1-524a-8378-e98f3ca8b75f with identifier: FM79917
2026-03-30 07:35:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fa6c351-45e1-524a-8378-e98f3ca8b75f with identifier: FM79917 to the API
2026-03-30 07:35:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:29:20Z',
 'fuel_type': 'petrol',
 'id': '7fa6c351-45e1-524a-8378-e98f3ca8b75f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM79917',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 152123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-08',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 SIDI Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2014}
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM79917%27 HTTP/1.1" 200 None
2026-03-30 07:35:43 [auto1.de] INFO: Saving data for FM79917: {'auction_closing_time': 1774970960.0, 'created_time': 1774118883.513078, 'last_price_update_time': 1774856143.175821}
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM79917') HTTP/1.1" 204 0
2026-03-30 07:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3244ae7d-1c0a-5007-ace1-4b1f2280f7b7 with identifier: PH95596
2026-03-30 07:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3244ae7d-1c0a-5007-ace1-4b1f2280f7b7 with identifier: PH95596
2026-03-30 07:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3244ae7d-1c0a-5007-ace1-4b1f2280f7b7 with identifier: PH95596 to the API
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-31T15:23:25Z',
 'fuel_type': 'diesel',
 'id': '3244ae7d-1c0a-5007-ace1-4b1f2280f7b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH95596',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 67000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-11',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2020}
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH95596%27 HTTP/1.1" 200 None
2026-03-30 07:35:43 [auto1.de] INFO: Saving data for PH95596: {'auction_closing_time': 1774970605.0, 'created_time': 1773304291.973515, 'last_price_update_time': 1774856143.671421}
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH95596') HTTP/1.1" 204 0
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY93423%27 HTTP/1.1" 200 None
2026-03-30 07:35:43 [auto1.de] INFO: Scrape type for MY93423: 2
2026-03-30 07:35:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db7f15bd-8fe8-5a22-a056-9f571d7ebd69 with identifier: MY93423
2026-03-30 07:35:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db7f15bd-8fe8-5a22-a056-9f571d7ebd69 with scrape type 2
2026-03-30 07:35:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db7f15bd-8fe8-5a22-a056-9f571d7ebd69 with scrape type 2
2026-03-30 07:35:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db7f15bd-8fe8-5a22-a056-9f571d7ebd69, identifier: MY93423
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: MN27803
2026-03-30 07:35:43 [auto1.de] INFO: Found listing with ID: LX54044
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX54044%27 HTTP/1.1" 200 None
2026-03-30 07:35:43 [auto1.de] INFO: Scrape type for LX54044: 1
2026-03-30 07:35:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db7f15bd-8fe8-5a22-a056-9f571d7ebd69 with identifier: MY93423
2026-03-30 07:35:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db7f15bd-8fe8-5a22-a056-9f571d7ebd69 with identifier: MY93423
2026-03-30 07:35:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db7f15bd-8fe8-5a22-a056-9f571d7ebd69 with identifier: MY93423 to the API
2026-03-30 07:35:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:44:37Z',
 'fuel_type': 'petrol',
 'id': 'db7f15bd-8fe8-5a22-a056-9f571d7ebd69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MY93423',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 94202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-15',
 'seller_name': None,
 'title': 'Hyundai ix20 1.6 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY93423%27 HTTP/1.1" 200 None
2026-03-30 07:35:44 [auto1.de] INFO: Saving data for MY93423: {'auction_closing_time': 1774971877.0, 'created_time': 1773342153.272223, 'last_price_update_time': 1774856144.367494}
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MY93423') HTTP/1.1" 204 0
2026-03-30 07:35:44 [auto1.de] INFO: Found listing with ID: JS17929
2026-03-30 07:35:44 [auto1.de] INFO: Found listing with ID: LW15180
2026-03-30 07:35:44 [auto1.de] INFO: Found listing with ID: NY45531
2026-03-30 07:35:44 [auto1.de] INFO: Found listing with ID: SB57558
2026-03-30 07:35:44 [auto1.de] INFO: Found listing with ID: LC01777
2026-03-30 07:35:44 [auto1.de] INFO: Found listing with ID: JT74267
2026-03-30 07:35:44 [auto1.de] INFO: Found listing with ID: LF00427
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF00427%27 HTTP/1.1" 200 None
2026-03-30 07:35:44 [auto1.de] INFO: Scrape type for LF00427: 2
2026-03-30 07:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a876132a-7c09-5dab-bd7e-a766dac5f8cf with identifier: LF00427
2026-03-30 07:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a876132a-7c09-5dab-bd7e-a766dac5f8cf with scrape type 2
2026-03-30 07:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a876132a-7c09-5dab-bd7e-a766dac5f8cf with scrape type 2
2026-03-30 07:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a876132a-7c09-5dab-bd7e-a766dac5f8cf, identifier: LF00427
2026-03-30 07:35:44 [auto1.de] INFO: Found listing with ID: FC32673
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC32673%27 HTTP/1.1" 200 None
2026-03-30 07:35:44 [auto1.de] INFO: Scrape type for FC32673: 2
2026-03-30 07:35:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86f6f4fb-feef-54b0-9bd2-9314ed68e8ba with identifier: FC32673
2026-03-30 07:35:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86f6f4fb-feef-54b0-9bd2-9314ed68e8ba with scrape type 2
2026-03-30 07:35:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86f6f4fb-feef-54b0-9bd2-9314ed68e8ba with scrape type 2
2026-03-30 07:35:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86f6f4fb-feef-54b0-9bd2-9314ed68e8ba, identifier: FC32673
2026-03-30 07:35:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a876132a-7c09-5dab-bd7e-a766dac5f8cf with identifier: LF00427
2026-03-30 07:35:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a876132a-7c09-5dab-bd7e-a766dac5f8cf with identifier: LF00427
2026-03-30 07:35:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a876132a-7c09-5dab-bd7e-a766dac5f8cf with identifier: LF00427 to the API
2026-03-30 07:35:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:42:52Z',
 'fuel_type': 'petrol',
 'id': 'a876132a-7c09-5dab-bd7e-a766dac5f8cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF00427',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 178134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF00427%27 HTTP/1.1" 200 None
2026-03-30 07:35:45 [auto1.de] INFO: Saving data for LF00427: {'auction_closing_time': 1774971772.0, 'created_time': 1773138758.99913, 'last_price_update_time': 1774856145.343406}
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF00427') HTTP/1.1" 204 0
2026-03-30 07:35:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86f6f4fb-feef-54b0-9bd2-9314ed68e8ba with identifier: FC32673
2026-03-30 07:35:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86f6f4fb-feef-54b0-9bd2-9314ed68e8ba with identifier: FC32673
2026-03-30 07:35:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86f6f4fb-feef-54b0-9bd2-9314ed68e8ba with identifier: FC32673 to the API
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:32:52Z',
 'fuel_type': 'petrol',
 'id': '86f6f4fb-feef-54b0-9bd2-9314ed68e8ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC32673',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 220302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-16',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC32673%27 HTTP/1.1" 200 None
2026-03-30 07:35:45 [auto1.de] INFO: Saving data for FC32673: {'auction_closing_time': 1774971172.0, 'created_time': 1773380874.715142, 'last_price_update_time': 1774856145.975487}
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC32673') HTTP/1.1" 204 0
2026-03-30 07:35:45 [auto1.de] INFO: Found listing with ID: MU75641
2026-03-30 07:35:45 [auto1.de] INFO: Found listing with ID: HV93263
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV93263%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Scrape type for HV93263: 2
2026-03-30 07:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 171beede-e001-5ff5-a07b-69c8b9bc72ff with identifier: HV93263
2026-03-30 07:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 171beede-e001-5ff5-a07b-69c8b9bc72ff with scrape type 2
2026-03-30 07:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 171beede-e001-5ff5-a07b-69c8b9bc72ff with scrape type 2
2026-03-30 07:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 171beede-e001-5ff5-a07b-69c8b9bc72ff, identifier: HV93263
2026-03-30 07:35:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: YA43957
2026-03-30 07:35:46 [auto1.de] INFO: Found listing with ID: WP05993
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP05993%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Scrape type for WP05993: 2
2026-03-30 07:35:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 477a2c37-db46-5add-9fd5-c822fe0306f2 with identifier: WP05993
2026-03-30 07:35:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 477a2c37-db46-5add-9fd5-c822fe0306f2 with scrape type 2
2026-03-30 07:35:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 477a2c37-db46-5add-9fd5-c822fe0306f2 with scrape type 2
2026-03-30 07:35:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 477a2c37-db46-5add-9fd5-c822fe0306f2, identifier: WP05993
2026-03-30 07:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 171beede-e001-5ff5-a07b-69c8b9bc72ff with identifier: HV93263
2026-03-30 07:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 171beede-e001-5ff5-a07b-69c8b9bc72ff with identifier: HV93263
2026-03-30 07:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 171beede-e001-5ff5-a07b-69c8b9bc72ff with identifier: HV93263 to the API
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:05:39Z',
 'fuel_type': 'diesel',
 'id': '171beede-e001-5ff5-a07b-69c8b9bc72ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV93263',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 199869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-10',
 'seller_name': None,
 'title': 'Ford Mondeo 2.2 TDCi Titanium X',
 'transmission': 'manual',
 'trim': 'Titanium X',
 'year': 2013}
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV93263%27 HTTP/1.1" 200 None
2026-03-30 07:35:46 [auto1.de] INFO: Saving data for HV93263: {'auction_closing_time': 1774969539.0, 'created_time': 1774349408.233599, 'last_price_update_time': 1774856146.76101}
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV93263') HTTP/1.1" 204 0
2026-03-30 07:35:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 477a2c37-db46-5add-9fd5-c822fe0306f2 with identifier: WP05993
2026-03-30 07:35:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 477a2c37-db46-5add-9fd5-c822fe0306f2 with identifier: WP05993
2026-03-30 07:35:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 477a2c37-db46-5add-9fd5-c822fe0306f2 with identifier: WP05993 to the API
2026-03-30 07:35:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:48:12Z',
 'fuel_type': 'diesel',
 'id': '477a2c37-db46-5add-9fd5-c822fe0306f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP05993',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 241887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-09',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2014}
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP05993%27 HTTP/1.1" 200 None
2026-03-30 07:35:47 [auto1.de] INFO: Saving data for WP05993: {'auction_closing_time': 1774972092.0, 'created_time': 1774377365.841897, 'last_price_update_time': 1774856147.361876}
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP05993') HTTP/1.1" 204 0
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: KT31788
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: PY86398
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY86398%27 HTTP/1.1" 200 None
2026-03-30 07:35:47 [auto1.de] INFO: Scrape type for PY86398: 2
2026-03-30 07:35:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 123497af-3415-5408-8320-e89194d04317 with identifier: PY86398
2026-03-30 07:35:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 123497af-3415-5408-8320-e89194d04317 with scrape type 2
2026-03-30 07:35:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 123497af-3415-5408-8320-e89194d04317 with scrape type 2
2026-03-30 07:35:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 123497af-3415-5408-8320-e89194d04317, identifier: PY86398
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: KF61768
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: VD73221
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: FM79917
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM79917%27 HTTP/1.1" 200 None
2026-03-30 07:35:47 [auto1.de] INFO: Scrape type for FM79917: 0
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: MY93423
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY93423%27 HTTP/1.1" 200 None
2026-03-30 07:35:47 [auto1.de] INFO: Scrape type for MY93423: 0
2026-03-30 07:35:47 [auto1.de] INFO: Found listing with ID: JS17929
2026-03-30 07:35:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 123497af-3415-5408-8320-e89194d04317 with identifier: PY86398
2026-03-30 07:35:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 123497af-3415-5408-8320-e89194d04317 with identifier: PY86398
2026-03-30 07:35:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 123497af-3415-5408-8320-e89194d04317 with identifier: PY86398 to the API
2026-03-30 07:35:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:04:10Z',
 'fuel_type': 'petrol',
 'id': '123497af-3415-5408-8320-e89194d04317',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY86398',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 91956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'Citroen C4 1.4 VTi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2013}
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY86398%27 HTTP/1.1" 200 None
2026-03-30 07:35:48 [auto1.de] INFO: Saving data for PY86398: {'auction_closing_time': 1774969450.0, 'created_time': 1773380516.070927, 'last_price_update_time': 1774856148.553206}
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY86398') HTTP/1.1" 204 0
2026-03-30 07:35:48 [auto1.de] INFO: Found listing with ID: JT36836
2026-03-30 07:35:48 [auto1.de] INFO: Found listing with ID: FH56090
2026-03-30 07:35:48 [auto1.de] INFO: Found listing with ID: MS42171
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS42171%27 HTTP/1.1" 200 None
2026-03-30 07:35:48 [auto1.de] INFO: Scrape type for MS42171: 2
2026-03-30 07:35:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ef98a1e-ab82-50fb-b81d-3eaeda502a33 with identifier: MS42171
2026-03-30 07:35:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ef98a1e-ab82-50fb-b81d-3eaeda502a33 with scrape type 2
2026-03-30 07:35:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ef98a1e-ab82-50fb-b81d-3eaeda502a33 with scrape type 2
2026-03-30 07:35:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ef98a1e-ab82-50fb-b81d-3eaeda502a33, identifier: MS42171
2026-03-30 07:35:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL46234> (referer: https://www.auto1.com/v1/car-details-view/VL46234/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ef98a1e-ab82-50fb-b81d-3eaeda502a33 with identifier: MS42171
2026-03-30 07:35:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ef98a1e-ab82-50fb-b81d-3eaeda502a33 with identifier: MS42171
2026-03-30 07:35:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ef98a1e-ab82-50fb-b81d-3eaeda502a33 with identifier: MS42171 to the API
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-31T15:27:14Z',
 'fuel_type': 'petrol',
 'id': '1ef98a1e-ab82-50fb-b81d-3eaeda502a33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS42171',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 73535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2021}
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS42171%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Saving data for MS42171: {'auction_closing_time': 1774970834.0, 'created_time': 1773304477.324721, 'last_price_update_time': 1774856149.121052}
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS42171') HTTP/1.1" 204 0
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: AE33479
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE33479%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Scrape type for AE33479: 2
2026-03-30 07:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4273381-7cba-52c9-851a-27465d72d33c with identifier: AE33479
2026-03-30 07:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4273381-7cba-52c9-851a-27465d72d33c with scrape type 2
2026-03-30 07:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4273381-7cba-52c9-851a-27465d72d33c with scrape type 2
2026-03-30 07:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4273381-7cba-52c9-851a-27465d72d33c, identifier: AE33479
2026-03-30 07:35:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4273381-7cba-52c9-851a-27465d72d33c with identifier: AE33479
2026-03-30 07:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4273381-7cba-52c9-851a-27465d72d33c with identifier: AE33479
2026-03-30 07:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4273381-7cba-52c9-851a-27465d72d33c with identifier: AE33479 to the API
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 465,
 'expiration_date': '2026-03-31T15:56:58Z',
 'fuel_type': 'hybrid',
 'id': 'c4273381-7cba-52c9-851a-27465d72d33c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE33479',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 73039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-21',
 'seller_name': None,
 'title': 'BMW 7er ActiveHybrid7 L',
 'transmission': 'automatic',
 'trim': 'L',
 'year': 2010}
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE33479%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Saving data for AE33479: {'auction_closing_time': 1774972618.0, 'created_time': 1774380625.341901, 'last_price_update_time': 1774856149.744796}
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE33479') HTTP/1.1" 204 0
2026-03-30 07:35:49 [auto1.de] INFO: Found listing with ID: JR74397
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR74397%27 HTTP/1.1" 200 None
2026-03-30 07:35:49 [auto1.de] INFO: Scrape type for JR74397: 2
2026-03-30 07:35:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85375f17-809b-5264-8f4e-969a90a7e9c1 with identifier: JR74397
2026-03-30 07:35:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85375f17-809b-5264-8f4e-969a90a7e9c1 with scrape type 2
2026-03-30 07:35:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85375f17-809b-5264-8f4e-969a90a7e9c1 with scrape type 2
2026-03-30 07:35:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85375f17-809b-5264-8f4e-969a90a7e9c1, identifier: JR74397
2026-03-30 07:35:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85375f17-809b-5264-8f4e-969a90a7e9c1 with identifier: JR74397
2026-03-30 07:35:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85375f17-809b-5264-8f4e-969a90a7e9c1 with identifier: JR74397
2026-03-30 07:35:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85375f17-809b-5264-8f4e-969a90a7e9c1 with identifier: JR74397 to the API
2026-03-30 07:35:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:03:56Z',
 'fuel_type': 'petrol',
 'id': '85375f17-809b-5264-8f4e-969a90a7e9c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR74397',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 198004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-19',
 'seller_name': None,
 'title': 'Toyota Auris 1.3 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2009}
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR74397%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Saving data for JR74397: {'auction_closing_time': 1774969436.0, 'created_time': 1774293774.662052, 'last_price_update_time': 1774856150.203739}
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR74397') HTTP/1.1" 204 0
2026-03-30 07:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e54d167-7bdf-5d18-9615-f6cff3cb5ad0 with identifier: VL46234
2026-03-30 07:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e54d167-7bdf-5d18-9615-f6cff3cb5ad0 with scrape type 1
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e54d167-7bdf-5d18-9615-f6cff3cb5ad0
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fb4%252F04b4bbca8c5782262177c726e00eb45c%252Fpa%252FVL46234_0d33cf24a34895a43aa2b12f504033f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_0d33cf24a34895a43aa2b12f504033f5.jpg already downloaded
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fb4%252F04b4bbca8c5782262177c726e00eb45c%252Fpa%252FVL46234_559ba62d65e01e1d658c06cad3ed2458.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_559ba62d65e01e1d658c06cad3ed2458.jpg already downloaded
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fb4%252F04b4bbca8c5782262177c726e00eb45c%252Fpa%252FVL46234_8c6d89538798083ef45dd25dac68f9d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_8c6d89538798083ef45dd25dac68f9d8.jpg already downloaded
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fb4%252F04b4bbca8c5782262177c726e00eb45c%252Fpa%252FVL46234_671f9d9d995fd72d5d7ad22505247132.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_671f9d9d995fd72d5d7ad22505247132.jpg already downloaded
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fb4%252F04b4bbca8c5782262177c726e00eb45c%252Fpa%252FVL46234_d1185a13ba588217757f91f394bc0932.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_d1185a13ba588217757f91f394bc0932.jpg already downloaded
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fb4%252F04b4bbca8c5782262177c726e00eb45c%252Fpa%252FVL46234_1ccd5ec18552559596134baefae4ee50.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_1ccd5ec18552559596134baefae4ee50.jpg already downloaded
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fb4%252F04b4bbca8c5782262177c726e00eb45c%252Fpa%252FVL46234_963acdadd02783ea1011156664d9d201.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_963acdadd02783ea1011156664d9d201.jpg already downloaded
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fb4%252F04b4bbca8c5782262177c726e00eb45c%252Fpa%252FVL46234_ba95c5659e08308c227a7f05f16e7769.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_ba95c5659e08308c227a7f05f16e7769.jpg already downloaded
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fb4%252F04b4bbca8c5782262177c726e00eb45c%252Fpa%252FVL46234_50fb3c805024e21daa976298c934a11d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_50fb3c805024e21daa976298c934a11d.jpg already downloaded
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252Fb4%252F04b4bbca8c5782262177c726e00eb45c%252Fpa%252FVL46234_13bc8fe1c9b8d67ddbcedcebc7d1f56c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_13bc8fe1c9b8d67ddbcedcebc7d1f56c.jpg already downloaded
2026-03-30 07:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e54d167-7bdf-5d18-9615-f6cff3cb5ad0, identifier: VL46234
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: VU57107
2026-03-30 07:35:50 [auto1.de] INFO: Found listing with ID: DX26542
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX26542%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Scrape type for DX26542: 2
2026-03-30 07:35:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c059361-6ecb-5275-82b1-d86bad0aa988 with identifier: DX26542
2026-03-30 07:35:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c059361-6ecb-5275-82b1-d86bad0aa988 with scrape type 2
2026-03-30 07:35:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c059361-6ecb-5275-82b1-d86bad0aa988 with scrape type 2
2026-03-30 07:35:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c059361-6ecb-5275-82b1-d86bad0aa988, identifier: DX26542
2026-03-30 07:35:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e54d167-7bdf-5d18-9615-f6cff3cb5ad0 with identifier: VL46234
2026-03-30 07:35:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e54d167-7bdf-5d18-9615-f6cff3cb5ad0 with identifier: VL46234
2026-03-30 07:35:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e54d167-7bdf-5d18-9615-f6cff3cb5ad0 with identifier: VL46234 to the API
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VL46234>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:44:46Z',
 'fuel_type': 'petrol',
 'id': '7e54d167-7bdf-5d18-9615-f6cff3cb5ad0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL46234',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 101322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_0d33cf24a34895a43aa2b12f504033f5.jpg',
                'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_559ba62d65e01e1d658c06cad3ed2458.jpg',
                'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_8c6d89538798083ef45dd25dac68f9d8.jpg',
                'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_671f9d9d995fd72d5d7ad22505247132.jpg',
                'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_d1185a13ba588217757f91f394bc0932.jpg',
                'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_1ccd5ec18552559596134baefae4ee50.jpg',
                'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_963acdadd02783ea1011156664d9d201.jpg',
                'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_ba95c5659e08308c227a7f05f16e7769.jpg',
                'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_50fb3c805024e21daa976298c934a11d.jpg',
                'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_13bc8fe1c9b8d67ddbcedcebc7d1f56c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e54d167-7bdf-5d18-9615-f6cff3cb5ad0/7e54d167-7bdf-5d18-9615-f6cff3cb5ad0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89593,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_0d33cf24a34895a43aa2b12f504033f5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e54d167-7bdf-5d18-9615-f6cff3cb5ad0/7e54d167-7bdf-5d18-9615-f6cff3cb5ad0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_559ba62d65e01e1d658c06cad3ed2458.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e54d167-7bdf-5d18-9615-f6cff3cb5ad0/7e54d167-7bdf-5d18-9615-f6cff3cb5ad0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_8c6d89538798083ef45dd25dac68f9d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e54d167-7bdf-5d18-9615-f6cff3cb5ad0/7e54d167-7bdf-5d18-9615-f6cff3cb5ad0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_671f9d9d995fd72d5d7ad22505247132.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e54d167-7bdf-5d18-9615-f6cff3cb5ad0/7e54d167-7bdf-5d18-9615-f6cff3cb5ad0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_d1185a13ba588217757f91f394bc0932.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e54d167-7bdf-5d18-9615-f6cff3cb5ad0/7e54d167-7bdf-5d18-9615-f6cff3cb5ad0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_1ccd5ec18552559596134baefae4ee50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e54d167-7bdf-5d18-9615-f6cff3cb5ad0/7e54d167-7bdf-5d18-9615-f6cff3cb5ad0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43035,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_963acdadd02783ea1011156664d9d201.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e54d167-7bdf-5d18-9615-f6cff3cb5ad0/7e54d167-7bdf-5d18-9615-f6cff3cb5ad0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2594425,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_ba95c5659e08308c227a7f05f16e7769.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e54d167-7bdf-5d18-9615-f6cff3cb5ad0/7e54d167-7bdf-5d18-9615-f6cff3cb5ad0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_50fb3c805024e21daa976298c934a11d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e54d167-7bdf-5d18-9615-f6cff3cb5ad0/7e54d167-7bdf-5d18-9615-f6cff3cb5ad0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/b4/04b4bbca8c5782262177c726e00eb45c/pa/VL46234_13bc8fe1c9b8d67ddbcedcebc7d1f56c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ateca 1.4 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46234%27 HTTP/1.1" 200 None
2026-03-30 07:35:50 [auto1.de] INFO: Saving data for VL46234: {'created_time': 1774856150.994034, 'last_price_update_time': 1774856150.994047, 'auction_closing_time': 1774971886.0}
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL46234') HTTP/1.1" 204 0
2026-03-30 07:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c059361-6ecb-5275-82b1-d86bad0aa988 with identifier: DX26542
2026-03-30 07:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c059361-6ecb-5275-82b1-d86bad0aa988 with identifier: DX26542
2026-03-30 07:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c059361-6ecb-5275-82b1-d86bad0aa988 with identifier: DX26542 to the API
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:13:41Z',
 'fuel_type': 'diesel',
 'id': '2c059361-6ecb-5275-82b1-d86bad0aa988',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX26542',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 163924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-12-13',
 'seller_name': None,
 'title': 'Toyota Yaris 1.4 D-4D Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2007}
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX26542%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Saving data for DX26542: {'auction_closing_time': 1774970021.0, 'created_time': 1774467682.663177, 'last_price_update_time': 1774856151.357739}
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX26542') HTTP/1.1" 204 0
2026-03-30 07:35:51 [auto1.de] INFO: Channel: 24h | Page: 4 | totalHits: 7595 | hits on page: 40
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: SN70569
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN70569%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for SN70569: 2
2026-03-30 07:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a0f21d9-a7c4-50d6-b6a2-caf3cf4f038e with identifier: SN70569
2026-03-30 07:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a0f21d9-a7c4-50d6-b6a2-caf3cf4f038e with scrape type 2
2026-03-30 07:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a0f21d9-a7c4-50d6-b6a2-caf3cf4f038e with scrape type 2
2026-03-30 07:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a0f21d9-a7c4-50d6-b6a2-caf3cf4f038e, identifier: SN70569
2026-03-30 07:35:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a0f21d9-a7c4-50d6-b6a2-caf3cf4f038e with identifier: SN70569
2026-03-30 07:35:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a0f21d9-a7c4-50d6-b6a2-caf3cf4f038e with identifier: SN70569
2026-03-30 07:35:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a0f21d9-a7c4-50d6-b6a2-caf3cf4f038e with identifier: SN70569 to the API
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:10:45Z',
 'fuel_type': 'diesel',
 'id': '7a0f21d9-a7c4-50d6-b6a2-caf3cf4f038e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN70569',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 171749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN70569%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Saving data for SN70569: {'auction_closing_time': 1774969845.0, 'created_time': 1774377649.236509, 'last_price_update_time': 1774856151.809214}
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN70569') HTTP/1.1" 204 0
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: EH94652
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH94652%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for EH94652: 2
2026-03-30 07:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c680a4f-f4d0-5702-b9b2-9da61a9a91d0 with identifier: EH94652
2026-03-30 07:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c680a4f-f4d0-5702-b9b2-9da61a9a91d0 with scrape type 2
2026-03-30 07:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c680a4f-f4d0-5702-b9b2-9da61a9a91d0 with scrape type 2
2026-03-30 07:35:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c680a4f-f4d0-5702-b9b2-9da61a9a91d0, identifier: EH94652
2026-03-30 07:35:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:51 [auto1.de] INFO: Found listing with ID: JD23265
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23265%27 HTTP/1.1" 200 None
2026-03-30 07:35:51 [auto1.de] INFO: Scrape type for JD23265: 2
2026-03-30 07:35:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ba1c982-a7d2-5b44-8ac5-9401abc9fbd6 with identifier: JD23265
2026-03-30 07:35:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ba1c982-a7d2-5b44-8ac5-9401abc9fbd6 with scrape type 2
2026-03-30 07:35:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ba1c982-a7d2-5b44-8ac5-9401abc9fbd6 with scrape type 2
2026-03-30 07:35:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ba1c982-a7d2-5b44-8ac5-9401abc9fbd6, identifier: JD23265
2026-03-30 07:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c680a4f-f4d0-5702-b9b2-9da61a9a91d0 with identifier: EH94652
2026-03-30 07:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c680a4f-f4d0-5702-b9b2-9da61a9a91d0 with identifier: EH94652
2026-03-30 07:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c680a4f-f4d0-5702-b9b2-9da61a9a91d0 with identifier: EH94652 to the API
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-31T15:30:24Z',
 'fuel_type': 'petrol',
 'id': '5c680a4f-f4d0-5702-b9b2-9da61a9a91d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH94652',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 166509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-08-30',
 'seller_name': None,
 'title': 'Nissan Micra 1.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2000}
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH94652%27 HTTP/1.1" 200 None
2026-03-30 07:35:52 [auto1.de] INFO: Saving data for EH94652: {'auction_closing_time': 1774971024.0, 'created_time': 1774118734.291469, 'last_price_update_time': 1774856152.439984}
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH94652') HTTP/1.1" 204 0
2026-03-30 07:35:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ba1c982-a7d2-5b44-8ac5-9401abc9fbd6 with identifier: JD23265
2026-03-30 07:35:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ba1c982-a7d2-5b44-8ac5-9401abc9fbd6 with identifier: JD23265
2026-03-30 07:35:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ba1c982-a7d2-5b44-8ac5-9401abc9fbd6 with identifier: JD23265 to the API
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:20:31Z',
 'fuel_type': 'diesel',
 'id': '4ba1c982-a7d2-5b44-8ac5-9401abc9fbd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD23265',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 185540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-17',
 'seller_name': None,
 'title': 'Renault Trafic 1.6 dCi L1H1 2,7t Komfort',
 'transmission': 'manual',
 'trim': 'L1H1 2,7t Komfort',
 'year': 2019}
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23265%27 HTTP/1.1" 200 None
2026-03-30 07:35:52 [auto1.de] INFO: Saving data for JD23265: {'auction_closing_time': 1774970431.0, 'created_time': 1774467429.779132, 'last_price_update_time': 1774856152.946098}
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD23265') HTTP/1.1" 204 0
2026-03-30 07:35:52 [auto1.de] INFO: Found listing with ID: XV47342
2026-03-30 07:35:52 [auto1.de] INFO: Found listing with ID: VT28358
2026-03-30 07:35:52 [auto1.de] INFO: Found listing with ID: AD89648
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD89648%27 HTTP/1.1" 200 None
2026-03-30 07:35:52 [auto1.de] INFO: Scrape type for AD89648: 2
2026-03-30 07:35:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71dea47b-d427-58f3-8e04-e1ba7632c31d with identifier: AD89648
2026-03-30 07:35:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71dea47b-d427-58f3-8e04-e1ba7632c31d with scrape type 2
2026-03-30 07:35:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71dea47b-d427-58f3-8e04-e1ba7632c31d with scrape type 2
2026-03-30 07:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71dea47b-d427-58f3-8e04-e1ba7632c31d, identifier: AD89648
2026-03-30 07:35:53 [auto1.de] INFO: Found listing with ID: VR87804
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR87804%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Scrape type for VR87804: 2
2026-03-30 07:35:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c009cb3-7de6-5840-b53c-8392af19a386 with identifier: VR87804
2026-03-30 07:35:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c009cb3-7de6-5840-b53c-8392af19a386 with scrape type 2
2026-03-30 07:35:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c009cb3-7de6-5840-b53c-8392af19a386 with scrape type 2
2026-03-30 07:35:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c009cb3-7de6-5840-b53c-8392af19a386, identifier: VR87804
2026-03-30 07:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71dea47b-d427-58f3-8e04-e1ba7632c31d with identifier: AD89648
2026-03-30 07:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71dea47b-d427-58f3-8e04-e1ba7632c31d with identifier: AD89648
2026-03-30 07:35:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71dea47b-d427-58f3-8e04-e1ba7632c31d with identifier: AD89648 to the API
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-31T15:08:24Z',
 'fuel_type': 'diesel',
 'id': '71dea47b-d427-58f3-8e04-e1ba7632c31d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD89648',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pathfinder',
 'odometer': 360007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-07-13',
 'seller_name': None,
 'title': 'Nissan Pathfinder 2.5 dCi SE',
 'transmission': 'automatic',
 'trim': 'SE',
 'year': 2005}
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD89648%27 HTTP/1.1" 200 None
2026-03-30 07:35:53 [auto1.de] INFO: Saving data for AD89648: {'auction_closing_time': 1774969704.0, 'created_time': 1774349651.137083, 'last_price_update_time': 1774856153.66314}
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD89648') HTTP/1.1" 204 0
2026-03-30 07:35:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX54044/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c009cb3-7de6-5840-b53c-8392af19a386 with identifier: VR87804
2026-03-30 07:35:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c009cb3-7de6-5840-b53c-8392af19a386 with identifier: VR87804
2026-03-30 07:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c009cb3-7de6-5840-b53c-8392af19a386 with identifier: VR87804 to the API
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:49:36Z',
 'fuel_type': 'petrol',
 'id': '3c009cb3-7de6-5840-b53c-8392af19a386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR87804',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 146442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-23',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2012}
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR87804%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Saving data for VR87804: {'auction_closing_time': 1774972176.0, 'created_time': 1774377995.985666, 'last_price_update_time': 1774856154.233066}
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR87804') HTTP/1.1" 204 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: YM49351
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: EP59038
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP59038%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for EP59038: 2
2026-03-30 07:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b85e0ff9-fac6-5b5c-8552-e096b5b8b95a with identifier: EP59038
2026-03-30 07:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b85e0ff9-fac6-5b5c-8552-e096b5b8b95a with scrape type 2
2026-03-30 07:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b85e0ff9-fac6-5b5c-8552-e096b5b8b95a with scrape type 2
2026-03-30 07:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b85e0ff9-fac6-5b5c-8552-e096b5b8b95a, identifier: EP59038
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: KM31933
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: LW16241
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: YP91302
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91302%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for YP91302: 1
2026-03-30 07:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b85e0ff9-fac6-5b5c-8552-e096b5b8b95a with identifier: EP59038
2026-03-30 07:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b85e0ff9-fac6-5b5c-8552-e096b5b8b95a with identifier: EP59038
2026-03-30 07:35:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b85e0ff9-fac6-5b5c-8552-e096b5b8b95a with identifier: EP59038 to the API
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:14:19Z',
 'fuel_type': 'petrol',
 'id': 'b85e0ff9-fac6-5b5c-8552-e096b5b8b95a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP59038',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 84598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-23',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.4 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP59038%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Saving data for EP59038: {'auction_closing_time': 1774970059.0, 'created_time': 1774381383.72336, 'last_price_update_time': 1774856154.759642}
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP59038') HTTP/1.1" 204 0
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: XE63092
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: GS35122
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: VT89208
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: GA83394
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA83394%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for GA83394: 2
2026-03-30 07:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d5d618c-77c1-54c2-ae2a-d4fc410674f5 with identifier: GA83394
2026-03-30 07:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d5d618c-77c1-54c2-ae2a-d4fc410674f5 with scrape type 2
2026-03-30 07:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d5d618c-77c1-54c2-ae2a-d4fc410674f5 with scrape type 2
2026-03-30 07:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d5d618c-77c1-54c2-ae2a-d4fc410674f5, identifier: GA83394
2026-03-30 07:35:54 [auto1.de] INFO: Found listing with ID: GG82433
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG82433%27 HTTP/1.1" 200 None
2026-03-30 07:35:54 [auto1.de] INFO: Scrape type for GG82433: 2
2026-03-30 07:35:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c37bc24-afa5-5762-a653-7e911a775a3e with identifier: GG82433
2026-03-30 07:35:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c37bc24-afa5-5762-a653-7e911a775a3e with scrape type 2
2026-03-30 07:35:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c37bc24-afa5-5762-a653-7e911a775a3e with scrape type 2
2026-03-30 07:35:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c37bc24-afa5-5762-a653-7e911a775a3e, identifier: GG82433
2026-03-30 07:35:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d5d618c-77c1-54c2-ae2a-d4fc410674f5 with identifier: GA83394
2026-03-30 07:35:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d5d618c-77c1-54c2-ae2a-d4fc410674f5 with identifier: GA83394
2026-03-30 07:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d5d618c-77c1-54c2-ae2a-d4fc410674f5 with identifier: GA83394 to the API
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:33:39Z',
 'fuel_type': 'petrol',
 'id': '8d5d618c-77c1-54c2-ae2a-d4fc410674f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA83394',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 68439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-13',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2022}
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA83394%27 HTTP/1.1" 200 None
2026-03-30 07:35:55 [auto1.de] INFO: Saving data for GA83394: {'auction_closing_time': 1774971219.0, 'created_time': 1774380494.685602, 'last_price_update_time': 1774856155.342781}
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA83394') HTTP/1.1" 204 0
2026-03-30 07:35:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c37bc24-afa5-5762-a653-7e911a775a3e with identifier: GG82433
2026-03-30 07:35:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c37bc24-afa5-5762-a653-7e911a775a3e with identifier: GG82433
2026-03-30 07:35:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c37bc24-afa5-5762-a653-7e911a775a3e with identifier: GG82433 to the API
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:29:36Z',
 'fuel_type': 'petrol',
 'id': '4c37bc24-afa5-5762-a653-7e911a775a3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG82433',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 63556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-25',
 'seller_name': None,
 'title': 'Seat Ateca 2.0 TSI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2019}
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG82433%27 HTTP/1.1" 200 None
2026-03-30 07:35:55 [auto1.de] INFO: Saving data for GG82433: {'auction_closing_time': 1774970976.0, 'created_time': 1773775570.087029, 'last_price_update_time': 1774856155.680019}
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG82433') HTTP/1.1" 204 0
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: VS58629
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS58629%27 HTTP/1.1" 200 None
2026-03-30 07:35:55 [auto1.de] INFO: Scrape type for VS58629: 2
2026-03-30 07:35:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f93f0c4-f3f3-58ac-b818-b32735552834 with identifier: VS58629
2026-03-30 07:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f93f0c4-f3f3-58ac-b818-b32735552834 with scrape type 2
2026-03-30 07:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f93f0c4-f3f3-58ac-b818-b32735552834 with scrape type 2
2026-03-30 07:35:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f93f0c4-f3f3-58ac-b818-b32735552834, identifier: VS58629
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: EH94652
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH94652%27 HTTP/1.1" 200 None
2026-03-30 07:35:55 [auto1.de] INFO: Scrape type for EH94652: 0
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: XV47342
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: VT28358
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: AD89648
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD89648%27 HTTP/1.1" 200 None
2026-03-30 07:35:55 [auto1.de] INFO: Scrape type for AD89648: 0
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: YM49351
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: EP59038
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP59038%27 HTTP/1.1" 200 None
2026-03-30 07:35:55 [auto1.de] INFO: Scrape type for EP59038: 0
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: XE63092
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: GS35122
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: VT89208
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: GA83394
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA83394%27 HTTP/1.1" 200 None
2026-03-30 07:35:55 [auto1.de] INFO: Scrape type for GA83394: 0
2026-03-30 07:35:55 [auto1.de] INFO: Found listing with ID: VS58629
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS58629%27 HTTP/1.1" 200 None
2026-03-30 07:35:55 [auto1.de] INFO: Scrape type for VS58629: 2
2026-03-30 07:35:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f93f0c4-f3f3-58ac-b818-b32735552834 with scrape type 2
2026-03-30 07:35:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f93f0c4-f3f3-58ac-b818-b32735552834 with scrape type 2
2026-03-30 07:35:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f93f0c4-f3f3-58ac-b818-b32735552834, identifier: VS58629
2026-03-30 07:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f93f0c4-f3f3-58ac-b818-b32735552834 with identifier: VS58629
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-30 07:35:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f93f0c4-f3f3-58ac-b818-b32735552834 with identifier: VS58629
2026-03-30 07:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f93f0c4-f3f3-58ac-b818-b32735552834 with identifier: VS58629 to the API
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:26:11Z',
 'fuel_type': 'diesel',
 'id': '0f93f0c4-f3f3-58ac-b818-b32735552834',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS58629',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 247818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-25',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS58629%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Saving data for VS58629: {'auction_closing_time': 1774970771.0, 'created_time': 1773688140.168748, 'last_price_update_time': 1774856156.48855}
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS58629') HTTP/1.1" 204 0
2026-03-30 07:35:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:35:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f93f0c4-f3f3-58ac-b818-b32735552834 with identifier: VS58629
2026-03-30 07:35:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f93f0c4-f3f3-58ac-b818-b32735552834 with identifier: VS58629
2026-03-30 07:35:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f93f0c4-f3f3-58ac-b818-b32735552834 with identifier: VS58629 to the API
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:26:11Z',
 'fuel_type': 'diesel',
 'id': '0f93f0c4-f3f3-58ac-b818-b32735552834',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS58629',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 247818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-25',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2012}
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS58629%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Saving data for VS58629: {'auction_closing_time': 1774970771.0, 'created_time': 1773688140.168748, 'last_price_update_time': 1774856156.908546}
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS58629') HTTP/1.1" 204 0
2026-03-30 07:35:56 [auto1.de] INFO: Found listing with ID: ND00067
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND00067%27 HTTP/1.1" 200 None
2026-03-30 07:35:56 [auto1.de] INFO: Scrape type for ND00067: 2
2026-03-30 07:35:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8 with identifier: ND00067
2026-03-30 07:35:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8 with scrape type 2
2026-03-30 07:35:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8 with scrape type 2
2026-03-30 07:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8, identifier: ND00067
2026-03-30 07:35:57 [auto1.de] INFO: Found listing with ID: ND00067
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND00067%27 HTTP/1.1" 200 None
2026-03-30 07:35:57 [auto1.de] INFO: Scrape type for ND00067: 2
2026-03-30 07:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8 with scrape type 2
2026-03-30 07:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8 with scrape type 2
2026-03-30 07:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8, identifier: ND00067
2026-03-30 07:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8 with identifier: ND00067
2026-03-30 07:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8 with identifier: ND00067
2026-03-30 07:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8 with identifier: ND00067 to the API
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:21:28Z',
 'fuel_type': 'petrol',
 'id': '9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND00067',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 104852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-31',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND00067%27 HTTP/1.1" 200 None
2026-03-30 07:35:57 [auto1.de] INFO: Saving data for ND00067: {'auction_closing_time': 1774970488.0, 'created_time': 1774463942.88228, 'last_price_update_time': 1774856157.493515}
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND00067') HTTP/1.1" 204 0
2026-03-30 07:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8 with identifier: ND00067
2026-03-30 07:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8 with identifier: ND00067
2026-03-30 07:35:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8 with identifier: ND00067 to the API
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:21:28Z',
 'fuel_type': 'petrol',
 'id': '9e2391c5-5eb4-5f9f-9a30-a710a80f1cb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND00067',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 104852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-31',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 e-VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND00067%27 HTTP/1.1" 200 None
2026-03-30 07:35:57 [auto1.de] INFO: Saving data for ND00067: {'auction_closing_time': 1774970488.0, 'created_time': 1774463942.88228, 'last_price_update_time': 1774856157.776595}
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND00067') HTTP/1.1" 204 0
2026-03-30 07:35:57 [auto1.de] INFO: Found listing with ID: SH97654
2026-03-30 07:35:57 [auto1.de] INFO: Found listing with ID: KW34435
2026-03-30 07:35:57 [auto1.de] INFO: Found listing with ID: WB92909
2026-03-30 07:35:57 [auto1.de] INFO: Found listing with ID: WX92371
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX92371%27 HTTP/1.1" 200 None
2026-03-30 07:35:57 [auto1.de] INFO: Scrape type for WX92371: 2
2026-03-30 07:35:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68d2d592-bae8-5625-b916-bd808823ea3f with identifier: WX92371
2026-03-30 07:35:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68d2d592-bae8-5625-b916-bd808823ea3f with scrape type 2
2026-03-30 07:35:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68d2d592-bae8-5625-b916-bd808823ea3f with scrape type 2
2026-03-30 07:35:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68d2d592-bae8-5625-b916-bd808823ea3f, identifier: WX92371
2026-03-30 07:35:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68d2d592-bae8-5625-b916-bd808823ea3f with identifier: WX92371
2026-03-30 07:35:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68d2d592-bae8-5625-b916-bd808823ea3f with identifier: WX92371
2026-03-30 07:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68d2d592-bae8-5625-b916-bd808823ea3f with identifier: WX92371 to the API
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:23:33Z',
 'fuel_type': 'petrol',
 'id': '68d2d592-bae8-5625-b916-bd808823ea3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX92371',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 83635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-27',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2021}
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX92371%27 HTTP/1.1" 200 None
2026-03-30 07:35:58 [auto1.de] INFO: Saving data for WX92371: {'auction_closing_time': 1774970613.0, 'created_time': 1774466904.532261, 'last_price_update_time': 1774856158.256852}
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX92371') HTTP/1.1" 204 0
2026-03-30 07:35:58 [auto1.de] INFO: Found listing with ID: XY85080
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85080%27 HTTP/1.1" 200 None
2026-03-30 07:35:58 [auto1.de] INFO: Scrape type for XY85080: 2
2026-03-30 07:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0202fd7-2773-524a-9f3e-4c2aa2e43064 with identifier: XY85080
2026-03-30 07:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0202fd7-2773-524a-9f3e-4c2aa2e43064 with scrape type 2
2026-03-30 07:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0202fd7-2773-524a-9f3e-4c2aa2e43064 with scrape type 2
2026-03-30 07:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0202fd7-2773-524a-9f3e-4c2aa2e43064, identifier: XY85080
2026-03-30 07:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0202fd7-2773-524a-9f3e-4c2aa2e43064 with identifier: XY85080
2026-03-30 07:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0202fd7-2773-524a-9f3e-4c2aa2e43064 with identifier: XY85080
2026-03-30 07:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0202fd7-2773-524a-9f3e-4c2aa2e43064 with identifier: XY85080 to the API
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:57:41Z',
 'fuel_type': 'petrol',
 'id': 'e0202fd7-2773-524a-9f3e-4c2aa2e43064',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY85080',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 109504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-03',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Edition 7 2WD',
 'transmission': 'manual',
 'trim': 'Edition 7 2WD',
 'year': 2015}
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85080%27 HTTP/1.1" 200 None
2026-03-30 07:35:58 [auto1.de] INFO: Saving data for XY85080: {'auction_closing_time': 1774972661.0, 'created_time': 1773301890.200029, 'last_price_update_time': 1774856158.771699}
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY85080') HTTP/1.1" 204 0
2026-03-30 07:35:58 [auto1.de] INFO: Found listing with ID: SV18640
2026-03-30 07:35:58 [auto1.de] INFO: Found listing with ID: LL54952
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL54952%27 HTTP/1.1" 200 None
2026-03-30 07:35:58 [auto1.de] INFO: Scrape type for LL54952: 2
2026-03-30 07:35:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b35cb0e-68df-5164-a4b0-4e830f2fefff with identifier: LL54952
2026-03-30 07:35:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b35cb0e-68df-5164-a4b0-4e830f2fefff with scrape type 2
2026-03-30 07:35:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b35cb0e-68df-5164-a4b0-4e830f2fefff with scrape type 2
2026-03-30 07:35:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b35cb0e-68df-5164-a4b0-4e830f2fefff, identifier: LL54952
2026-03-30 07:35:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b35cb0e-68df-5164-a4b0-4e830f2fefff with identifier: LL54952
2026-03-30 07:35:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b35cb0e-68df-5164-a4b0-4e830f2fefff with identifier: LL54952
2026-03-30 07:35:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b35cb0e-68df-5164-a4b0-4e830f2fefff with identifier: LL54952 to the API
2026-03-30 07:35:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:15:03Z',
 'fuel_type': 'diesel',
 'id': '0b35cb0e-68df-5164-a4b0-4e830f2fefff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL54952',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 120067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-24',
 'seller_name': None,
 'title': 'BMW 3er 330d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL54952%27 HTTP/1.1" 200 None
2026-03-30 07:35:59 [auto1.de] INFO: Saving data for LL54952: {'auction_closing_time': 1774970103.0, 'created_time': 1774467659.713004, 'last_price_update_time': 1774856159.238105}
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL54952') HTTP/1.1" 204 0
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: DM70532
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70532%27 HTTP/1.1" 200 None
2026-03-30 07:35:59 [auto1.de] INFO: Scrape type for DM70532: 2
2026-03-30 07:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42e0f728-990b-5894-acfb-528a9e42cf5e with identifier: DM70532
2026-03-30 07:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42e0f728-990b-5894-acfb-528a9e42cf5e with scrape type 2
2026-03-30 07:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42e0f728-990b-5894-acfb-528a9e42cf5e with scrape type 2
2026-03-30 07:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42e0f728-990b-5894-acfb-528a9e42cf5e, identifier: DM70532
2026-03-30 07:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42e0f728-990b-5894-acfb-528a9e42cf5e with identifier: DM70532
2026-03-30 07:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42e0f728-990b-5894-acfb-528a9e42cf5e with identifier: DM70532
2026-03-30 07:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42e0f728-990b-5894-acfb-528a9e42cf5e with identifier: DM70532 to the API
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:35:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:47:46Z',
 'fuel_type': 'petrol',
 'id': '42e0f728-990b-5894-acfb-528a9e42cf5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM70532',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 75544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-18',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Business',
 'transmission': 'manual',
 'trim': 'Business',
 'year': 2017}
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70532%27 HTTP/1.1" 200 None
2026-03-30 07:35:59 [auto1.de] INFO: Saving data for DM70532: {'auction_closing_time': 1774972066.0, 'created_time': 1774466025.875162, 'last_price_update_time': 1774856159.740708}
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM70532') HTTP/1.1" 204 0
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: EA23074
2026-03-30 07:35:59 [auto1.de] INFO: Found listing with ID: RM09243
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM09243%27 HTTP/1.1" 200 None
2026-03-30 07:35:59 [auto1.de] INFO: Scrape type for RM09243: 2
2026-03-30 07:35:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02c243df-74e5-5c81-ba68-12f6ef550421 with identifier: RM09243
2026-03-30 07:35:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02c243df-74e5-5c81-ba68-12f6ef550421 with scrape type 2
2026-03-30 07:35:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02c243df-74e5-5c81-ba68-12f6ef550421 with scrape type 2
2026-03-30 07:35:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02c243df-74e5-5c81-ba68-12f6ef550421, identifier: RM09243
2026-03-30 07:35:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:35:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02c243df-74e5-5c81-ba68-12f6ef550421 with identifier: RM09243
2026-03-30 07:35:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02c243df-74e5-5c81-ba68-12f6ef550421 with identifier: RM09243
2026-03-30 07:35:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02c243df-74e5-5c81-ba68-12f6ef550421 with identifier: RM09243 to the API
2026-03-30 07:35:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:11:31Z',
 'fuel_type': 'petrol',
 'id': '02c243df-74e5-5c81-ba68-12f6ef550421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM09243',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 133661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2015}
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM09243%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Saving data for RM09243: {'auction_closing_time': 1774969891.0, 'created_time': 1773304202.369799, 'last_price_update_time': 1774856160.26063}
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM09243') HTTP/1.1" 204 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: CW91808
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: FK98396
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK98396%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for FK98396: 2
2026-03-30 07:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82656fbe-377f-55a8-b5f7-11d8e8ccd2a3 with identifier: FK98396
2026-03-30 07:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82656fbe-377f-55a8-b5f7-11d8e8ccd2a3 with scrape type 2
2026-03-30 07:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82656fbe-377f-55a8-b5f7-11d8e8ccd2a3 with scrape type 2
2026-03-30 07:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82656fbe-377f-55a8-b5f7-11d8e8ccd2a3, identifier: FK98396
2026-03-30 07:36:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP91302/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82656fbe-377f-55a8-b5f7-11d8e8ccd2a3 with identifier: FK98396
2026-03-30 07:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82656fbe-377f-55a8-b5f7-11d8e8ccd2a3 with identifier: FK98396
2026-03-30 07:36:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82656fbe-377f-55a8-b5f7-11d8e8ccd2a3 with identifier: FK98396 to the API
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-31T15:19:42Z',
 'fuel_type': 'diesel',
 'id': '82656fbe-377f-55a8-b5f7-11d8e8ccd2a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK98396',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 142277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-01',
 'seller_name': None,
 'title': 'BMW 5er M550d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2019}
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK98396%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Saving data for FK98396: {'auction_closing_time': 1774970382.0, 'created_time': 1774435517.458792, 'last_price_update_time': 1774856160.855033}
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK98396') HTTP/1.1" 204 0
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: TS14604
2026-03-30 07:36:00 [auto1.de] INFO: Found listing with ID: GA97720
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA97720%27 HTTP/1.1" 200 None
2026-03-30 07:36:00 [auto1.de] INFO: Scrape type for GA97720: 2
2026-03-30 07:36:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2419213-c0fe-5f54-a170-5c5e1fbf2fe1 with identifier: GA97720
2026-03-30 07:36:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2419213-c0fe-5f54-a170-5c5e1fbf2fe1 with scrape type 2
2026-03-30 07:36:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2419213-c0fe-5f54-a170-5c5e1fbf2fe1 with scrape type 2
2026-03-30 07:36:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2419213-c0fe-5f54-a170-5c5e1fbf2fe1, identifier: GA97720
2026-03-30 07:36:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2419213-c0fe-5f54-a170-5c5e1fbf2fe1 with identifier: GA97720
2026-03-30 07:36:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2419213-c0fe-5f54-a170-5c5e1fbf2fe1 with identifier: GA97720
2026-03-30 07:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2419213-c0fe-5f54-a170-5c5e1fbf2fe1 with identifier: GA97720 to the API
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:27:16Z',
 'fuel_type': 'petrol',
 'id': 'a2419213-c0fe-5f54-a170-5c5e1fbf2fe1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA97720',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 118687,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-01',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA97720%27 HTTP/1.1" 200 None
2026-03-30 07:36:01 [auto1.de] INFO: Saving data for GA97720: {'auction_closing_time': 1774970836.0, 'created_time': 1773660415.396973, 'last_price_update_time': 1774856161.741396}
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA97720') HTTP/1.1" 204 0
2026-03-30 07:36:01 [auto1.de] INFO: Channel: 24h | Page: 5 | totalHits: 7602 | hits on page: 40
2026-03-30 07:36:01 [auto1.de] INFO: Found listing with ID: CT77406
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT77406%27 HTTP/1.1" 200 None
2026-03-30 07:36:01 [auto1.de] INFO: Scrape type for CT77406: 2
2026-03-30 07:36:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cba9edea-030c-5896-ae16-a35c080ee341 with identifier: CT77406
2026-03-30 07:36:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cba9edea-030c-5896-ae16-a35c080ee341 with scrape type 2
2026-03-30 07:36:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cba9edea-030c-5896-ae16-a35c080ee341 with scrape type 2
2026-03-30 07:36:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cba9edea-030c-5896-ae16-a35c080ee341, identifier: CT77406
2026-03-30 07:36:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cba9edea-030c-5896-ae16-a35c080ee341 with identifier: CT77406
2026-03-30 07:36:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cba9edea-030c-5896-ae16-a35c080ee341 with identifier: CT77406
2026-03-30 07:36:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cba9edea-030c-5896-ae16-a35c080ee341 with identifier: CT77406 to the API
2026-03-30 07:36:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:35:31Z',
 'fuel_type': 'petrol',
 'id': 'cba9edea-030c-5896-ae16-a35c080ee341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT77406',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 189049,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-22',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2017}
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT77406%27 HTTP/1.1" 200 None
2026-03-30 07:36:02 [auto1.de] INFO: Saving data for CT77406: {'auction_closing_time': 1774971331.0, 'created_time': 1774521548.577333, 'last_price_update_time': 1774856162.254726}
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT77406') HTTP/1.1" 204 0
2026-03-30 07:36:02 [auto1.de] INFO: Found listing with ID: KZ13921
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ13921%27 HTTP/1.1" 200 None
2026-03-30 07:36:02 [auto1.de] INFO: Scrape type for KZ13921: 2
2026-03-30 07:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be7888ef-118b-51dc-8ec0-3842ed3250e6 with identifier: KZ13921
2026-03-30 07:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be7888ef-118b-51dc-8ec0-3842ed3250e6 with scrape type 2
2026-03-30 07:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be7888ef-118b-51dc-8ec0-3842ed3250e6 with scrape type 2
2026-03-30 07:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be7888ef-118b-51dc-8ec0-3842ed3250e6, identifier: KZ13921
2026-03-30 07:36:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:02 [auto1.de] INFO: Found listing with ID: DB10875
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB10875%27 HTTP/1.1" 200 None
2026-03-30 07:36:02 [auto1.de] INFO: Scrape type for DB10875: 2
2026-03-30 07:36:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91da130c-56f1-5cc9-bf6f-5c8c76a2339d with identifier: DB10875
2026-03-30 07:36:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91da130c-56f1-5cc9-bf6f-5c8c76a2339d with scrape type 2
2026-03-30 07:36:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91da130c-56f1-5cc9-bf6f-5c8c76a2339d with scrape type 2
2026-03-30 07:36:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91da130c-56f1-5cc9-bf6f-5c8c76a2339d, identifier: DB10875
2026-03-30 07:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be7888ef-118b-51dc-8ec0-3842ed3250e6 with identifier: KZ13921
2026-03-30 07:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be7888ef-118b-51dc-8ec0-3842ed3250e6 with identifier: KZ13921
2026-03-30 07:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be7888ef-118b-51dc-8ec0-3842ed3250e6 with identifier: KZ13921 to the API
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:25:43Z',
 'fuel_type': 'petrol',
 'id': 'be7888ef-118b-51dc-8ec0-3842ed3250e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ13921',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 111333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-23',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ13921%27 HTTP/1.1" 200 None
2026-03-30 07:36:02 [auto1.de] INFO: Saving data for KZ13921: {'auction_closing_time': 1774970743.0, 'created_time': 1774436324.392163, 'last_price_update_time': 1774856162.845702}
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ13921') HTTP/1.1" 204 0
2026-03-30 07:36:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91da130c-56f1-5cc9-bf6f-5c8c76a2339d with identifier: DB10875
2026-03-30 07:36:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91da130c-56f1-5cc9-bf6f-5c8c76a2339d with identifier: DB10875
2026-03-30 07:36:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91da130c-56f1-5cc9-bf6f-5c8c76a2339d with identifier: DB10875 to the API
2026-03-30 07:36:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:47:19Z',
 'fuel_type': 'petrol',
 'id': '91da130c-56f1-5cc9-bf6f-5c8c76a2339d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB10875',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 240806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-23',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2016}
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB10875%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Saving data for DB10875: {'auction_closing_time': 1774972039.0, 'created_time': 1772729734.222081, 'last_price_update_time': 1774856163.236236}
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB10875') HTTP/1.1" 204 0
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: GR74650
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: XT03032
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT03032%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Scrape type for XT03032: 2
2026-03-30 07:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f7b3097-60ba-58cf-a90a-9d4d407f092d with identifier: XT03032
2026-03-30 07:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f7b3097-60ba-58cf-a90a-9d4d407f092d with scrape type 2
2026-03-30 07:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f7b3097-60ba-58cf-a90a-9d4d407f092d with scrape type 2
2026-03-30 07:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f7b3097-60ba-58cf-a90a-9d4d407f092d, identifier: XT03032
2026-03-30 07:36:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: JG98331
2026-03-30 07:36:03 [auto1.de] INFO: Found listing with ID: NH29659
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH29659%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Scrape type for NH29659: 2
2026-03-30 07:36:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19068fc4-8802-5645-8d17-18934007b72d with identifier: NH29659
2026-03-30 07:36:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19068fc4-8802-5645-8d17-18934007b72d with scrape type 2
2026-03-30 07:36:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19068fc4-8802-5645-8d17-18934007b72d with scrape type 2
2026-03-30 07:36:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19068fc4-8802-5645-8d17-18934007b72d, identifier: NH29659
2026-03-30 07:36:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f7b3097-60ba-58cf-a90a-9d4d407f092d with identifier: XT03032
2026-03-30 07:36:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f7b3097-60ba-58cf-a90a-9d4d407f092d with identifier: XT03032
2026-03-30 07:36:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f7b3097-60ba-58cf-a90a-9d4d407f092d with identifier: XT03032 to the API
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:39:22Z',
 'fuel_type': 'diesel',
 'id': '2f7b3097-60ba-58cf-a90a-9d4d407f092d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT03032',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 237973,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-21',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2014}
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT03032%27 HTTP/1.1" 200 None
2026-03-30 07:36:03 [auto1.de] INFO: Saving data for XT03032: {'auction_closing_time': 1774971562.0, 'created_time': 1773306398.237019, 'last_price_update_time': 1774856163.949546}
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT03032') HTTP/1.1" 204 0
2026-03-30 07:36:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX54044> (referer: https://www.auto1.com/v1/car-details-view/LX54044/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19068fc4-8802-5645-8d17-18934007b72d with identifier: NH29659
2026-03-30 07:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19068fc4-8802-5645-8d17-18934007b72d with identifier: NH29659
2026-03-30 07:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19068fc4-8802-5645-8d17-18934007b72d with identifier: NH29659 to the API
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:06:22Z',
 'fuel_type': 'diesel',
 'id': '19068fc4-8802-5645-8d17-18934007b72d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH29659',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 107329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-20',
 'seller_name': None,
 'title': 'Volvo V50 1.6 D Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2008}
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH29659%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Saving data for NH29659: {'auction_closing_time': 1774969582.0, 'created_time': 1774463888.276276, 'last_price_update_time': 1774856164.465507}
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH29659') HTTP/1.1" 204 0
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: DZ69719
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: LC58523
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: XM80704
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: MS18756
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18756%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for MS18756: 2
2026-03-30 07:36:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98b177b6-3523-5a20-8d73-e0f897fd278b with identifier: MS18756
2026-03-30 07:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b177b6-3523-5a20-8d73-e0f897fd278b with scrape type 2
2026-03-30 07:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98b177b6-3523-5a20-8d73-e0f897fd278b with scrape type 2
2026-03-30 07:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98b177b6-3523-5a20-8d73-e0f897fd278b, identifier: MS18756
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: JS22549
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: WU48136
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: KZ13921
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ13921%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for KZ13921: 0
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: GR74650
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: XT03032
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT03032%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for XT03032: 0
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: DZ69719
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: LC58523
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: XM80704
2026-03-30 07:36:04 [auto1.de] INFO: Found listing with ID: MS18756
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18756%27 HTTP/1.1" 200 None
2026-03-30 07:36:04 [auto1.de] INFO: Scrape type for MS18756: 2
2026-03-30 07:36:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b177b6-3523-5a20-8d73-e0f897fd278b with scrape type 2
2026-03-30 07:36:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98b177b6-3523-5a20-8d73-e0f897fd278b with scrape type 2
2026-03-30 07:36:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98b177b6-3523-5a20-8d73-e0f897fd278b, identifier: MS18756
2026-03-30 07:36:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98b177b6-3523-5a20-8d73-e0f897fd278b with identifier: MS18756
2026-03-30 07:36:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98b177b6-3523-5a20-8d73-e0f897fd278b with identifier: MS18756
2026-03-30 07:36:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98b177b6-3523-5a20-8d73-e0f897fd278b with identifier: MS18756 to the API
2026-03-30 07:36:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:04:37Z',
 'fuel_type': 'diesel',
 'id': '98b177b6-3523-5a20-8d73-e0f897fd278b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS18756',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 215252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-10',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2015}
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18756%27 HTTP/1.1" 200 None
2026-03-30 07:36:05 [auto1.de] INFO: Saving data for MS18756: {'auction_closing_time': 1774969477.0, 'created_time': 1774435661.310311, 'last_price_update_time': 1774856165.128227}
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS18756') HTTP/1.1" 204 0
2026-03-30 07:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98b177b6-3523-5a20-8d73-e0f897fd278b with identifier: MS18756
2026-03-30 07:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98b177b6-3523-5a20-8d73-e0f897fd278b with identifier: MS18756
2026-03-30 07:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98b177b6-3523-5a20-8d73-e0f897fd278b with identifier: MS18756 to the API
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:04:37Z',
 'fuel_type': 'diesel',
 'id': '98b177b6-3523-5a20-8d73-e0f897fd278b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS18756',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 215252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-10',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2015}
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS18756%27 HTTP/1.1" 200 None
2026-03-30 07:36:05 [auto1.de] INFO: Saving data for MS18756: {'auction_closing_time': 1774969477.0, 'created_time': 1774435661.310311, 'last_price_update_time': 1774856165.523551}
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS18756') HTTP/1.1" 204 0
2026-03-30 07:36:05 [auto1.de] INFO: Found listing with ID: BH54798
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54798%27 HTTP/1.1" 200 None
2026-03-30 07:36:05 [auto1.de] INFO: Scrape type for BH54798: 2
2026-03-30 07:36:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fd629cb-c730-582c-ab2c-eb46a2a476c3 with identifier: BH54798
2026-03-30 07:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd629cb-c730-582c-ab2c-eb46a2a476c3 with scrape type 2
2026-03-30 07:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fd629cb-c730-582c-ab2c-eb46a2a476c3 with scrape type 2
2026-03-30 07:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fd629cb-c730-582c-ab2c-eb46a2a476c3, identifier: BH54798
2026-03-30 07:36:05 [auto1.de] INFO: Found listing with ID: BH54798
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54798%27 HTTP/1.1" 200 None
2026-03-30 07:36:05 [auto1.de] INFO: Scrape type for BH54798: 2
2026-03-30 07:36:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fd629cb-c730-582c-ab2c-eb46a2a476c3 with scrape type 2
2026-03-30 07:36:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fd629cb-c730-582c-ab2c-eb46a2a476c3 with scrape type 2
2026-03-30 07:36:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fd629cb-c730-582c-ab2c-eb46a2a476c3, identifier: BH54798
2026-03-30 07:36:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fd629cb-c730-582c-ab2c-eb46a2a476c3 with identifier: BH54798
2026-03-30 07:36:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fd629cb-c730-582c-ab2c-eb46a2a476c3 with identifier: BH54798
2026-03-30 07:36:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fd629cb-c730-582c-ab2c-eb46a2a476c3 with identifier: BH54798 to the API
2026-03-30 07:36:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:02:42Z',
 'fuel_type': 'diesel',
 'id': '6fd629cb-c730-582c-ab2c-eb46a2a476c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH54798',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 184064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-16',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Niveau B L1',
 'transmission': 'manual',
 'trim': 'Niveau B L1',
 'year': 2011}
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54798%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [auto1.de] INFO: Saving data for BH54798: {'auction_closing_time': 1774969362.0, 'created_time': 1773775255.226708, 'last_price_update_time': 1774856166.187911}
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH54798') HTTP/1.1" 204 0
2026-03-30 07:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fd629cb-c730-582c-ab2c-eb46a2a476c3 with identifier: BH54798
2026-03-30 07:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fd629cb-c730-582c-ab2c-eb46a2a476c3 with identifier: BH54798
2026-03-30 07:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fd629cb-c730-582c-ab2c-eb46a2a476c3 with identifier: BH54798 to the API
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:02:42Z',
 'fuel_type': 'diesel',
 'id': '6fd629cb-c730-582c-ab2c-eb46a2a476c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH54798',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 184064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-16',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Niveau B L1',
 'transmission': 'manual',
 'trim': 'Niveau B L1',
 'year': 2011}
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54798%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [auto1.de] INFO: Saving data for BH54798: {'auction_closing_time': 1774969362.0, 'created_time': 1773775255.226708, 'last_price_update_time': 1774856166.488838}
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH54798') HTTP/1.1" 204 0
2026-03-30 07:36:06 [auto1.de] INFO: Found listing with ID: WU88616
2026-03-30 07:36:06 [auto1.de] INFO: Found listing with ID: ZM28041
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM28041%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [auto1.de] INFO: Scrape type for ZM28041: 2
2026-03-30 07:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8623e38d-9d22-5e2d-8cc1-4e974b6beb33 with identifier: ZM28041
2026-03-30 07:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8623e38d-9d22-5e2d-8cc1-4e974b6beb33 with scrape type 2
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8623e38d-9d22-5e2d-8cc1-4e974b6beb33 with scrape type 2
2026-03-30 07:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8623e38d-9d22-5e2d-8cc1-4e974b6beb33, identifier: ZM28041
2026-03-30 07:36:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c68148d-4de7-5ecb-a1fe-633b1ac52fa5 with identifier: LX54044
2026-03-30 07:36:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c68148d-4de7-5ecb-a1fe-633b1ac52fa5 with scrape type 1
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c68148d-4de7-5ecb-a1fe-633b1ac52fa5
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F87%252Ff387f9400a500efe88346602cc65a4f2%252Fpa%252FLX54044_514ed990d4d7a5b1239234895ab71187.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_514ed990d4d7a5b1239234895ab71187.jpg already downloaded
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F87%252Ff387f9400a500efe88346602cc65a4f2%252Fpa%252FLX54044_d406dfd15f6cfd5846102d83b36b5ad8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_d406dfd15f6cfd5846102d83b36b5ad8.jpg already downloaded
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F87%252Ff387f9400a500efe88346602cc65a4f2%252Fpa%252FLX54044_ebece89c2134fdf6448734b69adc63b8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_ebece89c2134fdf6448734b69adc63b8.jpg already downloaded
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F87%252Ff387f9400a500efe88346602cc65a4f2%252Fpa%252FLX54044_b2bc1d7f8415b80d09efe1af67d87a26.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_b2bc1d7f8415b80d09efe1af67d87a26.jpg already downloaded
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F87%252Ff387f9400a500efe88346602cc65a4f2%252Fpa%252FLX54044_15a535d271a56c60395575190e0aa316.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_15a535d271a56c60395575190e0aa316.jpg already downloaded
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F87%252Ff387f9400a500efe88346602cc65a4f2%252Fpa%252FLX54044_8b5bdab380680dcd6f2348dd0d25691f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_8b5bdab380680dcd6f2348dd0d25691f.jpg already downloaded
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F87%252Ff387f9400a500efe88346602cc65a4f2%252Fpa%252FLX54044_95359de3190ab82656e30774df8b9afd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_95359de3190ab82656e30774df8b9afd.jpg already downloaded
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F87%252Ff387f9400a500efe88346602cc65a4f2%252Fpa%252FLX54044_d339011906f332c791b569755e52a615.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_d339011906f332c791b569755e52a615.jpg already downloaded
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F87%252Ff387f9400a500efe88346602cc65a4f2%252Fpa%252FLX54044_f63e3527106a816abd21a18852971181.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_f63e3527106a816abd21a18852971181.jpg already downloaded
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F87%252Ff387f9400a500efe88346602cc65a4f2%252Fpa%252FLX54044_8e8bc4b98777c4b85f0bd075183a6bef.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_8e8bc4b98777c4b85f0bd075183a6bef.jpg already downloaded
2026-03-30 07:36:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c68148d-4de7-5ecb-a1fe-633b1ac52fa5, identifier: LX54044
2026-03-30 07:36:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8623e38d-9d22-5e2d-8cc1-4e974b6beb33 with identifier: ZM28041
2026-03-30 07:36:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8623e38d-9d22-5e2d-8cc1-4e974b6beb33 with identifier: ZM28041
2026-03-30 07:36:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8623e38d-9d22-5e2d-8cc1-4e974b6beb33 with identifier: ZM28041 to the API
2026-03-30 07:36:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-31T15:21:26Z',
 'fuel_type': 'petrol',
 'id': '8623e38d-9d22-5e2d-8cc1-4e974b6beb33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM28041',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 9395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-03',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.3 TCE Mild-Hybrid Intro Edition',
 'transmission': 'automatic',
 'trim': 'Intro Edition',
 'year': 2023}
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM28041%27 HTTP/1.1" 200 None
2026-03-30 07:36:07 [auto1.de] INFO: Saving data for ZM28041: {'auction_closing_time': 1774970486.0, 'created_time': 1773725752.10062, 'last_price_update_time': 1774856167.231488}
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM28041') HTTP/1.1" 204 0
2026-03-30 07:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c68148d-4de7-5ecb-a1fe-633b1ac52fa5 with identifier: LX54044
2026-03-30 07:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c68148d-4de7-5ecb-a1fe-633b1ac52fa5 with identifier: LX54044
2026-03-30 07:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c68148d-4de7-5ecb-a1fe-633b1ac52fa5 with identifier: LX54044 to the API
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX54044>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:32:10Z',
 'fuel_type': 'petrol',
 'id': '7c68148d-4de7-5ecb-a1fe-633b1ac52fa5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX54044',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 89064,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_514ed990d4d7a5b1239234895ab71187.jpg',
                'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_d406dfd15f6cfd5846102d83b36b5ad8.jpg',
                'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_ebece89c2134fdf6448734b69adc63b8.jpg',
                'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_b2bc1d7f8415b80d09efe1af67d87a26.jpg',
                'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_15a535d271a56c60395575190e0aa316.jpg',
                'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_8b5bdab380680dcd6f2348dd0d25691f.jpg',
                'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_95359de3190ab82656e30774df8b9afd.jpg',
                'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_d339011906f332c791b569755e52a615.jpg',
                'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_f63e3527106a816abd21a18852971181.jpg',
                'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_8e8bc4b98777c4b85f0bd075183a6bef.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c68148d-4de7-5ecb-a1fe-633b1ac52fa5/7c68148d-4de7-5ecb-a1fe-633b1ac52fa5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75763,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_514ed990d4d7a5b1239234895ab71187.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c68148d-4de7-5ecb-a1fe-633b1ac52fa5/7c68148d-4de7-5ecb-a1fe-633b1ac52fa5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_d406dfd15f6cfd5846102d83b36b5ad8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c68148d-4de7-5ecb-a1fe-633b1ac52fa5/7c68148d-4de7-5ecb-a1fe-633b1ac52fa5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_ebece89c2134fdf6448734b69adc63b8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c68148d-4de7-5ecb-a1fe-633b1ac52fa5/7c68148d-4de7-5ecb-a1fe-633b1ac52fa5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_b2bc1d7f8415b80d09efe1af67d87a26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c68148d-4de7-5ecb-a1fe-633b1ac52fa5/7c68148d-4de7-5ecb-a1fe-633b1ac52fa5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_15a535d271a56c60395575190e0aa316.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c68148d-4de7-5ecb-a1fe-633b1ac52fa5/7c68148d-4de7-5ecb-a1fe-633b1ac52fa5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_8b5bdab380680dcd6f2348dd0d25691f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c68148d-4de7-5ecb-a1fe-633b1ac52fa5/7c68148d-4de7-5ecb-a1fe-633b1ac52fa5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_95359de3190ab82656e30774df8b9afd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c68148d-4de7-5ecb-a1fe-633b1ac52fa5/7c68148d-4de7-5ecb-a1fe-633b1ac52fa5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75314,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_d339011906f332c791b569755e52a615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c68148d-4de7-5ecb-a1fe-633b1ac52fa5/7c68148d-4de7-5ecb-a1fe-633b1ac52fa5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_f63e3527106a816abd21a18852971181.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c68148d-4de7-5ecb-a1fe-633b1ac52fa5/7c68148d-4de7-5ecb-a1fe-633b1ac52fa5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/87/f387f9400a500efe88346602cc65a4f2/pa/LX54044_8e8bc4b98777c4b85f0bd075183a6bef.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-10',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Basis BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Basis BlueMotion Tech',
 'year': 2011}
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX54044%27 HTTP/1.1" 200 None
2026-03-30 07:36:07 [auto1.de] INFO: Saving data for LX54044: {'created_time': 1774856167.580588, 'last_price_update_time': 1774856167.5806, 'auction_closing_time': 1774971130.0}
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX54044') HTTP/1.1" 204 0
2026-03-30 07:36:07 [scrapy.extensions.logstats] INFO: Crawled 14 pages (at 14 pages/min), scraped 80 items (at 80 items/min)
2026-03-30 07:36:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 156MiB
2026-03-30 07:36:07 [auto1.de] INFO: Found listing with ID: SM60062
2026-03-30 07:36:07 [auto1.de] INFO: Found listing with ID: UD08597
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD08597%27 HTTP/1.1" 200 None
2026-03-30 07:36:07 [auto1.de] INFO: Scrape type for UD08597: 2
2026-03-30 07:36:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1d54a65-f25f-58db-bc62-c895e5ceae80 with identifier: UD08597
2026-03-30 07:36:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1d54a65-f25f-58db-bc62-c895e5ceae80 with scrape type 2
2026-03-30 07:36:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1d54a65-f25f-58db-bc62-c895e5ceae80 with scrape type 2
2026-03-30 07:36:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1d54a65-f25f-58db-bc62-c895e5ceae80, identifier: UD08597
2026-03-30 07:36:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1d54a65-f25f-58db-bc62-c895e5ceae80 with identifier: UD08597
2026-03-30 07:36:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1d54a65-f25f-58db-bc62-c895e5ceae80 with identifier: UD08597
2026-03-30 07:36:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1d54a65-f25f-58db-bc62-c895e5ceae80 with identifier: UD08597 to the API
2026-03-30 07:36:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:42:42Z',
 'fuel_type': 'diesel',
 'id': 'b1d54a65-f25f-58db-bc62-c895e5ceae80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD08597',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 210681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-08',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum 2WD',
 'year': 2016}
2026-03-30 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD08597%27 HTTP/1.1" 200 None
2026-03-30 07:36:08 [auto1.de] INFO: Saving data for UD08597: {'auction_closing_time': 1774971762.0, 'created_time': 1773426969.501177, 'last_price_update_time': 1774856168.169438}
2026-03-30 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD08597') HTTP/1.1" 204 0
2026-03-30 07:36:08 [auto1.de] INFO: Found listing with ID: KU34267
2026-03-30 07:36:08 [auto1.de] INFO: Found listing with ID: CT69735
2026-03-30 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT69735%27 HTTP/1.1" 200 None
2026-03-30 07:36:08 [auto1.de] INFO: Scrape type for CT69735: 2
2026-03-30 07:36:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4a4918c-2ca7-5a90-8105-90265f3d5a45 with identifier: CT69735
2026-03-30 07:36:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4a4918c-2ca7-5a90-8105-90265f3d5a45 with scrape type 2
2026-03-30 07:36:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4a4918c-2ca7-5a90-8105-90265f3d5a45 with scrape type 2
2026-03-30 07:36:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4a4918c-2ca7-5a90-8105-90265f3d5a45, identifier: CT69735
2026-03-30 07:36:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4a4918c-2ca7-5a90-8105-90265f3d5a45 with identifier: CT69735
2026-03-30 07:36:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4a4918c-2ca7-5a90-8105-90265f3d5a45 with identifier: CT69735
2026-03-30 07:36:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4a4918c-2ca7-5a90-8105-90265f3d5a45 with identifier: CT69735 to the API
2026-03-30 07:36:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:09:41Z',
 'fuel_type': 'diesel',
 'id': 'c4a4918c-2ca7-5a90-8105-90265f3d5a45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT69735',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 104919,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-13',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi Bi-Turbo Sport 4x4',
 'transmission': 'automatic',
 'trim': 'Sport 4x4',
 'year': 2016}
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT69735%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Saving data for CT69735: {'auction_closing_time': 1774969781.0, 'created_time': 1774464541.042925, 'last_price_update_time': 1774856170.346034}
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT69735') HTTP/1.1" 204 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: NA97113
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: KH68440
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: NM38216
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: DS39411
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: KA78171
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: DL52557
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL52557%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for DL52557: 2
2026-03-30 07:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf24ba3f-ae5e-5b7e-b244-6df1f6da26f4 with identifier: DL52557
2026-03-30 07:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf24ba3f-ae5e-5b7e-b244-6df1f6da26f4 with scrape type 2
2026-03-30 07:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf24ba3f-ae5e-5b7e-b244-6df1f6da26f4 with scrape type 2
2026-03-30 07:36:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf24ba3f-ae5e-5b7e-b244-6df1f6da26f4, identifier: DL52557
2026-03-30 07:36:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf24ba3f-ae5e-5b7e-b244-6df1f6da26f4 with identifier: DL52557
2026-03-30 07:36:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf24ba3f-ae5e-5b7e-b244-6df1f6da26f4 with identifier: DL52557
2026-03-30 07:36:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf24ba3f-ae5e-5b7e-b244-6df1f6da26f4 with identifier: DL52557 to the API
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:14:55Z',
 'fuel_type': 'petrol',
 'id': 'cf24ba3f-ae5e-5b7e-b244-6df1f6da26f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL52557',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 79883,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-06',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 220 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2019}
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL52557%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Saving data for DL52557: {'auction_closing_time': 1774970095.0, 'created_time': 1773345215.011254, 'last_price_update_time': 1774856170.814302}
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL52557') HTTP/1.1" 204 0
2026-03-30 07:36:10 [auto1.de] INFO: Found listing with ID: KK91301
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK91301%27 HTTP/1.1" 200 None
2026-03-30 07:36:10 [auto1.de] INFO: Scrape type for KK91301: 2
2026-03-30 07:36:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cececc0c-6012-5d6d-ab7d-7915c443010c with identifier: KK91301
2026-03-30 07:36:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cececc0c-6012-5d6d-ab7d-7915c443010c with scrape type 2
2026-03-30 07:36:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cececc0c-6012-5d6d-ab7d-7915c443010c with scrape type 2
2026-03-30 07:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cececc0c-6012-5d6d-ab7d-7915c443010c, identifier: KK91301
2026-03-30 07:36:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP91302> (referer: https://www.auto1.com/v1/car-details-view/YP91302/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cececc0c-6012-5d6d-ab7d-7915c443010c with identifier: KK91301
2026-03-30 07:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cececc0c-6012-5d6d-ab7d-7915c443010c with identifier: KK91301
2026-03-30 07:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cececc0c-6012-5d6d-ab7d-7915c443010c with identifier: KK91301 to the API
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:04:26Z',
 'fuel_type': 'diesel',
 'id': 'cececc0c-6012-5d6d-ab7d-7915c443010c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK91301',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 295983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-13',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK91301%27 HTTP/1.1" 200 None
2026-03-30 07:36:11 [auto1.de] INFO: Saving data for KK91301: {'auction_closing_time': 1774969466.0, 'created_time': 1774380219.833276, 'last_price_update_time': 1774856171.40672}
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK91301') HTTP/1.1" 204 0
2026-03-30 07:36:11 [auto1.de] INFO: Channel: 24h | Page: 6 | totalHits: 7611 | hits on page: 40
2026-03-30 07:36:11 [auto1.de] INFO: Found listing with ID: XP97772
2026-03-30 07:36:11 [auto1.de] INFO: Found listing with ID: AS97650
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS97650%27 HTTP/1.1" 200 None
2026-03-30 07:36:11 [auto1.de] INFO: Scrape type for AS97650: 2
2026-03-30 07:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2731f5da-ba24-56a0-9cdb-4499959adc7e with identifier: AS97650
2026-03-30 07:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2731f5da-ba24-56a0-9cdb-4499959adc7e with scrape type 2
2026-03-30 07:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2731f5da-ba24-56a0-9cdb-4499959adc7e with scrape type 2
2026-03-30 07:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2731f5da-ba24-56a0-9cdb-4499959adc7e, identifier: AS97650
2026-03-30 07:36:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2731f5da-ba24-56a0-9cdb-4499959adc7e with identifier: AS97650
2026-03-30 07:36:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2731f5da-ba24-56a0-9cdb-4499959adc7e with identifier: AS97650
2026-03-30 07:36:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2731f5da-ba24-56a0-9cdb-4499959adc7e with identifier: AS97650 to the API
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 350,
 'expiration_date': '2026-03-31T15:50:58Z',
 'fuel_type': 'petrol',
 'id': '2731f5da-ba24-56a0-9cdb-4499959adc7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS97650',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 69807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-07',
 'seller_name': None,
 'title': 'Ford Focus 2.3 EcoBoost RS',
 'transmission': 'manual',
 'trim': 'RS',
 'year': 2017}
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS97650%27 HTTP/1.1" 200 None
2026-03-30 07:36:11 [auto1.de] INFO: Saving data for AS97650: {'auction_closing_time': 1774972258.0, 'created_time': 1774380927.078615, 'last_price_update_time': 1774856171.875518}
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS97650') HTTP/1.1" 204 0
2026-03-30 07:36:11 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG52732%27 HTTP/1.1" 200 None
2026-03-30 07:36:11 [auto1.de] INFO: Scrape type for XG52732: 2
2026-03-30 07:36:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75edeb63-f6d6-552b-a8d1-52ff21ef2aa2 with identifier: XG52732
2026-03-30 07:36:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75edeb63-f6d6-552b-a8d1-52ff21ef2aa2 with scrape type 2
2026-03-30 07:36:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75edeb63-f6d6-552b-a8d1-52ff21ef2aa2 with scrape type 2
2026-03-30 07:36:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75edeb63-f6d6-552b-a8d1-52ff21ef2aa2, identifier: XG52732
2026-03-30 07:36:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:11 [auto1.de] INFO: Found listing with ID: GJ82091
2026-03-30 07:36:11 [auto1.de] INFO: Found listing with ID: VV40094
2026-03-30 07:36:11 [auto1.de] INFO: Found listing with ID: WJ35456
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35456%27 HTTP/1.1" 200 None
2026-03-30 07:36:12 [auto1.de] INFO: Scrape type for WJ35456: 2
2026-03-30 07:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2efcd7ea-28f5-5616-be84-c05bc386410c with identifier: WJ35456
2026-03-30 07:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2efcd7ea-28f5-5616-be84-c05bc386410c with scrape type 2
2026-03-30 07:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2efcd7ea-28f5-5616-be84-c05bc386410c with scrape type 2
2026-03-30 07:36:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2efcd7ea-28f5-5616-be84-c05bc386410c, identifier: WJ35456
2026-03-30 07:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75edeb63-f6d6-552b-a8d1-52ff21ef2aa2 with identifier: XG52732
2026-03-30 07:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75edeb63-f6d6-552b-a8d1-52ff21ef2aa2 with identifier: XG52732
2026-03-30 07:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75edeb63-f6d6-552b-a8d1-52ff21ef2aa2 with identifier: XG52732 to the API
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-31T15:10:59Z',
 'fuel_type': 'diesel',
 'id': '75edeb63-f6d6-552b-a8d1-52ff21ef2aa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG52732',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 172902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-30',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 400 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG52732%27 HTTP/1.1" 200 None
2026-03-30 07:36:12 [auto1.de] INFO: Saving data for XG52732: {'auction_closing_time': 1774969859.0, 'created_time': 1773303753.158944, 'last_price_update_time': 1774856172.541247}
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XG52732') HTTP/1.1" 204 0
2026-03-30 07:36:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2efcd7ea-28f5-5616-be84-c05bc386410c with identifier: WJ35456
2026-03-30 07:36:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2efcd7ea-28f5-5616-be84-c05bc386410c with identifier: WJ35456
2026-03-30 07:36:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2efcd7ea-28f5-5616-be84-c05bc386410c with identifier: WJ35456 to the API
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:11:45Z',
 'fuel_type': 'petrol',
 'id': '2efcd7ea-28f5-5616-be84-c05bc386410c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ35456',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 177487,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2012}
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35456%27 HTTP/1.1" 200 None
2026-03-30 07:36:12 [auto1.de] INFO: Saving data for WJ35456: {'auction_closing_time': 1774969905.0, 'created_time': 1773343841.56968, 'last_price_update_time': 1774856172.903312}
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ35456') HTTP/1.1" 204 0
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: ZH99212
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: AF65109
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: VC66912
2026-03-30 07:36:12 [auto1.de] INFO: Found listing with ID: PF21402
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF21402%27 HTTP/1.1" 200 None
2026-03-30 07:36:12 [auto1.de] INFO: Scrape type for PF21402: 2
2026-03-30 07:36:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35e8407a-e173-5074-a6b1-8e92b453e18d with identifier: PF21402
2026-03-30 07:36:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35e8407a-e173-5074-a6b1-8e92b453e18d with scrape type 2
2026-03-30 07:36:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35e8407a-e173-5074-a6b1-8e92b453e18d with scrape type 2
2026-03-30 07:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35e8407a-e173-5074-a6b1-8e92b453e18d, identifier: PF21402
2026-03-30 07:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77bf57c3-aed0-5c8e-be7a-35a6158284f1 with identifier: YP91302
2026-03-30 07:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1 with scrape type 1
2026-03-30 07:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_844e14c737608a4194a0dfee7bdd2eac.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_844e14c737608a4194a0dfee7bdd2eac.jpg not downloaded yet
2026-03-30 07:36:13 [auto1.de] INFO: Found listing with ID: XF49404
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF49404%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Scrape type for XF49404: 2
2026-03-30 07:36:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6a22cec-65ab-5fb2-b43f-6fb3b05ae330 with identifier: XF49404
2026-03-30 07:36:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a22cec-65ab-5fb2-b43f-6fb3b05ae330 with scrape type 2
2026-03-30 07:36:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6a22cec-65ab-5fb2-b43f-6fb3b05ae330 with scrape type 2
2026-03-30 07:36:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6a22cec-65ab-5fb2-b43f-6fb3b05ae330, identifier: XF49404
2026-03-30 07:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35e8407a-e173-5074-a6b1-8e92b453e18d with identifier: PF21402
2026-03-30 07:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35e8407a-e173-5074-a6b1-8e92b453e18d with identifier: PF21402
2026-03-30 07:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35e8407a-e173-5074-a6b1-8e92b453e18d with identifier: PF21402 to the API
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-31T15:57:15Z',
 'fuel_type': 'diesel',
 'id': '35e8407a-e173-5074-a6b1-8e92b453e18d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF21402',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 367580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-12',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF21402%27 HTTP/1.1" 200 None
2026-03-30 07:36:13 [auto1.de] INFO: Saving data for PF21402: {'auction_closing_time': 1774972635.0, 'created_time': 1773307721.336094, 'last_price_update_time': 1774856173.78007}
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF21402') HTTP/1.1" 204 0
2026-03-30 07:36:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6a22cec-65ab-5fb2-b43f-6fb3b05ae330 with identifier: XF49404
2026-03-30 07:36:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6a22cec-65ab-5fb2-b43f-6fb3b05ae330 with identifier: XF49404
2026-03-30 07:36:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6a22cec-65ab-5fb2-b43f-6fb3b05ae330 with identifier: XF49404 to the API
2026-03-30 07:36:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:09:21Z',
 'fuel_type': 'hybrid',
 'id': 'd6a22cec-65ab-5fb2-b43f-6fb3b05ae330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF49404',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 59167,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-17',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250e AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2020}
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF49404%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Saving data for XF49404: {'auction_closing_time': 1774969761.0, 'created_time': 1773380685.927787, 'last_price_update_time': 1774856174.24787}
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF49404') HTTP/1.1" 204 0
2026-03-30 07:36:14 [auto1.de] INFO: Found listing with ID: FY91209
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91209%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Scrape type for FY91209: 2
2026-03-30 07:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a9f0e6f-5bcc-54c5-90e9-e0e5e60877f6 with identifier: FY91209
2026-03-30 07:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a9f0e6f-5bcc-54c5-90e9-e0e5e60877f6 with scrape type 2
2026-03-30 07:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a9f0e6f-5bcc-54c5-90e9-e0e5e60877f6 with scrape type 2
2026-03-30 07:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a9f0e6f-5bcc-54c5-90e9-e0e5e60877f6, identifier: FY91209
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_9390b3238ebb8dd366f2c0b54cf1ca3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_9390b3238ebb8dd366f2c0b54cf1ca3b.jpg not downloaded yet
2026-03-30 07:36:14 [auto1.de] INFO: Found listing with ID: KE08458
2026-03-30 07:36:14 [auto1.de] INFO: Found listing with ID: UM54862
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM54862%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Scrape type for UM54862: 2
2026-03-30 07:36:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 870bc3ee-8b1c-575a-a048-f10baa23817d with identifier: UM54862
2026-03-30 07:36:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 870bc3ee-8b1c-575a-a048-f10baa23817d with scrape type 2
2026-03-30 07:36:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 870bc3ee-8b1c-575a-a048-f10baa23817d with scrape type 2
2026-03-30 07:36:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 870bc3ee-8b1c-575a-a048-f10baa23817d, identifier: UM54862
2026-03-30 07:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a9f0e6f-5bcc-54c5-90e9-e0e5e60877f6 with identifier: FY91209
2026-03-30 07:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a9f0e6f-5bcc-54c5-90e9-e0e5e60877f6 with identifier: FY91209
2026-03-30 07:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a9f0e6f-5bcc-54c5-90e9-e0e5e60877f6 with identifier: FY91209 to the API
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:10:32Z',
 'fuel_type': 'diesel',
 'id': '4a9f0e6f-5bcc-54c5-90e9-e0e5e60877f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY91209',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 37958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-10',
 'seller_name': None,
 'title': 'Audi A4 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2023}
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91209%27 HTTP/1.1" 200 None
2026-03-30 07:36:14 [auto1.de] INFO: Saving data for FY91209: {'auction_closing_time': 1774969832.0, 'created_time': 1773303488.452923, 'last_price_update_time': 1774856174.858021}
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY91209') HTTP/1.1" 204 0
2026-03-30 07:36:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 870bc3ee-8b1c-575a-a048-f10baa23817d with identifier: UM54862
2026-03-30 07:36:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 870bc3ee-8b1c-575a-a048-f10baa23817d with identifier: UM54862
2026-03-30 07:36:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 870bc3ee-8b1c-575a-a048-f10baa23817d with identifier: UM54862 to the API
2026-03-30 07:36:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:59:54Z',
 'fuel_type': 'diesel',
 'id': '870bc3ee-8b1c-575a-a048-f10baa23817d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM54862',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 221466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-19',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM54862%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Saving data for UM54862: {'auction_closing_time': 1774972794.0, 'created_time': 1773387622.743225, 'last_price_update_time': 1774856175.215101}
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM54862') HTTP/1.1" 204 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: HC53321
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: YM22646
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: PT02757
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: UY83334
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: KD43899
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: CU14282
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: HN95943
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN95943%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for HN95943: 2
2026-03-30 07:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5543e478-6b56-57fb-bb88-19e7915dafac with identifier: HN95943
2026-03-30 07:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5543e478-6b56-57fb-bb88-19e7915dafac with scrape type 2
2026-03-30 07:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5543e478-6b56-57fb-bb88-19e7915dafac with scrape type 2
2026-03-30 07:36:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5543e478-6b56-57fb-bb88-19e7915dafac, identifier: HN95943
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_ea56d654c39113da02742598b3a9bacf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ea56d654c39113da02742598b3a9bacf.jpg not downloaded yet
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: TH95550
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: RL71472
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: XG52732
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG52732%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for XG52732: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: ZH99212
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: AF65109
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: VC66912
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: PF21402
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF21402%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for PF21402: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: FY91209
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91209%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for FY91209: 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: HC53321
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: YM22646
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: PT02757
2026-03-30 07:36:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5543e478-6b56-57fb-bb88-19e7915dafac with identifier: HN95943
2026-03-30 07:36:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5543e478-6b56-57fb-bb88-19e7915dafac with identifier: HN95943
2026-03-30 07:36:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5543e478-6b56-57fb-bb88-19e7915dafac with identifier: HN95943 to the API
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:54:33Z',
 'fuel_type': 'diesel',
 'id': '5543e478-6b56-57fb-bb88-19e7915dafac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN95943',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 199819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-17',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2014}
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN95943%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Saving data for HN95943: {'auction_closing_time': 1774972473.0, 'created_time': 1773302882.794366, 'last_price_update_time': 1774856175.755288}
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN95943') HTTP/1.1" 204 0
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: BU66338
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: UX53934
2026-03-30 07:36:15 [auto1.de] INFO: Found listing with ID: XS40317
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS40317%27 HTTP/1.1" 200 None
2026-03-30 07:36:15 [auto1.de] INFO: Scrape type for XS40317: 2
2026-03-30 07:36:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d31bba7-ddd5-5fa4-b832-d5c57723005e with identifier: XS40317
2026-03-30 07:36:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d31bba7-ddd5-5fa4-b832-d5c57723005e with scrape type 2
2026-03-30 07:36:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d31bba7-ddd5-5fa4-b832-d5c57723005e with scrape type 2
2026-03-30 07:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0d31bba7-ddd5-5fa4-b832-d5c57723005e, identifier: XS40317
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_6876bc6a961756fc78aa322d4bdf27ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_6876bc6a961756fc78aa322d4bdf27ea.jpg not downloaded yet
2026-03-30 07:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0d31bba7-ddd5-5fa4-b832-d5c57723005e with identifier: XS40317
2026-03-30 07:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0d31bba7-ddd5-5fa4-b832-d5c57723005e with identifier: XS40317
2026-03-30 07:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0d31bba7-ddd5-5fa4-b832-d5c57723005e with identifier: XS40317 to the API
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:43:45Z',
 'fuel_type': 'diesel',
 'id': '0d31bba7-ddd5-5fa4-b832-d5c57723005e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS40317',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'H1',
 'odometer': 214337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-14',
 'seller_name': None,
 'title': 'Hyundai H1 2.5 CRDi Travel Comfort',
 'transmission': 'manual',
 'trim': 'Travel Comfort',
 'year': 2011}
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS40317%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [auto1.de] INFO: Saving data for XS40317: {'auction_closing_time': 1774971825.0, 'created_time': 1773898526.531837, 'last_price_update_time': 1774856176.368687}
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS40317') HTTP/1.1" 204 0
2026-03-30 07:36:16 [auto1.de] INFO: Found listing with ID: YU36554
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU36554%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [auto1.de] INFO: Scrape type for YU36554: 2
2026-03-30 07:36:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2451825d-40a4-58a8-8040-f7a0b7638e07 with identifier: YU36554
2026-03-30 07:36:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2451825d-40a4-58a8-8040-f7a0b7638e07 with scrape type 2
2026-03-30 07:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2451825d-40a4-58a8-8040-f7a0b7638e07 with scrape type 2
2026-03-30 07:36:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2451825d-40a4-58a8-8040-f7a0b7638e07, identifier: YU36554
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_2391f23dabf62c1c82731391c9e20c5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_2391f23dabf62c1c82731391c9e20c5e.jpg not downloaded yet
2026-03-30 07:36:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2451825d-40a4-58a8-8040-f7a0b7638e07 with identifier: YU36554
2026-03-30 07:36:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2451825d-40a4-58a8-8040-f7a0b7638e07 with identifier: YU36554
2026-03-30 07:36:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2451825d-40a4-58a8-8040-f7a0b7638e07 with identifier: YU36554 to the API
2026-03-30 07:36:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:38:49Z',
 'fuel_type': 'diesel',
 'id': '2451825d-40a4-58a8-8040-f7a0b7638e07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU36554',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 132950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-12',
 'seller_name': None,
 'title': 'Renault Espace 2.0 BLUE dCi Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2019}
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU36554%27 HTTP/1.1" 200 None
2026-03-30 07:36:17 [auto1.de] INFO: Saving data for YU36554: {'auction_closing_time': 1774971529.0, 'created_time': 1773381494.703257, 'last_price_update_time': 1774856177.16199}
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU36554') HTTP/1.1" 204 0
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: RP11152
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: YZ97980
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ97980%27 HTTP/1.1" 200 None
2026-03-30 07:36:17 [auto1.de] INFO: Scrape type for YZ97980: 2
2026-03-30 07:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dbbc63d4-71ca-580e-98a8-b6e5f332717e with identifier: YZ97980
2026-03-30 07:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dbbc63d4-71ca-580e-98a8-b6e5f332717e with scrape type 2
2026-03-30 07:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dbbc63d4-71ca-580e-98a8-b6e5f332717e with scrape type 2
2026-03-30 07:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dbbc63d4-71ca-580e-98a8-b6e5f332717e, identifier: YZ97980
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_352f0d916bcd834b1e51eaf510836204.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_352f0d916bcd834b1e51eaf510836204.jpg not downloaded yet
2026-03-30 07:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dbbc63d4-71ca-580e-98a8-b6e5f332717e with identifier: YZ97980
2026-03-30 07:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dbbc63d4-71ca-580e-98a8-b6e5f332717e with identifier: YZ97980
2026-03-30 07:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dbbc63d4-71ca-580e-98a8-b6e5f332717e with identifier: YZ97980 to the API
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:17:05Z',
 'fuel_type': 'diesel',
 'id': 'dbbc63d4-71ca-580e-98a8-b6e5f332717e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ97980',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 64053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-01',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2020}
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ97980%27 HTTP/1.1" 200 None
2026-03-30 07:36:17 [auto1.de] INFO: Saving data for YZ97980: {'auction_closing_time': 1774970225.0, 'created_time': 1774468184.942968, 'last_price_update_time': 1774856177.648832}
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ97980') HTTP/1.1" 204 0
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: SA90137
2026-03-30 07:36:17 [auto1.de] INFO: Found listing with ID: JW05825
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05825%27 HTTP/1.1" 200 None
2026-03-30 07:36:17 [auto1.de] INFO: Scrape type for JW05825: 2
2026-03-30 07:36:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3de5aa1-7e3b-5bc5-ac83-e82ebd0ae01a with identifier: JW05825
2026-03-30 07:36:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3de5aa1-7e3b-5bc5-ac83-e82ebd0ae01a with scrape type 2
2026-03-30 07:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e3de5aa1-7e3b-5bc5-ac83-e82ebd0ae01a with scrape type 2
2026-03-30 07:36:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e3de5aa1-7e3b-5bc5-ac83-e82ebd0ae01a, identifier: JW05825
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_ef56c992299c40a381c300c1bc129567.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ef56c992299c40a381c300c1bc129567.jpg not downloaded yet
2026-03-30 07:36:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e3de5aa1-7e3b-5bc5-ac83-e82ebd0ae01a with identifier: JW05825
2026-03-30 07:36:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e3de5aa1-7e3b-5bc5-ac83-e82ebd0ae01a with identifier: JW05825
2026-03-30 07:36:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e3de5aa1-7e3b-5bc5-ac83-e82ebd0ae01a with identifier: JW05825 to the API
2026-03-30 07:36:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:00:10Z',
 'fuel_type': 'petrol',
 'id': 'e3de5aa1-7e3b-5bc5-ac83-e82ebd0ae01a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JW05825',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 245118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-31',
 'seller_name': None,
 'title': 'Volvo V40 1.8',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05825%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Saving data for JW05825: {'auction_closing_time': 1774969210.0, 'created_time': 1774292252.55088, 'last_price_update_time': 1774856178.13171}
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JW05825') HTTP/1.1" 204 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: AK76136
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: RN76659
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: MK13186
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: YZ92306
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ92306%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for YZ92306: 2
2026-03-30 07:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c452276-38a6-59fe-b709-a5fa519e6b9a with identifier: YZ92306
2026-03-30 07:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c452276-38a6-59fe-b709-a5fa519e6b9a with scrape type 2
2026-03-30 07:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c452276-38a6-59fe-b709-a5fa519e6b9a with scrape type 2
2026-03-30 07:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c452276-38a6-59fe-b709-a5fa519e6b9a, identifier: YZ92306
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_6058864d856698ce0cc70eae92ccbb45.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_6058864d856698ce0cc70eae92ccbb45.jpg not downloaded yet
2026-03-30 07:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c452276-38a6-59fe-b709-a5fa519e6b9a with identifier: YZ92306
2026-03-30 07:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c452276-38a6-59fe-b709-a5fa519e6b9a with identifier: YZ92306
2026-03-30 07:36:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c452276-38a6-59fe-b709-a5fa519e6b9a with identifier: YZ92306 to the API
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:11:02Z',
 'fuel_type': 'hybrid',
 'id': '3c452276-38a6-59fe-b709-a5fa519e6b9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ92306',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 64303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-18',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ92306%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Saving data for YZ92306: {'auction_closing_time': 1774969862.0, 'created_time': 1773226073.846353, 'last_price_update_time': 1774856178.644226}
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ92306') HTTP/1.1" 204 0
2026-03-30 07:36:18 [auto1.de] INFO: Found listing with ID: FJ41734
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ41734%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [auto1.de] INFO: Scrape type for FJ41734: 2
2026-03-30 07:36:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26e6ae40-09d5-50bf-9431-60ccbd6a5a4e with identifier: FJ41734
2026-03-30 07:36:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26e6ae40-09d5-50bf-9431-60ccbd6a5a4e with scrape type 2
2026-03-30 07:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26e6ae40-09d5-50bf-9431-60ccbd6a5a4e with scrape type 2
2026-03-30 07:36:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26e6ae40-09d5-50bf-9431-60ccbd6a5a4e, identifier: FJ41734
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_f38c6db568f500a4a0069c1f1e4ce0ec.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_f38c6db568f500a4a0069c1f1e4ce0ec.jpg not downloaded yet
2026-03-30 07:36:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26e6ae40-09d5-50bf-9431-60ccbd6a5a4e with identifier: FJ41734
2026-03-30 07:36:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26e6ae40-09d5-50bf-9431-60ccbd6a5a4e with identifier: FJ41734
2026-03-30 07:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26e6ae40-09d5-50bf-9431-60ccbd6a5a4e with identifier: FJ41734 to the API
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:58:56Z',
 'fuel_type': 'diesel',
 'id': '26e6ae40-09d5-50bf-9431-60ccbd6a5a4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ41734',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 134023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-08',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2016}
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ41734%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [auto1.de] INFO: Saving data for FJ41734: {'auction_closing_time': 1774972736.0, 'created_time': 1773775621.283291, 'last_price_update_time': 1774856179.278443}
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ41734') HTTP/1.1" 204 0
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: XS76137
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: DY62455
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY62455%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [auto1.de] INFO: Scrape type for DY62455: 2
2026-03-30 07:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53017631-a1ae-56e2-91d1-19c578042bfd with identifier: DY62455
2026-03-30 07:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53017631-a1ae-56e2-91d1-19c578042bfd with scrape type 2
2026-03-30 07:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53017631-a1ae-56e2-91d1-19c578042bfd with scrape type 2
2026-03-30 07:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53017631-a1ae-56e2-91d1-19c578042bfd, identifier: DY62455
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_ef119eae993b6cafbaa4d778408806de.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ef119eae993b6cafbaa4d778408806de.jpg not downloaded yet
2026-03-30 07:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ea56d654c39113da02742598b3a9bacf.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53017631-a1ae-56e2-91d1-19c578042bfd with identifier: DY62455
2026-03-30 07:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53017631-a1ae-56e2-91d1-19c578042bfd with identifier: DY62455
2026-03-30 07:36:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53017631-a1ae-56e2-91d1-19c578042bfd with identifier: DY62455 to the API
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:19:14Z',
 'fuel_type': 'diesel',
 'id': '53017631-a1ae-56e2-91d1-19c578042bfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY62455',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 197638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-14',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY62455%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [auto1.de] INFO: Saving data for DY62455: {'auction_closing_time': 1774970354.0, 'created_time': 1773646582.856163, 'last_price_update_time': 1774856179.786352}
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY62455') HTTP/1.1" 204 0
2026-03-30 07:36:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_6876bc6a961756fc78aa322d4bdf27ea.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:19 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM64069%27 HTTP/1.1" 200 None
2026-03-30 07:36:19 [auto1.de] INFO: Scrape type for MM64069: 2
2026-03-30 07:36:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0407bb76-abdf-587e-800d-421f5e29ab29 with identifier: MM64069
2026-03-30 07:36:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0407bb76-abdf-587e-800d-421f5e29ab29 with scrape type 2
2026-03-30 07:36:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0407bb76-abdf-587e-800d-421f5e29ab29 with scrape type 2
2026-03-30 07:36:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0407bb76-abdf-587e-800d-421f5e29ab29, identifier: MM64069
2026-03-30 07:36:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0407bb76-abdf-587e-800d-421f5e29ab29 with identifier: MM64069
2026-03-30 07:36:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0407bb76-abdf-587e-800d-421f5e29ab29 with identifier: MM64069
2026-03-30 07:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0407bb76-abdf-587e-800d-421f5e29ab29 with identifier: MM64069 to the API
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-31T15:18:53Z',
 'fuel_type': 'diesel',
 'id': '0407bb76-abdf-587e-800d-421f5e29ab29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM64069',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 180461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-17',
 'seller_name': None,
 'title': 'Audi Q5 Sportback 40 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2023}
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM64069%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Saving data for MM64069: {'auction_closing_time': 1774970333.0, 'created_time': 1774435278.658688, 'last_price_update_time': 1774856180.289594}
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM64069') HTTP/1.1" 204 0
2026-03-30 07:36:20 [auto1.de] INFO: Found listing with ID: TE08407
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08407%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Scrape type for TE08407: 2
2026-03-30 07:36:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47254e5d-ad68-521b-b277-270adb6cd9d6 with identifier: TE08407
2026-03-30 07:36:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47254e5d-ad68-521b-b277-270adb6cd9d6 with scrape type 2
2026-03-30 07:36:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47254e5d-ad68-521b-b277-270adb6cd9d6 with scrape type 2
2026-03-30 07:36:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47254e5d-ad68-521b-b277-270adb6cd9d6, identifier: TE08407
2026-03-30 07:36:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47254e5d-ad68-521b-b277-270adb6cd9d6 with identifier: TE08407
2026-03-30 07:36:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47254e5d-ad68-521b-b277-270adb6cd9d6 with identifier: TE08407
2026-03-30 07:36:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47254e5d-ad68-521b-b277-270adb6cd9d6 with identifier: TE08407 to the API
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:45:23Z',
 'fuel_type': 'petrol',
 'id': '47254e5d-ad68-521b-b277-270adb6cd9d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE08407',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 93924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-21',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08407%27 HTTP/1.1" 200 None
2026-03-30 07:36:20 [auto1.de] INFO: Saving data for TE08407: {'auction_closing_time': 1774971923.0, 'created_time': 1774293271.760153, 'last_price_update_time': 1774856180.810665}
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE08407') HTTP/1.1" 204 0
2026-03-30 07:36:20 [auto1.de] INFO: Channel: 24h | Page: 7 | totalHits: 7626 | hits on page: 40
2026-03-30 07:36:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-30 07:36:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-30 07:36:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e2cd10>
2026-03-30 07:36:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2106
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_ea56d654c39113da02742598b3a9bacf.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ea56d654c39113da02742598b3a9bacf.jpg saved to cache
2026-03-30 07:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1
2026-03-30 07:36:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2462890>
2026-03-30 07:36:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_6876bc6a961756fc78aa322d4bdf27ea.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_6876bc6a961756fc78aa322d4bdf27ea.jpg saved to cache
2026-03-30 07:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1
2026-03-30 07:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_352f0d916bcd834b1e51eaf510836204.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_f38c6db568f500a4a0069c1f1e4ce0ec.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: GL59238
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: CC88338
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: LC10044
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: MG02873
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG02873%27 HTTP/1.1" 200 None
2026-03-30 07:36:21 [auto1.de] INFO: Scrape type for MG02873: 2
2026-03-30 07:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07686f69-b263-5a6b-839e-14687bfb1e12 with identifier: MG02873
2026-03-30 07:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07686f69-b263-5a6b-839e-14687bfb1e12 with scrape type 2
2026-03-30 07:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07686f69-b263-5a6b-839e-14687bfb1e12 with scrape type 2
2026-03-30 07:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07686f69-b263-5a6b-839e-14687bfb1e12, identifier: MG02873
2026-03-30 07:36:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07686f69-b263-5a6b-839e-14687bfb1e12 with identifier: MG02873
2026-03-30 07:36:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07686f69-b263-5a6b-839e-14687bfb1e12 with identifier: MG02873
2026-03-30 07:36:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07686f69-b263-5a6b-839e-14687bfb1e12 with identifier: MG02873 to the API
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:30:16Z',
 'fuel_type': 'diesel',
 'id': '07686f69-b263-5a6b-839e-14687bfb1e12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG02873',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 221861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-18',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG02873%27 HTTP/1.1" 200 None
2026-03-30 07:36:21 [auto1.de] INFO: Saving data for MG02873: {'auction_closing_time': 1774971016.0, 'created_time': 1773304682.930161, 'last_price_update_time': 1774856181.775563}
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG02873') HTTP/1.1" 204 0
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: FJ41734
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ41734%27 HTTP/1.1" 200 None
2026-03-30 07:36:21 [auto1.de] INFO: Scrape type for FJ41734: 0
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: XS76137
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: DY62455
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY62455%27 HTTP/1.1" 200 None
2026-03-30 07:36:21 [auto1.de] INFO: Scrape type for DY62455: 0
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: MM64069
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM64069%27 HTTP/1.1" 200 None
2026-03-30 07:36:21 [auto1.de] INFO: Scrape type for MM64069: 0
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: TE08407
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08407%27 HTTP/1.1" 200 None
2026-03-30 07:36:21 [auto1.de] INFO: Scrape type for TE08407: 0
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: GL59238
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: CC88338
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: LC10044
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: MG02873
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG02873%27 HTTP/1.1" 200 None
2026-03-30 07:36:21 [auto1.de] INFO: Scrape type for MG02873: 0
2026-03-30 07:36:21 [auto1.de] INFO: Found listing with ID: BY54192
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY54192%27 HTTP/1.1" 200 None
2026-03-30 07:36:21 [auto1.de] INFO: Scrape type for BY54192: 2
2026-03-30 07:36:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32d3b2aa-547a-5ee9-b646-bbc3718199da with identifier: BY54192
2026-03-30 07:36:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d3b2aa-547a-5ee9-b646-bbc3718199da with scrape type 2
2026-03-30 07:36:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d3b2aa-547a-5ee9-b646-bbc3718199da with scrape type 2
2026-03-30 07:36:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32d3b2aa-547a-5ee9-b646-bbc3718199da, identifier: BY54192
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: BY54192
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY54192%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Scrape type for BY54192: 2
2026-03-30 07:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32d3b2aa-547a-5ee9-b646-bbc3718199da with scrape type 2
2026-03-30 07:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32d3b2aa-547a-5ee9-b646-bbc3718199da with scrape type 2
2026-03-30 07:36:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 32d3b2aa-547a-5ee9-b646-bbc3718199da, identifier: BY54192
2026-03-30 07:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32d3b2aa-547a-5ee9-b646-bbc3718199da with identifier: BY54192
2026-03-30 07:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32d3b2aa-547a-5ee9-b646-bbc3718199da with identifier: BY54192
2026-03-30 07:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32d3b2aa-547a-5ee9-b646-bbc3718199da with identifier: BY54192 to the API
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:13:30Z',
 'fuel_type': 'diesel',
 'id': '32d3b2aa-547a-5ee9-b646-bbc3718199da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY54192',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 123124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Business Innovation',
 'transmission': 'manual',
 'trim': 'Business Innovation',
 'year': 2016}
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY54192%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Saving data for BY54192: {'auction_closing_time': 1774970010.0, 'created_time': 1774293447.045838, 'last_price_update_time': 1774856182.531273}
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY54192') HTTP/1.1" 204 0
2026-03-30 07:36:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ef56c992299c40a381c300c1bc129567.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 32d3b2aa-547a-5ee9-b646-bbc3718199da with identifier: BY54192
2026-03-30 07:36:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 32d3b2aa-547a-5ee9-b646-bbc3718199da with identifier: BY54192
2026-03-30 07:36:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 32d3b2aa-547a-5ee9-b646-bbc3718199da with identifier: BY54192 to the API
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:13:30Z',
 'fuel_type': 'diesel',
 'id': '32d3b2aa-547a-5ee9-b646-bbc3718199da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY54192',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 123124,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Business Innovation',
 'transmission': 'manual',
 'trim': 'Business Innovation',
 'year': 2016}
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY54192%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Saving data for BY54192: {'auction_closing_time': 1774970010.0, 'created_time': 1774293447.045838, 'last_price_update_time': 1774856182.946652}
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY54192') HTTP/1.1" 204 0
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: PF70269
2026-03-30 07:36:22 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF76763%27 HTTP/1.1" 200 None
2026-03-30 07:36:22 [auto1.de] INFO: Scrape type for AF76763: 2
2026-03-30 07:36:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 537add61-3a1e-5f54-a0d5-150d45f8ba8d with identifier: AF76763
2026-03-30 07:36:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 537add61-3a1e-5f54-a0d5-150d45f8ba8d with scrape type 2
2026-03-30 07:36:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 537add61-3a1e-5f54-a0d5-150d45f8ba8d with scrape type 2
2026-03-30 07:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 537add61-3a1e-5f54-a0d5-150d45f8ba8d, identifier: AF76763
2026-03-30 07:36:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_6058864d856698ce0cc70eae92ccbb45.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: PF70269
2026-03-30 07:36:23 [auto1.de] INFO: Found listing with ID: AF76763
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF76763%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Scrape type for AF76763: 2
2026-03-30 07:36:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 537add61-3a1e-5f54-a0d5-150d45f8ba8d with scrape type 2
2026-03-30 07:36:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 537add61-3a1e-5f54-a0d5-150d45f8ba8d with scrape type 2
2026-03-30 07:36:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 537add61-3a1e-5f54-a0d5-150d45f8ba8d, identifier: AF76763
2026-03-30 07:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 537add61-3a1e-5f54-a0d5-150d45f8ba8d with identifier: AF76763
2026-03-30 07:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 537add61-3a1e-5f54-a0d5-150d45f8ba8d with identifier: AF76763
2026-03-30 07:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 537add61-3a1e-5f54-a0d5-150d45f8ba8d with identifier: AF76763 to the API
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:41:25Z',
 'fuel_type': 'diesel',
 'id': '537add61-3a1e-5f54-a0d5-150d45f8ba8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF76763',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 214092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-04',
 'seller_name': None,
 'title': 'Ford Grand C-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF76763%27 HTTP/1.1" 200 None
2026-03-30 07:36:23 [auto1.de] INFO: Saving data for AF76763: {'auction_closing_time': 1774971685.0, 'created_time': 1773659804.536323, 'last_price_update_time': 1774856183.870945}
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF76763') HTTP/1.1" 204 0
2026-03-30 07:36:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 537add61-3a1e-5f54-a0d5-150d45f8ba8d with identifier: AF76763
2026-03-30 07:36:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 537add61-3a1e-5f54-a0d5-150d45f8ba8d with identifier: AF76763
2026-03-30 07:36:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 537add61-3a1e-5f54-a0d5-150d45f8ba8d with identifier: AF76763 to the API
2026-03-30 07:36:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:41:25Z',
 'fuel_type': 'diesel',
 'id': '537add61-3a1e-5f54-a0d5-150d45f8ba8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF76763',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 214092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-04',
 'seller_name': None,
 'title': 'Ford Grand C-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF76763%27 HTTP/1.1" 200 None
2026-03-30 07:36:24 [auto1.de] INFO: Saving data for AF76763: {'auction_closing_time': 1774971685.0, 'created_time': 1773659804.536323, 'last_price_update_time': 1774856184.175842}
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF76763') HTTP/1.1" 204 0
2026-03-30 07:36:24 [auto1.de] INFO: Found listing with ID: YA34461
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA34461%27 HTTP/1.1" 200 None
2026-03-30 07:36:24 [auto1.de] INFO: Scrape type for YA34461: 1
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d339d0>
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_352f0d916bcd834b1e51eaf510836204.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_352f0d916bcd834b1e51eaf510836204.jpg saved to cache
2026-03-30 07:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e7bc90>
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_f38c6db568f500a4a0069c1f1e4ce0ec.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_f38c6db568f500a4a0069c1f1e4ce0ec.jpg saved to cache
2026-03-30 07:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1
2026-03-30 07:36:24 [auto1.de] INFO: Found listing with ID: YA34461
2026-03-30 07:36:24 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES39418%27 HTTP/1.1" 200 None
2026-03-30 07:36:24 [auto1.de] INFO: Scrape type for ES39418: 2
2026-03-30 07:36:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c13c03d8-8f03-5157-80f6-858f9707151f with identifier: ES39418
2026-03-30 07:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c13c03d8-8f03-5157-80f6-858f9707151f with scrape type 2
2026-03-30 07:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c13c03d8-8f03-5157-80f6-858f9707151f with scrape type 2
2026-03-30 07:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c13c03d8-8f03-5157-80f6-858f9707151f, identifier: ES39418
2026-03-30 07:36:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d076d0>
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_ef56c992299c40a381c300c1bc129567.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ef56c992299c40a381c300c1bc129567.jpg saved to cache
2026-03-30 07:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f8f950>
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_6058864d856698ce0cc70eae92ccbb45.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_6058864d856698ce0cc70eae92ccbb45.jpg saved to cache
2026-03-30 07:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1
2026-03-30 07:36:24 [auto1.de] INFO: Found listing with ID: ES39418
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES39418%27 HTTP/1.1" 200 None
2026-03-30 07:36:24 [auto1.de] INFO: Scrape type for ES39418: 2
2026-03-30 07:36:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c13c03d8-8f03-5157-80f6-858f9707151f with scrape type 2
2026-03-30 07:36:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c13c03d8-8f03-5157-80f6-858f9707151f with scrape type 2
2026-03-30 07:36:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c13c03d8-8f03-5157-80f6-858f9707151f, identifier: ES39418
2026-03-30 07:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c13c03d8-8f03-5157-80f6-858f9707151f with identifier: ES39418
2026-03-30 07:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c13c03d8-8f03-5157-80f6-858f9707151f with identifier: ES39418
2026-03-30 07:36:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c13c03d8-8f03-5157-80f6-858f9707151f with identifier: ES39418 to the API
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:47:35Z',
 'fuel_type': 'diesel',
 'id': 'c13c03d8-8f03-5157-80f6-858f9707151f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES39418',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 258257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-27',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Momentum AWD',
 'transmission': 'manual',
 'trim': 'Momentum AWD',
 'year': 2009}
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES39418%27 HTTP/1.1" 200 None
2026-03-30 07:36:24 [auto1.de] INFO: Saving data for ES39418: {'auction_closing_time': 1774972055.0, 'created_time': 1773688811.224838, 'last_price_update_time': 1774856184.972914}
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES39418') HTTP/1.1" 204 0
2026-03-30 07:36:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c13c03d8-8f03-5157-80f6-858f9707151f with identifier: ES39418
2026-03-30 07:36:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c13c03d8-8f03-5157-80f6-858f9707151f with identifier: ES39418
2026-03-30 07:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c13c03d8-8f03-5157-80f6-858f9707151f with identifier: ES39418 to the API
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:47:35Z',
 'fuel_type': 'diesel',
 'id': 'c13c03d8-8f03-5157-80f6-858f9707151f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES39418',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 258257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-27',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D4 Momentum AWD',
 'transmission': 'manual',
 'trim': 'Momentum AWD',
 'year': 2009}
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES39418%27 HTTP/1.1" 200 None
2026-03-30 07:36:25 [auto1.de] INFO: Saving data for ES39418: {'auction_closing_time': 1774972055.0, 'created_time': 1773688811.224838, 'last_price_update_time': 1774856185.29569}
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ES39418') HTTP/1.1" 204 0
2026-03-30 07:36:25 [auto1.de] INFO: Found listing with ID: VK59895
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK59895%27 HTTP/1.1" 200 None
2026-03-30 07:36:25 [auto1.de] INFO: Scrape type for VK59895: 2
2026-03-30 07:36:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9dee779-a2e4-5688-86d3-663ca4cebbd7 with identifier: VK59895
2026-03-30 07:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9dee779-a2e4-5688-86d3-663ca4cebbd7 with scrape type 2
2026-03-30 07:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9dee779-a2e4-5688-86d3-663ca4cebbd7 with scrape type 2
2026-03-30 07:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9dee779-a2e4-5688-86d3-663ca4cebbd7, identifier: VK59895
2026-03-30 07:36:25 [auto1.de] INFO: Found listing with ID: VK59895
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK59895%27 HTTP/1.1" 200 None
2026-03-30 07:36:25 [auto1.de] INFO: Scrape type for VK59895: 2
2026-03-30 07:36:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9dee779-a2e4-5688-86d3-663ca4cebbd7 with scrape type 2
2026-03-30 07:36:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9dee779-a2e4-5688-86d3-663ca4cebbd7 with scrape type 2
2026-03-30 07:36:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9dee779-a2e4-5688-86d3-663ca4cebbd7, identifier: VK59895
2026-03-30 07:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9dee779-a2e4-5688-86d3-663ca4cebbd7 with identifier: VK59895
2026-03-30 07:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9dee779-a2e4-5688-86d3-663ca4cebbd7 with identifier: VK59895
2026-03-30 07:36:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9dee779-a2e4-5688-86d3-663ca4cebbd7 with identifier: VK59895 to the API
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:37:01Z',
 'fuel_type': 'diesel',
 'id': 'a9dee779-a2e4-5688-86d3-663ca4cebbd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK59895',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 285304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-06',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK59895%27 HTTP/1.1" 200 None
2026-03-30 07:36:25 [auto1.de] INFO: Saving data for VK59895: {'auction_closing_time': 1774971421.0, 'created_time': 1773303257.951739, 'last_price_update_time': 1774856185.881389}
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK59895') HTTP/1.1" 204 0
2026-03-30 07:36:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9dee779-a2e4-5688-86d3-663ca4cebbd7 with identifier: VK59895
2026-03-30 07:36:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9dee779-a2e4-5688-86d3-663ca4cebbd7 with identifier: VK59895
2026-03-30 07:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9dee779-a2e4-5688-86d3-663ca4cebbd7 with identifier: VK59895 to the API
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:37:01Z',
 'fuel_type': 'diesel',
 'id': 'a9dee779-a2e4-5688-86d3-663ca4cebbd7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK59895',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 285304,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-06',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK59895%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Saving data for VK59895: {'auction_closing_time': 1774971421.0, 'created_time': 1773303257.951739, 'last_price_update_time': 1774856186.204976}
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK59895') HTTP/1.1" 204 0
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: YC86222
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC86222%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Scrape type for YC86222: 2
2026-03-30 07:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9998a2e-056d-5223-b4dd-01ec54f5977f with identifier: YC86222
2026-03-30 07:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9998a2e-056d-5223-b4dd-01ec54f5977f with scrape type 2
2026-03-30 07:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9998a2e-056d-5223-b4dd-01ec54f5977f with scrape type 2
2026-03-30 07:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9998a2e-056d-5223-b4dd-01ec54f5977f, identifier: YC86222
2026-03-30 07:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9998a2e-056d-5223-b4dd-01ec54f5977f with identifier: YC86222
2026-03-30 07:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9998a2e-056d-5223-b4dd-01ec54f5977f with identifier: YC86222
2026-03-30 07:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9998a2e-056d-5223-b4dd-01ec54f5977f with identifier: YC86222 to the API
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:18:35Z',
 'fuel_type': 'diesel',
 'id': 'b9998a2e-056d-5223-b4dd-01ec54f5977f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC86222',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'X-TYPE',
 'odometer': 176352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-30',
 'seller_name': None,
 'title': 'Jaguar X-TYPE 2.2 D Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2006}
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC86222%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Saving data for YC86222: {'auction_closing_time': 1774970315.0, 'created_time': 1774292902.543291, 'last_price_update_time': 1774856186.695655}
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC86222') HTTP/1.1" 204 0
2026-03-30 07:36:26 [auto1.de] INFO: Found listing with ID: HP20518
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP20518%27 HTTP/1.1" 200 None
2026-03-30 07:36:26 [auto1.de] INFO: Scrape type for HP20518: 2
2026-03-30 07:36:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4499f563-fecd-5c83-b3a8-1f75597e7c44 with identifier: HP20518
2026-03-30 07:36:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4499f563-fecd-5c83-b3a8-1f75597e7c44 with scrape type 2
2026-03-30 07:36:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4499f563-fecd-5c83-b3a8-1f75597e7c44 with scrape type 2
2026-03-30 07:36:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4499f563-fecd-5c83-b3a8-1f75597e7c44, identifier: HP20518
2026-03-30 07:36:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4499f563-fecd-5c83-b3a8-1f75597e7c44 with identifier: HP20518
2026-03-30 07:36:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4499f563-fecd-5c83-b3a8-1f75597e7c44 with identifier: HP20518
2026-03-30 07:36:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4499f563-fecd-5c83-b3a8-1f75597e7c44 with identifier: HP20518 to the API
2026-03-30 07:36:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:45:28Z',
 'fuel_type': 'diesel',
 'id': '4499f563-fecd-5c83-b3a8-1f75597e7c44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP20518',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 211904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-19',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP20518%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Saving data for HP20518: {'auction_closing_time': 1774971928.0, 'created_time': 1773689073.688675, 'last_price_update_time': 1774856187.161041}
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP20518') HTTP/1.1" 204 0
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: TA49456
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA49456%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Scrape type for TA49456: 2
2026-03-30 07:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 309fc6c7-6637-5653-a8e6-3e24bddd2ff0 with identifier: TA49456
2026-03-30 07:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 309fc6c7-6637-5653-a8e6-3e24bddd2ff0 with scrape type 2
2026-03-30 07:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 309fc6c7-6637-5653-a8e6-3e24bddd2ff0 with scrape type 2
2026-03-30 07:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 309fc6c7-6637-5653-a8e6-3e24bddd2ff0, identifier: TA49456
2026-03-30 07:36:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 309fc6c7-6637-5653-a8e6-3e24bddd2ff0 with identifier: TA49456
2026-03-30 07:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 309fc6c7-6637-5653-a8e6-3e24bddd2ff0 with identifier: TA49456
2026-03-30 07:36:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 309fc6c7-6637-5653-a8e6-3e24bddd2ff0 with identifier: TA49456 to the API
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:21:19Z',
 'fuel_type': 'petrol',
 'id': '309fc6c7-6637-5653-a8e6-3e24bddd2ff0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA49456',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 227943,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-13',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Turbo S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2016}
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA49456%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Saving data for TA49456: {'auction_closing_time': 1774970479.0, 'created_time': 1773571969.100491, 'last_price_update_time': 1774856187.773619}
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA49456') HTTP/1.1" 204 0
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: YR12178
2026-03-30 07:36:27 [auto1.de] INFO: Found listing with ID: MR49496
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR49496%27 HTTP/1.1" 200 None
2026-03-30 07:36:27 [auto1.de] INFO: Scrape type for MR49496: 2
2026-03-30 07:36:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed798073-9718-560e-94b6-b059b1ca1d54 with identifier: MR49496
2026-03-30 07:36:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed798073-9718-560e-94b6-b059b1ca1d54 with scrape type 2
2026-03-30 07:36:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed798073-9718-560e-94b6-b059b1ca1d54 with scrape type 2
2026-03-30 07:36:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed798073-9718-560e-94b6-b059b1ca1d54, identifier: MR49496
2026-03-30 07:36:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed798073-9718-560e-94b6-b059b1ca1d54 with identifier: MR49496
2026-03-30 07:36:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed798073-9718-560e-94b6-b059b1ca1d54 with identifier: MR49496
2026-03-30 07:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed798073-9718-560e-94b6-b059b1ca1d54 with identifier: MR49496 to the API
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:06:04Z',
 'fuel_type': 'petrol',
 'id': 'ed798073-9718-560e-94b6-b059b1ca1d54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR49496',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 90404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-10',
 'seller_name': None,
 'title': 'Seat Altea 1.4 TSI Style Copa',
 'transmission': 'manual',
 'trim': 'Style Copa',
 'year': 2011}
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR49496%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Saving data for MR49496: {'auction_closing_time': 1774969564.0, 'created_time': 1774377593.741276, 'last_price_update_time': 1774856188.263818}
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR49496') HTTP/1.1" 204 0
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: MN22228
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN22228%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Scrape type for MN22228: 1
2026-03-30 07:36:28 [auto1.de] INFO: Channel: 24h | Page: 8 | totalHits: 7635 | hits on page: 40
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: CR26660
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: PH88321
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: MD97257
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: FV82403
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: SR89713
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: EK84177
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: FB79973
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79973%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Scrape type for FB79973: 1
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: BN35753
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: SA32858
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA32858%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Scrape type for SA32858: 2
2026-03-30 07:36:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1395eb30-5b77-518b-9b76-1e7b9b38900f with identifier: SA32858
2026-03-30 07:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1395eb30-5b77-518b-9b76-1e7b9b38900f with scrape type 2
2026-03-30 07:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1395eb30-5b77-518b-9b76-1e7b9b38900f with scrape type 2
2026-03-30 07:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1395eb30-5b77-518b-9b76-1e7b9b38900f, identifier: SA32858
2026-03-30 07:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: YB11592
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: FJ58055
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: FC64824
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: BN35753
2026-03-30 07:36:28 [auto1.de] INFO: Found listing with ID: SA32858
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA32858%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Scrape type for SA32858: 2
2026-03-30 07:36:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1395eb30-5b77-518b-9b76-1e7b9b38900f with scrape type 2
2026-03-30 07:36:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1395eb30-5b77-518b-9b76-1e7b9b38900f with scrape type 2
2026-03-30 07:36:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1395eb30-5b77-518b-9b76-1e7b9b38900f, identifier: SA32858
2026-03-30 07:36:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1395eb30-5b77-518b-9b76-1e7b9b38900f with identifier: SA32858
2026-03-30 07:36:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1395eb30-5b77-518b-9b76-1e7b9b38900f with identifier: SA32858
2026-03-30 07:36:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1395eb30-5b77-518b-9b76-1e7b9b38900f with identifier: SA32858 to the API
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:41:18Z',
 'fuel_type': 'diesel',
 'id': '1395eb30-5b77-518b-9b76-1e7b9b38900f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA32858',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 123053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-27',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 HDi Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2012}
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA32858%27 HTTP/1.1" 200 None
2026-03-30 07:36:28 [auto1.de] INFO: Saving data for SA32858: {'auction_closing_time': 1774971678.0, 'created_time': 1773224821.168487, 'last_price_update_time': 1774856188.909975}
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA32858') HTTP/1.1" 204 0
2026-03-30 07:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1395eb30-5b77-518b-9b76-1e7b9b38900f with identifier: SA32858
2026-03-30 07:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1395eb30-5b77-518b-9b76-1e7b9b38900f with identifier: SA32858
2026-03-30 07:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1395eb30-5b77-518b-9b76-1e7b9b38900f with identifier: SA32858 to the API
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:41:18Z',
 'fuel_type': 'diesel',
 'id': '1395eb30-5b77-518b-9b76-1e7b9b38900f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA32858',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 123053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-27',
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 1.6 HDi Selection',
 'transmission': 'automatic',
 'trim': 'Selection',
 'year': 2012}
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA32858%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Saving data for SA32858: {'auction_closing_time': 1774971678.0, 'created_time': 1773224821.168487, 'last_price_update_time': 1774856189.382642}
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA32858') HTTP/1.1" 204 0
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: JA20872
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: VN21885
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: KN60852
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN60852%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Scrape type for KN60852: 2
2026-03-30 07:36:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cfbc903-16d0-5d94-a5d2-4410b223e178 with identifier: KN60852
2026-03-30 07:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cfbc903-16d0-5d94-a5d2-4410b223e178 with scrape type 2
2026-03-30 07:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cfbc903-16d0-5d94-a5d2-4410b223e178 with scrape type 2
2026-03-30 07:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cfbc903-16d0-5d94-a5d2-4410b223e178, identifier: KN60852
2026-03-30 07:36:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: JA20872
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: VN21885
2026-03-30 07:36:29 [auto1.de] INFO: Found listing with ID: KN60852
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN60852%27 HTTP/1.1" 200 None
2026-03-30 07:36:29 [auto1.de] INFO: Scrape type for KN60852: 2
2026-03-30 07:36:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cfbc903-16d0-5d94-a5d2-4410b223e178 with scrape type 2
2026-03-30 07:36:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cfbc903-16d0-5d94-a5d2-4410b223e178 with scrape type 2
2026-03-30 07:36:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cfbc903-16d0-5d94-a5d2-4410b223e178, identifier: KN60852
2026-03-30 07:36:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cfbc903-16d0-5d94-a5d2-4410b223e178 with identifier: KN60852
2026-03-30 07:36:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cfbc903-16d0-5d94-a5d2-4410b223e178 with identifier: KN60852
2026-03-30 07:36:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cfbc903-16d0-5d94-a5d2-4410b223e178 with identifier: KN60852 to the API
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:03Z',
 'fuel_type': 'diesel',
 'id': '3cfbc903-16d0-5d94-a5d2-4410b223e178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN60852',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 78479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN60852%27 HTTP/1.1" 200 None
2026-03-30 07:36:30 [auto1.de] INFO: Saving data for KN60852: {'auction_closing_time': 1774972683.0, 'created_time': 1774467134.707789, 'last_price_update_time': 1774856190.023412}
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN60852') HTTP/1.1" 204 0
2026-03-30 07:36:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA34461/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cfbc903-16d0-5d94-a5d2-4410b223e178 with identifier: KN60852
2026-03-30 07:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cfbc903-16d0-5d94-a5d2-4410b223e178 with identifier: KN60852
2026-03-30 07:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cfbc903-16d0-5d94-a5d2-4410b223e178 with identifier: KN60852 to the API
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:58:03Z',
 'fuel_type': 'diesel',
 'id': '3cfbc903-16d0-5d94-a5d2-4410b223e178',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN60852',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 78479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN60852%27 HTTP/1.1" 200 None
2026-03-30 07:36:30 [auto1.de] INFO: Saving data for KN60852: {'auction_closing_time': 1774972683.0, 'created_time': 1774467134.707789, 'last_price_update_time': 1774856190.335854}
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN60852') HTTP/1.1" 204 0
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: FL96741
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: HJ41200
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: PF91020
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: NF54912
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF54912%27 HTTP/1.1" 200 None
2026-03-30 07:36:30 [auto1.de] INFO: Scrape type for NF54912: 2
2026-03-30 07:36:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8197e73-4e33-5a53-aa58-cf484a18710a with identifier: NF54912
2026-03-30 07:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8197e73-4e33-5a53-aa58-cf484a18710a with scrape type 2
2026-03-30 07:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8197e73-4e33-5a53-aa58-cf484a18710a with scrape type 2
2026-03-30 07:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8197e73-4e33-5a53-aa58-cf484a18710a, identifier: NF54912
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: FL96741
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: HJ41200
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: PF91020
2026-03-30 07:36:30 [auto1.de] INFO: Found listing with ID: NF54912
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF54912%27 HTTP/1.1" 200 None
2026-03-30 07:36:30 [auto1.de] INFO: Scrape type for NF54912: 2
2026-03-30 07:36:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8197e73-4e33-5a53-aa58-cf484a18710a with scrape type 2
2026-03-30 07:36:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8197e73-4e33-5a53-aa58-cf484a18710a with scrape type 2
2026-03-30 07:36:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8197e73-4e33-5a53-aa58-cf484a18710a, identifier: NF54912
2026-03-30 07:36:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8197e73-4e33-5a53-aa58-cf484a18710a with identifier: NF54912
2026-03-30 07:36:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8197e73-4e33-5a53-aa58-cf484a18710a with identifier: NF54912
2026-03-30 07:36:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8197e73-4e33-5a53-aa58-cf484a18710a with identifier: NF54912 to the API
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:53:02Z',
 'fuel_type': 'diesel',
 'id': 'f8197e73-4e33-5a53-aa58-cf484a18710a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF54912',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-18',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 316 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF54912%27 HTTP/1.1" 200 None
2026-03-30 07:36:31 [auto1.de] INFO: Saving data for NF54912: {'auction_closing_time': 1774972382.0, 'created_time': 1774349052.623238, 'last_price_update_time': 1774856191.026928}
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF54912') HTTP/1.1" 204 0
2026-03-30 07:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8197e73-4e33-5a53-aa58-cf484a18710a with identifier: NF54912
2026-03-30 07:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8197e73-4e33-5a53-aa58-cf484a18710a with identifier: NF54912
2026-03-30 07:36:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8197e73-4e33-5a53-aa58-cf484a18710a with identifier: NF54912 to the API
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:53:02Z',
 'fuel_type': 'diesel',
 'id': 'f8197e73-4e33-5a53-aa58-cf484a18710a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF54912',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-18',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 316 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF54912%27 HTTP/1.1" 200 None
2026-03-30 07:36:31 [auto1.de] INFO: Saving data for NF54912: {'auction_closing_time': 1774972382.0, 'created_time': 1774349052.623238, 'last_price_update_time': 1774856191.787121}
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF54912') HTTP/1.1" 204 0
2026-03-30 07:36:31 [auto1.de] INFO: Found listing with ID: WP07187
2026-03-30 07:36:31 [auto1.de] INFO: Found listing with ID: KK55590
2026-03-30 07:36:31 [auto1.de] INFO: Found listing with ID: LH84474
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH84474%27 HTTP/1.1" 200 None
2026-03-30 07:36:31 [auto1.de] INFO: Scrape type for LH84474: 2
2026-03-30 07:36:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7fe6876-33bd-53da-92d6-06087040aac5 with identifier: LH84474
2026-03-30 07:36:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7fe6876-33bd-53da-92d6-06087040aac5 with scrape type 2
2026-03-30 07:36:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7fe6876-33bd-53da-92d6-06087040aac5 with scrape type 2
2026-03-30 07:36:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7fe6876-33bd-53da-92d6-06087040aac5, identifier: LH84474
2026-03-30 07:36:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7fe6876-33bd-53da-92d6-06087040aac5 with identifier: LH84474
2026-03-30 07:36:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7fe6876-33bd-53da-92d6-06087040aac5 with identifier: LH84474
2026-03-30 07:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7fe6876-33bd-53da-92d6-06087040aac5 with identifier: LH84474 to the API
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:41:34Z',
 'fuel_type': 'diesel',
 'id': 'f7fe6876-33bd-53da-92d6-06087040aac5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH84474',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 146152,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-27',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2011}
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH84474%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Saving data for LH84474: {'auction_closing_time': 1774971694.0, 'created_time': 1774435096.623566, 'last_price_update_time': 1774856192.270433}
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH84474') HTTP/1.1" 204 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: ZK41607
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK41607%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for ZK41607: 2
2026-03-30 07:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 043db4ba-0f22-59d5-ab95-9c1afaca75ab with identifier: ZK41607
2026-03-30 07:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 043db4ba-0f22-59d5-ab95-9c1afaca75ab with scrape type 2
2026-03-30 07:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 043db4ba-0f22-59d5-ab95-9c1afaca75ab with scrape type 2
2026-03-30 07:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 043db4ba-0f22-59d5-ab95-9c1afaca75ab, identifier: ZK41607
2026-03-30 07:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 043db4ba-0f22-59d5-ab95-9c1afaca75ab with identifier: ZK41607
2026-03-30 07:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 043db4ba-0f22-59d5-ab95-9c1afaca75ab with identifier: ZK41607
2026-03-30 07:36:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 043db4ba-0f22-59d5-ab95-9c1afaca75ab with identifier: ZK41607 to the API
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:23:27Z',
 'fuel_type': 'petrol',
 'id': '043db4ba-0f22-59d5-ab95-9c1afaca75ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK41607',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 153501,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-23',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK41607%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Saving data for ZK41607: {'auction_closing_time': 1774970607.0, 'created_time': 1774381422.252693, 'last_price_update_time': 1774856192.770617}
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK41607') HTTP/1.1" 204 0
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: YM31567
2026-03-30 07:36:32 [auto1.de] INFO: Found listing with ID: US29975
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US29975%27 HTTP/1.1" 200 None
2026-03-30 07:36:32 [auto1.de] INFO: Scrape type for US29975: 2
2026-03-30 07:36:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94c698df-effe-56a0-8500-76986a2a55d4 with identifier: US29975
2026-03-30 07:36:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c698df-effe-56a0-8500-76986a2a55d4 with scrape type 2
2026-03-30 07:36:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94c698df-effe-56a0-8500-76986a2a55d4 with scrape type 2
2026-03-30 07:36:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94c698df-effe-56a0-8500-76986a2a55d4, identifier: US29975
2026-03-30 07:36:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94c698df-effe-56a0-8500-76986a2a55d4 with identifier: US29975
2026-03-30 07:36:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94c698df-effe-56a0-8500-76986a2a55d4 with identifier: US29975
2026-03-30 07:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94c698df-effe-56a0-8500-76986a2a55d4 with identifier: US29975 to the API
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:46:32Z',
 'fuel_type': 'petrol',
 'id': '94c698df-effe-56a0-8500-76986a2a55d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US29975',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 155902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-17',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2008}
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US29975%27 HTTP/1.1" 200 None
2026-03-30 07:36:33 [auto1.de] INFO: Saving data for US29975: {'auction_closing_time': 1774971992.0, 'created_time': 1773304781.369646, 'last_price_update_time': 1774856193.27517}
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US29975') HTTP/1.1" 204 0
2026-03-30 07:36:33 [auto1.de] INFO: Found listing with ID: TV42528
2026-03-30 07:36:33 [auto1.de] INFO: Found listing with ID: XK43796
2026-03-30 07:36:33 [auto1.de] INFO: Found listing with ID: CB34821
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB34821%27 HTTP/1.1" 200 None
2026-03-30 07:36:33 [auto1.de] INFO: Scrape type for CB34821: 2
2026-03-30 07:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50279968-c523-5532-9a64-4ceff422a8de with identifier: CB34821
2026-03-30 07:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50279968-c523-5532-9a64-4ceff422a8de with scrape type 2
2026-03-30 07:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50279968-c523-5532-9a64-4ceff422a8de with scrape type 2
2026-03-30 07:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50279968-c523-5532-9a64-4ceff422a8de, identifier: CB34821
2026-03-30 07:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50279968-c523-5532-9a64-4ceff422a8de with identifier: CB34821
2026-03-30 07:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50279968-c523-5532-9a64-4ceff422a8de with identifier: CB34821
2026-03-30 07:36:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50279968-c523-5532-9a64-4ceff422a8de with identifier: CB34821 to the API
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-31T15:40:55Z',
 'fuel_type': 'diesel',
 'id': '50279968-c523-5532-9a64-4ceff422a8de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CB34821',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 81369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-10',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2014}
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB34821%27 HTTP/1.1" 200 None
2026-03-30 07:36:33 [auto1.de] INFO: Saving data for CB34821: {'auction_closing_time': 1774971655.0, 'created_time': 1774348760.300101, 'last_price_update_time': 1774856193.772931}
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CB34821') HTTP/1.1" 204 0
2026-03-30 07:36:33 [auto1.de] INFO: Found listing with ID: UZ92171
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ92171%27 HTTP/1.1" 200 None
2026-03-30 07:36:33 [auto1.de] INFO: Scrape type for UZ92171: 2
2026-03-30 07:36:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a932e029-2bc0-5ee2-890e-dec385170c6c with identifier: UZ92171
2026-03-30 07:36:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a932e029-2bc0-5ee2-890e-dec385170c6c with scrape type 2
2026-03-30 07:36:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a932e029-2bc0-5ee2-890e-dec385170c6c with scrape type 2
2026-03-30 07:36:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a932e029-2bc0-5ee2-890e-dec385170c6c, identifier: UZ92171
2026-03-30 07:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN22228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_844e14c737608a4194a0dfee7bdd2eac.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_9390b3238ebb8dd366f2c0b54cf1ca3b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a932e029-2bc0-5ee2-890e-dec385170c6c with identifier: UZ92171
2026-03-30 07:36:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a932e029-2bc0-5ee2-890e-dec385170c6c with identifier: UZ92171
2026-03-30 07:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a932e029-2bc0-5ee2-890e-dec385170c6c with identifier: UZ92171 to the API
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-31T15:45:11Z',
 'fuel_type': 'petrol',
 'id': 'a932e029-2bc0-5ee2-890e-dec385170c6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ92171',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C8',
 'odometer': 187560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-18',
 'seller_name': None,
 'title': 'Citroen C8 2.2 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2004}
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ92171%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Saving data for UZ92171: {'auction_closing_time': 1774971911.0, 'created_time': 1774380293.77667, 'last_price_update_time': 1774856194.341075}
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ92171') HTTP/1.1" 204 0
2026-03-30 07:36:34 [auto1.de] INFO: Found listing with ID: TA32643
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32643%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Scrape type for TA32643: 2
2026-03-30 07:36:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 631f0ef4-44d9-54cd-a2b7-fb400a91e633 with identifier: TA32643
2026-03-30 07:36:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 631f0ef4-44d9-54cd-a2b7-fb400a91e633 with scrape type 2
2026-03-30 07:36:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 631f0ef4-44d9-54cd-a2b7-fb400a91e633 with scrape type 2
2026-03-30 07:36:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 631f0ef4-44d9-54cd-a2b7-fb400a91e633, identifier: TA32643
2026-03-30 07:36:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 631f0ef4-44d9-54cd-a2b7-fb400a91e633 with identifier: TA32643
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-30 07:36:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:36:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 631f0ef4-44d9-54cd-a2b7-fb400a91e633 with identifier: TA32643
2026-03-30 07:36:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 631f0ef4-44d9-54cd-a2b7-fb400a91e633 with identifier: TA32643 to the API
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-31T15:10:29Z',
 'fuel_type': 'petrol',
 'id': '631f0ef4-44d9-54cd-a2b7-fb400a91e633',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA32643',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 127631,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-02-21',
 'seller_name': None,
 'title': 'Fiat Panda 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2005}
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA32643%27 HTTP/1.1" 200 None
2026-03-30 07:36:34 [auto1.de] INFO: Saving data for TA32643: {'auction_closing_time': 1774969829.0, 'created_time': 1774294396.205812, 'last_price_update_time': 1774856194.974708}
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA32643') HTTP/1.1" 204 0
2026-03-30 07:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FB79973/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: GU29210
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: VB44523
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: KU64879
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: YE54237
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: XZ96479
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96479%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Scrape type for XZ96479: 2
2026-03-30 07:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with identifier: XZ96479
2026-03-30 07:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with scrape type 2
2026-03-30 07:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with scrape type 2
2026-03-30 07:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa7f74cf-47e3-56a3-b5ab-3df69a1848cf, identifier: XZ96479
2026-03-30 07:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with identifier: XZ96479
2026-03-30 07:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with identifier: XZ96479
2026-03-30 07:36:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa7f74cf-47e3-56a3-b5ab-3df69a1848cf with identifier: XZ96479 to the API
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:15:49Z',
 'fuel_type': 'diesel',
 'id': 'fa7f74cf-47e3-56a3-b5ab-3df69a1848cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ96479',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 284082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-29',
 'seller_name': None,
 'title': 'BMW X1 xDrive 23d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96479%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Saving data for XZ96479: {'auction_closing_time': 1774970149.0, 'created_time': 1774463873.912606, 'last_price_update_time': 1774856195.552874}
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ96479') HTTP/1.1" 204 0
2026-03-30 07:36:35 [auto1.de] INFO: Channel: 24h | Page: 9 | totalHits: 7644 | hits on page: 40
2026-03-30 07:36:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f9cd10>
2026-03-30 07:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_844e14c737608a4194a0dfee7bdd2eac.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_844e14c737608a4194a0dfee7bdd2eac.jpg saved to cache
2026-03-30 07:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1
2026-03-30 07:36:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:36:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24d0d90>
2026-03-30 07:36:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_9390b3238ebb8dd366f2c0b54cf1ca3b.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_9390b3238ebb8dd366f2c0b54cf1ca3b.jpg saved to cache
2026-03-30 07:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1
2026-03-30 07:36:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_2391f23dabf62c1c82731391c9e20c5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: SU53309
2026-03-30 07:36:35 [auto1.de] INFO: Found listing with ID: VL69924
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL69924%27 HTTP/1.1" 200 None
2026-03-30 07:36:35 [auto1.de] INFO: Scrape type for VL69924: 2
2026-03-30 07:36:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98ec00bc-996d-506c-81a1-58c028a09fee with identifier: VL69924
2026-03-30 07:36:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98ec00bc-996d-506c-81a1-58c028a09fee with scrape type 2
2026-03-30 07:36:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98ec00bc-996d-506c-81a1-58c028a09fee with scrape type 2
2026-03-30 07:36:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98ec00bc-996d-506c-81a1-58c028a09fee, identifier: VL69924
2026-03-30 07:36:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98ec00bc-996d-506c-81a1-58c028a09fee with identifier: VL69924
2026-03-30 07:36:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98ec00bc-996d-506c-81a1-58c028a09fee with identifier: VL69924
2026-03-30 07:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98ec00bc-996d-506c-81a1-58c028a09fee with identifier: VL69924 to the API
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:31:04Z',
 'fuel_type': 'petrol',
 'id': '98ec00bc-996d-506c-81a1-58c028a09fee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL69924',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 154129,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-04',
 'seller_name': None,
 'title': 'Mazda 6 1.8 Active Sport',
 'transmission': 'manual',
 'trim': 'Active Sport',
 'year': 2005}
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL69924%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Saving data for VL69924: {'auction_closing_time': 1774971064.0, 'created_time': 1774378287.975203, 'last_price_update_time': 1774856196.314886}
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL69924') HTTP/1.1" 204 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: LY71761
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY71761%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for LY71761: 1
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: VH72223
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH72223%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for VH72223: 2
2026-03-30 07:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d12119fa-ef49-55dd-ad8b-1186088945a1 with identifier: VH72223
2026-03-30 07:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d12119fa-ef49-55dd-ad8b-1186088945a1 with scrape type 2
2026-03-30 07:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d12119fa-ef49-55dd-ad8b-1186088945a1 with scrape type 2
2026-03-30 07:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d12119fa-ef49-55dd-ad8b-1186088945a1, identifier: VH72223
2026-03-30 07:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d12119fa-ef49-55dd-ad8b-1186088945a1 with identifier: VH72223
2026-03-30 07:36:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d12119fa-ef49-55dd-ad8b-1186088945a1 with identifier: VH72223
2026-03-30 07:36:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d12119fa-ef49-55dd-ad8b-1186088945a1 with identifier: VH72223 to the API
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:25:21Z',
 'fuel_type': 'diesel',
 'id': 'd12119fa-ef49-55dd-ad8b-1186088945a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH72223',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Edge',
 'odometer': 110292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-07',
 'seller_name': None,
 'title': 'Ford Edge 2.0 TDCi Bi-Turbo Sport 4x4',
 'transmission': 'automatic',
 'trim': 'Sport 4x4',
 'year': 2016}
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH72223%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Saving data for VH72223: {'auction_closing_time': 1774970721.0, 'created_time': 1774463916.96149, 'last_price_update_time': 1774856196.803628}
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH72223') HTTP/1.1" 204 0
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: FE80519
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: MC31762
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC31762%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for MC31762: 2
2026-03-30 07:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with identifier: MC31762
2026-03-30 07:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with scrape type 2
2026-03-30 07:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with scrape type 2
2026-03-30 07:36:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18bc4885-6d67-5e11-94b5-2cf0fe64f409, identifier: MC31762
2026-03-30 07:36:36 [auto1.de] INFO: Found listing with ID: LN72061
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN72061%27 HTTP/1.1" 200 None
2026-03-30 07:36:36 [auto1.de] INFO: Scrape type for LN72061: 2
2026-03-30 07:36:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3bf2837-cee3-56aa-b370-12bed22eb97a with identifier: LN72061
2026-03-30 07:36:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3bf2837-cee3-56aa-b370-12bed22eb97a with scrape type 2
2026-03-30 07:36:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3bf2837-cee3-56aa-b370-12bed22eb97a with scrape type 2
2026-03-30 07:36:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3bf2837-cee3-56aa-b370-12bed22eb97a, identifier: LN72061
2026-03-30 07:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with identifier: MC31762
2026-03-30 07:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with identifier: MC31762
2026-03-30 07:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18bc4885-6d67-5e11-94b5-2cf0fe64f409 with identifier: MC31762 to the API
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:20:03Z',
 'fuel_type': 'diesel',
 'id': '18bc4885-6d67-5e11-94b5-2cf0fe64f409',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC31762',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 239666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-06',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC31762%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Saving data for MC31762: {'auction_closing_time': 1774970403.0, 'created_time': 1774466858.543788, 'last_price_update_time': 1774856197.397248}
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC31762') HTTP/1.1" 204 0
2026-03-30 07:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:36:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e8a810>
2026-03-30 07:36:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_2391f23dabf62c1c82731391c9e20c5e.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_2391f23dabf62c1c82731391c9e20c5e.jpg saved to cache
2026-03-30 07:36:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1
2026-03-30 07:36:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ef119eae993b6cafbaa4d778408806de.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3bf2837-cee3-56aa-b370-12bed22eb97a with identifier: LN72061
2026-03-30 07:36:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3bf2837-cee3-56aa-b370-12bed22eb97a with identifier: LN72061
2026-03-30 07:36:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3bf2837-cee3-56aa-b370-12bed22eb97a with identifier: LN72061 to the API
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:24:58Z',
 'fuel_type': 'petrol',
 'id': 'b3bf2837-cee3-56aa-b370-12bed22eb97a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN72061',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1',
 'odometer': 110598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Audi A1 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN72061%27 HTTP/1.1" 200 None
2026-03-30 07:36:37 [auto1.de] INFO: Saving data for LN72061: {'auction_closing_time': 1774970698.0, 'created_time': 1774381362.870855, 'last_price_update_time': 1774856197.998176}
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN72061') HTTP/1.1" 204 0
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: VZ67143
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ67143%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Scrape type for VZ67143: 2
2026-03-30 07:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a323705d-8422-5695-b7c7-e7b49d7b852a with identifier: VZ67143
2026-03-30 07:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a323705d-8422-5695-b7c7-e7b49d7b852a with scrape type 2
2026-03-30 07:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a323705d-8422-5695-b7c7-e7b49d7b852a with scrape type 2
2026-03-30 07:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a323705d-8422-5695-b7c7-e7b49d7b852a, identifier: VZ67143
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: YR94789
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: FU89113
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU89113%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Scrape type for FU89113: 2
2026-03-30 07:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79df5cf8-c658-5c9d-9510-e1d8026f00e1 with identifier: FU89113
2026-03-30 07:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79df5cf8-c658-5c9d-9510-e1d8026f00e1 with scrape type 2
2026-03-30 07:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79df5cf8-c658-5c9d-9510-e1d8026f00e1 with scrape type 2
2026-03-30 07:36:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79df5cf8-c658-5c9d-9510-e1d8026f00e1, identifier: FU89113
2026-03-30 07:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a323705d-8422-5695-b7c7-e7b49d7b852a with identifier: VZ67143
2026-03-30 07:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a323705d-8422-5695-b7c7-e7b49d7b852a with identifier: VZ67143
2026-03-30 07:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a323705d-8422-5695-b7c7-e7b49d7b852a with identifier: VZ67143 to the API
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:08:25Z',
 'fuel_type': 'petrol',
 'id': 'a323705d-8422-5695-b7c7-e7b49d7b852a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ67143',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 162344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-05',
 'seller_name': None,
 'title': 'BMW 1er 120i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ67143%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Saving data for VZ67143: {'auction_closing_time': 1774969705.0, 'created_time': 1773380659.172776, 'last_price_update_time': 1774856198.57912}
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ67143') HTTP/1.1" 204 0
2026-03-30 07:36:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79df5cf8-c658-5c9d-9510-e1d8026f00e1 with identifier: FU89113
2026-03-30 07:36:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79df5cf8-c658-5c9d-9510-e1d8026f00e1 with identifier: FU89113
2026-03-30 07:36:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79df5cf8-c658-5c9d-9510-e1d8026f00e1 with identifier: FU89113 to the API
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:57:04Z',
 'fuel_type': 'diesel',
 'id': '79df5cf8-c658-5c9d-9510-e1d8026f00e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU89113',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 115310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-13',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2016}
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU89113%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Saving data for FU89113: {'auction_closing_time': 1774972624.0, 'created_time': 1774550918.78458, 'last_price_update_time': 1774856198.93145}
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU89113') HTTP/1.1" 204 0
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: EF20977
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: UD38277
2026-03-30 07:36:38 [auto1.de] INFO: Found listing with ID: DS53999
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS53999%27 HTTP/1.1" 200 None
2026-03-30 07:36:38 [auto1.de] INFO: Scrape type for DS53999: 2
2026-03-30 07:36:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d41d511-ae60-5511-b370-40b79354e72d with identifier: DS53999
2026-03-30 07:36:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d41d511-ae60-5511-b370-40b79354e72d with scrape type 2
2026-03-30 07:36:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d41d511-ae60-5511-b370-40b79354e72d with scrape type 2
2026-03-30 07:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d41d511-ae60-5511-b370-40b79354e72d, identifier: DS53999
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: LY71761
2026-03-30 07:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d41d511-ae60-5511-b370-40b79354e72d with identifier: DS53999
2026-03-30 07:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d41d511-ae60-5511-b370-40b79354e72d with identifier: DS53999
2026-03-30 07:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d41d511-ae60-5511-b370-40b79354e72d with identifier: DS53999 to the API
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:16:17Z',
 'fuel_type': 'petrol',
 'id': '1d41d511-ae60-5511-b370-40b79354e72d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS53999',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 369022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-06-26',
 'seller_name': None,
 'title': 'Audi A4 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS53999%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Saving data for DS53999: {'auction_closing_time': 1774970177.0, 'created_time': 1774378099.204775, 'last_price_update_time': 1774856199.44388}
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS53999') HTTP/1.1" 204 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: SG45173
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: AY72100
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: CL04690
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL04690%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for CL04690: 2
2026-03-30 07:36:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 223ed1af-15ce-530b-b8d6-1309c322b97e with identifier: CL04690
2026-03-30 07:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 223ed1af-15ce-530b-b8d6-1309c322b97e with scrape type 2
2026-03-30 07:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 223ed1af-15ce-530b-b8d6-1309c322b97e with scrape type 2
2026-03-30 07:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 223ed1af-15ce-530b-b8d6-1309c322b97e, identifier: CL04690
2026-03-30 07:36:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:36:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d2f390>
2026-03-30 07:36:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgea%252Fa7%252Feaa7382c49c757850977d66b3f40a58b%252Fpa%252FYP91302_ef119eae993b6cafbaa4d778408806de.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ef119eae993b6cafbaa4d778408806de.jpg saved to cache
2026-03-30 07:36:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1
2026-03-30 07:36:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77bf57c3-aed0-5c8e-be7a-35a6158284f1, skipping ID generation
2026-03-30 07:36:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1 with scrape type 1
2026-03-30 07:36:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77bf57c3-aed0-5c8e-be7a-35a6158284f1 sending to next pipeline
2026-03-30 07:36:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77bf57c3-aed0-5c8e-be7a-35a6158284f1, identifier: YP91302
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: FE80519
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: MC31762
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC31762%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for MC31762: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: VZ67143
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ67143%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for VZ67143: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: EF20977
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: UD38277
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: DS53999
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS53999%27 HTTP/1.1" 200 None
2026-03-30 07:36:39 [auto1.de] INFO: Scrape type for DS53999: 0
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: SG45173
2026-03-30 07:36:39 [auto1.de] INFO: Found listing with ID: AY72100
2026-03-30 07:36:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 223ed1af-15ce-530b-b8d6-1309c322b97e with identifier: CL04690
2026-03-30 07:36:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 223ed1af-15ce-530b-b8d6-1309c322b97e with identifier: CL04690
2026-03-30 07:36:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 223ed1af-15ce-530b-b8d6-1309c322b97e with identifier: CL04690 to the API
2026-03-30 07:36:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:13:14Z',
 'fuel_type': 'diesel',
 'id': '223ed1af-15ce-530b-b8d6-1309c322b97e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL04690',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 141104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-16',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL04690%27 HTTP/1.1" 200 None
2026-03-30 07:36:40 [auto1.de] INFO: Saving data for CL04690: {'auction_closing_time': 1774969994.0, 'created_time': 1773688612.77111, 'last_price_update_time': 1774856200.244889}
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL04690') HTTP/1.1" 204 0
2026-03-30 07:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77bf57c3-aed0-5c8e-be7a-35a6158284f1 with identifier: YP91302
2026-03-30 07:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77bf57c3-aed0-5c8e-be7a-35a6158284f1 with identifier: YP91302
2026-03-30 07:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77bf57c3-aed0-5c8e-be7a-35a6158284f1 with identifier: YP91302 to the API
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ef119eae993b6cafbaa4d778408806de.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:51:32Z',
 'fuel_type': 'petrol',
 'id': '77bf57c3-aed0-5c8e-be7a-35a6158284f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP91302',
 'listing': 'auction',
 'location': 'DE, Berlin',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 118541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2908269,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_844e14c737608a4194a0dfee7bdd2eac.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2754812,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_9390b3238ebb8dd366f2c0b54cf1ca3b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ea56d654c39113da02742598b3a9bacf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_6876bc6a961756fc78aa322d4bdf27ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2870890,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_2391f23dabf62c1c82731391c9e20c5e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_352f0d916bcd834b1e51eaf510836204.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ef56c992299c40a381c300c1bc129567.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_6058864d856698ce0cc70eae92ccbb45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_f38c6db568f500a4a0069c1f1e4ce0ec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77bf57c3-aed0-5c8e-be7a-35a6158284f1/77bf57c3-aed0-5c8e-be7a-35a6158284f1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3134141,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgea/a7/eaa7382c49c757850977d66b3f40a58b/pa/YP91302_ef119eae993b6cafbaa4d778408806de.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91302%27 HTTP/1.1" 200 None
2026-03-30 07:36:40 [auto1.de] INFO: Saving data for YP91302: {'created_time': 1774856200.745874, 'last_price_update_time': 1774856200.745886, 'auction_closing_time': 1774972292.0}
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YP91302') HTTP/1.1" 204 0
2026-03-30 07:36:40 [auto1.de] INFO: Found listing with ID: UH91278
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91278%27 HTTP/1.1" 200 None
2026-03-30 07:36:40 [auto1.de] INFO: Scrape type for UH91278: 2
2026-03-30 07:36:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b735a4-e0e6-59d1-bb69-d10bc10da164 with identifier: UH91278
2026-03-30 07:36:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b735a4-e0e6-59d1-bb69-d10bc10da164 with scrape type 2
2026-03-30 07:36:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b735a4-e0e6-59d1-bb69-d10bc10da164 with scrape type 2
2026-03-30 07:36:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10b735a4-e0e6-59d1-bb69-d10bc10da164, identifier: UH91278
2026-03-30 07:36:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10b735a4-e0e6-59d1-bb69-d10bc10da164 with identifier: UH91278
2026-03-30 07:36:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10b735a4-e0e6-59d1-bb69-d10bc10da164 with identifier: UH91278
2026-03-30 07:36:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10b735a4-e0e6-59d1-bb69-d10bc10da164 with identifier: UH91278 to the API
2026-03-30 07:36:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:20:45Z',
 'fuel_type': 'petrol',
 'id': '10b735a4-e0e6-59d1-bb69-d10bc10da164',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UH91278',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 101740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-26',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis Standard',
 'transmission': 'automatic',
 'trim': 'Basis Standard',
 'year': 2015}
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91278%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Saving data for UH91278: {'auction_closing_time': 1774970445.0, 'created_time': 1774380933.320522, 'last_price_update_time': 1774856201.379142}
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UH91278') HTTP/1.1" 204 0
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: SG73532
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: HY62017
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: KM62528
2026-03-30 07:36:41 [auto1.de] INFO: Found listing with ID: AF02059
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF02059%27 HTTP/1.1" 200 None
2026-03-30 07:36:41 [auto1.de] INFO: Scrape type for AF02059: 2
2026-03-30 07:36:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beab2b36-1c41-5511-ae32-9d50749794d0 with identifier: AF02059
2026-03-30 07:36:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beab2b36-1c41-5511-ae32-9d50749794d0 with scrape type 2
2026-03-30 07:36:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item beab2b36-1c41-5511-ae32-9d50749794d0 with scrape type 2
2026-03-30 07:36:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: beab2b36-1c41-5511-ae32-9d50749794d0, identifier: AF02059
2026-03-30 07:36:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: beab2b36-1c41-5511-ae32-9d50749794d0 with identifier: AF02059
2026-03-30 07:36:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: beab2b36-1c41-5511-ae32-9d50749794d0 with identifier: AF02059
2026-03-30 07:36:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: beab2b36-1c41-5511-ae32-9d50749794d0 with identifier: AF02059 to the API
2026-03-30 07:36:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:17:18Z',
 'fuel_type': 'petrol',
 'id': 'beab2b36-1c41-5511-ae32-9d50749794d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF02059',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 108320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2014}
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF02059%27 HTTP/1.1" 200 None
2026-03-30 07:36:42 [auto1.de] INFO: Saving data for AF02059: {'auction_closing_time': 1774970238.0, 'created_time': 1774380599.661486, 'last_price_update_time': 1774856202.265166}
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF02059') HTTP/1.1" 204 0
2026-03-30 07:36:42 [auto1.de] INFO: Found listing with ID: XC72019
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC72019%27 HTTP/1.1" 200 None
2026-03-30 07:36:42 [auto1.de] INFO: Scrape type for XC72019: 2
2026-03-30 07:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e089383f-ce12-53c8-830a-dfcc06853951 with identifier: XC72019
2026-03-30 07:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e089383f-ce12-53c8-830a-dfcc06853951 with scrape type 2
2026-03-30 07:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e089383f-ce12-53c8-830a-dfcc06853951 with scrape type 2
2026-03-30 07:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e089383f-ce12-53c8-830a-dfcc06853951, identifier: XC72019
2026-03-30 07:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e089383f-ce12-53c8-830a-dfcc06853951 with identifier: XC72019
2026-03-30 07:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e089383f-ce12-53c8-830a-dfcc06853951 with identifier: XC72019
2026-03-30 07:36:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e089383f-ce12-53c8-830a-dfcc06853951 with identifier: XC72019 to the API
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:49:42Z',
 'fuel_type': 'diesel',
 'id': 'e089383f-ce12-53c8-830a-dfcc06853951',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC72019',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 94364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-18',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Family FWD',
 'transmission': 'automatic',
 'trim': 'Family FWD',
 'year': 2021}
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC72019%27 HTTP/1.1" 200 None
2026-03-30 07:36:42 [auto1.de] INFO: Saving data for XC72019: {'auction_closing_time': 1774972182.0, 'created_time': 1773306115.924857, 'last_price_update_time': 1774856202.779488}
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC72019') HTTP/1.1" 204 0
2026-03-30 07:36:42 [auto1.de] INFO: Found listing with ID: HG55526
2026-03-30 07:36:42 [auto1.de] INFO: Found listing with ID: AE75299
2026-03-30 07:36:42 [auto1.de] INFO: Found listing with ID: EL20809
2026-03-30 07:36:42 [auto1.de] INFO: Found listing with ID: RM36813
2026-03-30 07:36:42 [auto1.de] INFO: Found listing with ID: ND85219
2026-03-30 07:36:42 [auto1.de] INFO: Found listing with ID: AH35551
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH35551%27 HTTP/1.1" 200 None
2026-03-30 07:36:42 [auto1.de] INFO: Scrape type for AH35551: 2
2026-03-30 07:36:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2341b8d-de62-57ef-8f44-ab85f3ca8973 with identifier: AH35551
2026-03-30 07:36:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2341b8d-de62-57ef-8f44-ab85f3ca8973 with scrape type 2
2026-03-30 07:36:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2341b8d-de62-57ef-8f44-ab85f3ca8973 with scrape type 2
2026-03-30 07:36:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2341b8d-de62-57ef-8f44-ab85f3ca8973, identifier: AH35551
2026-03-30 07:36:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2341b8d-de62-57ef-8f44-ab85f3ca8973 with identifier: AH35551
2026-03-30 07:36:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2341b8d-de62-57ef-8f44-ab85f3ca8973 with identifier: AH35551
2026-03-30 07:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2341b8d-de62-57ef-8f44-ab85f3ca8973 with identifier: AH35551 to the API
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 55,
 'expiration_date': '2026-03-31T15:19:29Z',
 'fuel_type': 'petrol',
 'id': 'b2341b8d-de62-57ef-8f44-ab85f3ca8973',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH35551',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 175480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-19',
 'seller_name': None,
 'title': 'Fiat Panda 1.1 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH35551%27 HTTP/1.1" 200 None
2026-03-30 07:36:43 [auto1.de] INFO: Saving data for AH35551: {'auction_closing_time': 1774970369.0, 'created_time': 1774380432.951465, 'last_price_update_time': 1774856203.340114}
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH35551') HTTP/1.1" 204 0
2026-03-30 07:36:43 [auto1.de] INFO: Found listing with ID: EM14245
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM14245%27 HTTP/1.1" 200 None
2026-03-30 07:36:43 [auto1.de] INFO: Scrape type for EM14245: 2
2026-03-30 07:36:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3736c5f-15d3-5954-aba4-9c17c34225cd with identifier: EM14245
2026-03-30 07:36:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3736c5f-15d3-5954-aba4-9c17c34225cd with scrape type 2
2026-03-30 07:36:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3736c5f-15d3-5954-aba4-9c17c34225cd with scrape type 2
2026-03-30 07:36:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3736c5f-15d3-5954-aba4-9c17c34225cd, identifier: EM14245
2026-03-30 07:36:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3736c5f-15d3-5954-aba4-9c17c34225cd with identifier: EM14245
2026-03-30 07:36:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3736c5f-15d3-5954-aba4-9c17c34225cd with identifier: EM14245
2026-03-30 07:36:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3736c5f-15d3-5954-aba4-9c17c34225cd with identifier: EM14245 to the API
2026-03-30 07:36:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:07:20Z',
 'fuel_type': 'petrol',
 'id': 'b3736c5f-15d3-5954-aba4-9c17c34225cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM14245',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 412826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-25',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2009}
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM14245%27 HTTP/1.1" 200 None
2026-03-30 07:36:44 [auto1.de] INFO: Saving data for EM14245: {'auction_closing_time': 1774969640.0, 'created_time': 1774465730.583988, 'last_price_update_time': 1774856204.252075}
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM14245') HTTP/1.1" 204 0
2026-03-30 07:36:44 [auto1.de] INFO: Found listing with ID: PV86472
2026-03-30 07:36:44 [auto1.de] INFO: Found listing with ID: VJ37696
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ37696%27 HTTP/1.1" 200 None
2026-03-30 07:36:44 [auto1.de] INFO: Scrape type for VJ37696: 2
2026-03-30 07:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e15817a-67df-59a7-8db5-cc1ac5073a48 with identifier: VJ37696
2026-03-30 07:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e15817a-67df-59a7-8db5-cc1ac5073a48 with scrape type 2
2026-03-30 07:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e15817a-67df-59a7-8db5-cc1ac5073a48 with scrape type 2
2026-03-30 07:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e15817a-67df-59a7-8db5-cc1ac5073a48, identifier: VJ37696
2026-03-30 07:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN22228> (referer: https://www.auto1.com/v1/car-details-view/MN22228/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e15817a-67df-59a7-8db5-cc1ac5073a48 with identifier: VJ37696
2026-03-30 07:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e15817a-67df-59a7-8db5-cc1ac5073a48 with identifier: VJ37696
2026-03-30 07:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e15817a-67df-59a7-8db5-cc1ac5073a48 with identifier: VJ37696 to the API
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:46:14Z',
 'fuel_type': 'petrol',
 'id': '7e15817a-67df-59a7-8db5-cc1ac5073a48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ37696',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 57789,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-27',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2017}
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ37696%27 HTTP/1.1" 200 None
2026-03-30 07:36:44 [auto1.de] INFO: Saving data for VJ37696: {'auction_closing_time': 1774971974.0, 'created_time': 1774467151.20817, 'last_price_update_time': 1774856204.728809}
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ37696') HTTP/1.1" 204 0
2026-03-30 07:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LY71761/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:44 [auto1.de] INFO: Found listing with ID: VY63136
2026-03-30 07:36:44 [auto1.de] INFO: Found listing with ID: GM66597
2026-03-30 07:36:44 [auto1.de] INFO: Found listing with ID: UZ22488
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ22488%27 HTTP/1.1" 200 None
2026-03-30 07:36:44 [auto1.de] INFO: Scrape type for UZ22488: 2
2026-03-30 07:36:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f45ecd3-f22d-594e-b74e-8ca40a8a4df3 with identifier: UZ22488
2026-03-30 07:36:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f45ecd3-f22d-594e-b74e-8ca40a8a4df3 with scrape type 2
2026-03-30 07:36:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f45ecd3-f22d-594e-b74e-8ca40a8a4df3 with scrape type 2
2026-03-30 07:36:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f45ecd3-f22d-594e-b74e-8ca40a8a4df3, identifier: UZ22488
2026-03-30 07:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FB79973> (referer: https://www.auto1.com/v1/car-details-view/FB79973/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f45ecd3-f22d-594e-b74e-8ca40a8a4df3 with identifier: UZ22488
2026-03-30 07:36:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f45ecd3-f22d-594e-b74e-8ca40a8a4df3 with identifier: UZ22488
2026-03-30 07:36:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f45ecd3-f22d-594e-b74e-8ca40a8a4df3 with identifier: UZ22488 to the API
2026-03-30 07:36:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-31T15:17:14Z',
 'fuel_type': 'diesel',
 'id': '6f45ecd3-f22d-594e-b74e-8ca40a8a4df3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ22488',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 76309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-06',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2018}
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ22488%27 HTTP/1.1" 200 None
2026-03-30 07:36:45 [auto1.de] INFO: Saving data for UZ22488: {'auction_closing_time': 1774970234.0, 'created_time': 1774467666.324792, 'last_price_update_time': 1774856205.232573}
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ22488') HTTP/1.1" 204 0
2026-03-30 07:36:45 [auto1.de] INFO: Found listing with ID: PX60208
2026-03-30 07:36:45 [auto1.de] INFO: Found listing with ID: DE91366
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE91366%27 HTTP/1.1" 200 None
2026-03-30 07:36:45 [auto1.de] INFO: Scrape type for DE91366: 1
2026-03-30 07:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41b03d95-f474-5dfb-87f0-bd9663dab586 with identifier: MN22228
2026-03-30 07:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41b03d95-f474-5dfb-87f0-bd9663dab586 with scrape type 1
2026-03-30 07:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 41b03d95-f474-5dfb-87f0-bd9663dab586
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3f2da38b607244022503e3f66bda0%252Fpa%252FMN22228_302b2ebdb57f0225b9ceb503d339b8c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_302b2ebdb57f0225b9ceb503d339b8c6.jpg already downloaded
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3f2da38b607244022503e3f66bda0%252Fpa%252FMN22228_9a3a198267ee2aa40c6d46cd4b8994bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_9a3a198267ee2aa40c6d46cd4b8994bd.jpg already downloaded
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3f2da38b607244022503e3f66bda0%252Fpa%252FMN22228_c60fe149ba5862c24bb2d930209a7eca.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_c60fe149ba5862c24bb2d930209a7eca.jpg already downloaded
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3f2da38b607244022503e3f66bda0%252Fpa%252FMN22228_2f232ad7ff192f5db1555eef39d67c46.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_2f232ad7ff192f5db1555eef39d67c46.jpg already downloaded
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252Ff3%252Ffdf3f2da38b607244022503e3f66bda0%252Fpa%252FMN22228_18ddddb0ec052f0b34202916c7a33410.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_18ddddb0ec052f0b34202916c7a33410.jpg already downloaded
2026-03-30 07:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41b03d95-f474-5dfb-87f0-bd9663dab586, identifier: MN22228
2026-03-30 07:36:45 [auto1.de] INFO: Found listing with ID: TW83791
2026-03-30 07:36:45 [auto1.de] INFO: Found listing with ID: LC46015
2026-03-30 07:36:45 [auto1.de] INFO: Found listing with ID: GR51738
2026-03-30 07:36:45 [auto1.de] INFO: Found listing with ID: VE81778
2026-03-30 07:36:45 [auto1.de] INFO: Found listing with ID: HX51661
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX51661%27 HTTP/1.1" 200 None
2026-03-30 07:36:45 [auto1.de] INFO: Scrape type for HX51661: 2
2026-03-30 07:36:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f4b9983-7d9d-552e-84bf-5c44e358186b with identifier: HX51661
2026-03-30 07:36:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f4b9983-7d9d-552e-84bf-5c44e358186b with scrape type 2
2026-03-30 07:36:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f4b9983-7d9d-552e-84bf-5c44e358186b with scrape type 2
2026-03-30 07:36:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f4b9983-7d9d-552e-84bf-5c44e358186b, identifier: HX51661
2026-03-30 07:36:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41b03d95-f474-5dfb-87f0-bd9663dab586 with identifier: MN22228
2026-03-30 07:36:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41b03d95-f474-5dfb-87f0-bd9663dab586 with identifier: MN22228
2026-03-30 07:36:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41b03d95-f474-5dfb-87f0-bd9663dab586 with identifier: MN22228 to the API
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MN22228>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:08:59Z',
 'fuel_type': 'petrol',
 'id': '41b03d95-f474-5dfb-87f0-bd9663dab586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN22228',
 'listing': 'auction',
 'location': 'DE, Sulz am Neckar',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 169424,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_302b2ebdb57f0225b9ceb503d339b8c6.jpg',
                'https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_9a3a198267ee2aa40c6d46cd4b8994bd.jpg',
                'https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_c60fe149ba5862c24bb2d930209a7eca.jpg',
                'https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_2f232ad7ff192f5db1555eef39d67c46.jpg',
                'https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_18ddddb0ec052f0b34202916c7a33410.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b03d95-f474-5dfb-87f0-bd9663dab586/41b03d95-f474-5dfb-87f0-bd9663dab586_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_302b2ebdb57f0225b9ceb503d339b8c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b03d95-f474-5dfb-87f0-bd9663dab586/41b03d95-f474-5dfb-87f0-bd9663dab586_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_9a3a198267ee2aa40c6d46cd4b8994bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b03d95-f474-5dfb-87f0-bd9663dab586/41b03d95-f474-5dfb-87f0-bd9663dab586_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_c60fe149ba5862c24bb2d930209a7eca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b03d95-f474-5dfb-87f0-bd9663dab586/41b03d95-f474-5dfb-87f0-bd9663dab586_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75399,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_2f232ad7ff192f5db1555eef39d67c46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41b03d95-f474-5dfb-87f0-bd9663dab586/41b03d95-f474-5dfb-87f0-bd9663dab586_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/f3/fdf3f2da38b607244022503e3f66bda0/pa/MN22228_18ddddb0ec052f0b34202916c7a33410.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-10-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 2.0 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN22228%27 HTTP/1.1" 200 None
2026-03-30 07:36:45 [auto1.de] INFO: Saving data for MN22228: {'created_time': 1774856205.984325, 'last_price_update_time': 1774856205.984373, 'auction_closing_time': 1774969739.0}
2026-03-30 07:36:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN22228') HTTP/1.1" 204 0
2026-03-30 07:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f4b9983-7d9d-552e-84bf-5c44e358186b with identifier: HX51661
2026-03-30 07:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f4b9983-7d9d-552e-84bf-5c44e358186b with identifier: HX51661
2026-03-30 07:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f4b9983-7d9d-552e-84bf-5c44e358186b with identifier: HX51661 to the API
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:05:15Z',
 'fuel_type': 'petrol',
 'id': '3f4b9983-7d9d-552e-84bf-5c44e358186b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX51661',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 59158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-14',
 'seller_name': None,
 'title': 'Audi TT 1.8 TFSI Roadster',
 'transmission': 'manual',
 'trim': 'Roadster',
 'year': 2013}
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX51661%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Saving data for HX51661: {'auction_closing_time': 1774969515.0, 'created_time': 1774380551.747527, 'last_price_update_time': 1774856206.525436}
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX51661') HTTP/1.1" 204 0
2026-03-30 07:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:46 [auto1.de] INFO: Channel: 24h | Page: 10 | totalHits: 7656 | hits on page: 40
2026-03-30 07:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1f7557c-fb27-542e-8401-9e5715d99c01 with identifier: FB79973
2026-03-30 07:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1f7557c-fb27-542e-8401-9e5715d99c01 with scrape type 1
2026-03-30 07:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1f7557c-fb27-542e-8401-9e5715d99c01
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_2b5f1a4314a3392a9b76f610bce9042c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_2b5f1a4314a3392a9b76f610bce9042c.jpg not downloaded yet
2026-03-30 07:36:46 [auto1.de] INFO: Found listing with ID: FK17584
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK17584%27 HTTP/1.1" 200 None
2026-03-30 07:36:46 [auto1.de] INFO: Scrape type for FK17584: 2
2026-03-30 07:36:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b932cf93-7e5f-5e11-81eb-458ef89c45ab with identifier: FK17584
2026-03-30 07:36:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b932cf93-7e5f-5e11-81eb-458ef89c45ab with scrape type 2
2026-03-30 07:36:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b932cf93-7e5f-5e11-81eb-458ef89c45ab with scrape type 2
2026-03-30 07:36:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b932cf93-7e5f-5e11-81eb-458ef89c45ab, identifier: FK17584
2026-03-30 07:36:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b932cf93-7e5f-5e11-81eb-458ef89c45ab with identifier: FK17584
2026-03-30 07:36:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b932cf93-7e5f-5e11-81eb-458ef89c45ab with identifier: FK17584
2026-03-30 07:36:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b932cf93-7e5f-5e11-81eb-458ef89c45ab with identifier: FK17584 to the API
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:22:10Z',
 'fuel_type': 'petrol',
 'id': 'b932cf93-7e5f-5e11-81eb-458ef89c45ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK17584',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 47849,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-21',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2023}
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK17584%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Saving data for FK17584: {'auction_closing_time': 1774970530.0, 'created_time': 1774337760.581437, 'last_price_update_time': 1774856207.195316}
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK17584') HTTP/1.1" 204 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: PX60208
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: DE91366
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_67fde5ad55deca6b0b295d979051443d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_67fde5ad55deca6b0b295d979051443d.jpg not downloaded yet
2026-03-30 07:36:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: ND90480
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: ZG41092
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG41092%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for ZG41092: 2
2026-03-30 07:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b979e1df-9c93-520c-95c3-01da556058b6 with identifier: ZG41092
2026-03-30 07:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b979e1df-9c93-520c-95c3-01da556058b6 with scrape type 2
2026-03-30 07:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b979e1df-9c93-520c-95c3-01da556058b6 with scrape type 2
2026-03-30 07:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b979e1df-9c93-520c-95c3-01da556058b6, identifier: ZG41092
2026-03-30 07:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b979e1df-9c93-520c-95c3-01da556058b6 with identifier: ZG41092
2026-03-30 07:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b979e1df-9c93-520c-95c3-01da556058b6 with identifier: ZG41092
2026-03-30 07:36:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b979e1df-9c93-520c-95c3-01da556058b6 with identifier: ZG41092 to the API
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:32:42Z',
 'fuel_type': 'petrol',
 'id': 'b979e1df-9c93-520c-95c3-01da556058b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG41092',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 95327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG41092%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Saving data for ZG41092: {'auction_closing_time': 1774971162.0, 'created_time': 1774380895.252956, 'last_price_update_time': 1774856207.747497}
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG41092') HTTP/1.1" 204 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: TW83791
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: LC46015
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: GR51738
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: VE81778
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: HX51661
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX51661%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for HX51661: 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: FK17584
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK17584%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for FK17584: 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: ND90480
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: ZG41092
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG41092%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for ZG41092: 0
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: WP00727
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: BZ91502
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: NC83571
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC83571%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [auto1.de] INFO: Scrape type for NC83571: 2
2026-03-30 07:36:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fdddae4-7523-5ba4-b476-46ffa76a2c2c with identifier: NC83571
2026-03-30 07:36:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fdddae4-7523-5ba4-b476-46ffa76a2c2c with scrape type 2
2026-03-30 07:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fdddae4-7523-5ba4-b476-46ffa76a2c2c with scrape type 2
2026-03-30 07:36:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fdddae4-7523-5ba4-b476-46ffa76a2c2c, identifier: NC83571
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_6966829bc9581511d4d5da4ba7cb1db0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_6966829bc9581511d4d5da4ba7cb1db0.jpg not downloaded yet
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: WP00727
2026-03-30 07:36:47 [auto1.de] INFO: Found listing with ID: BZ91502
2026-03-30 07:36:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fdddae4-7523-5ba4-b476-46ffa76a2c2c with identifier: NC83571
2026-03-30 07:36:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fdddae4-7523-5ba4-b476-46ffa76a2c2c with identifier: NC83571
2026-03-30 07:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fdddae4-7523-5ba4-b476-46ffa76a2c2c with identifier: NC83571 to the API
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-31T15:10:42Z',
 'fuel_type': 'petrol',
 'id': '4fdddae4-7523-5ba4-b476-46ffa76a2c2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC83571',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 322618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-02',
 'seller_name': None,
 'title': 'Audi A8 3.7 V8 quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2004}
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC83571%27 HTTP/1.1" 200 None
2026-03-30 07:36:48 [auto1.de] INFO: Saving data for NC83571: {'auction_closing_time': 1774969842.0, 'created_time': 1773307443.295828, 'last_price_update_time': 1774856208.305704}
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC83571') HTTP/1.1" 204 0
2026-03-30 07:36:48 [auto1.de] INFO: Found listing with ID: XZ84287
2026-03-30 07:36:48 [auto1.de] INFO: Found listing with ID: SM33942
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM33942%27 HTTP/1.1" 200 None
2026-03-30 07:36:48 [auto1.de] INFO: Scrape type for SM33942: 2
2026-03-30 07:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82b86bee-6f1d-5c0b-9509-7258cfc0cddb with identifier: SM33942
2026-03-30 07:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82b86bee-6f1d-5c0b-9509-7258cfc0cddb with scrape type 2
2026-03-30 07:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82b86bee-6f1d-5c0b-9509-7258cfc0cddb with scrape type 2
2026-03-30 07:36:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82b86bee-6f1d-5c0b-9509-7258cfc0cddb, identifier: SM33942
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_42529730ecaf8f25911e24cb5ff84e91.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_42529730ecaf8f25911e24cb5ff84e91.jpg not downloaded yet
2026-03-30 07:36:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_2b5f1a4314a3392a9b76f610bce9042c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82b86bee-6f1d-5c0b-9509-7258cfc0cddb with identifier: SM33942
2026-03-30 07:36:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82b86bee-6f1d-5c0b-9509-7258cfc0cddb with identifier: SM33942
2026-03-30 07:36:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82b86bee-6f1d-5c0b-9509-7258cfc0cddb with identifier: SM33942 to the API
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:14:15Z',
 'fuel_type': 'petrol',
 'id': '82b86bee-6f1d-5c0b-9509-7258cfc0cddb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM33942',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 113216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-18',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM33942%27 HTTP/1.1" 200 None
2026-03-30 07:36:48 [auto1.de] INFO: Saving data for SM33942: {'auction_closing_time': 1774970055.0, 'created_time': 1773688242.031924, 'last_price_update_time': 1774856208.947809}
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM33942') HTTP/1.1" 204 0
2026-03-30 07:36:48 [auto1.de] INFO: Found listing with ID: YW60751
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW60751%27 HTTP/1.1" 200 None
2026-03-30 07:36:48 [auto1.de] INFO: Scrape type for YW60751: 2
2026-03-30 07:36:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95e33c17-8293-5e80-aff3-a0b460380b36 with identifier: YW60751
2026-03-30 07:36:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95e33c17-8293-5e80-aff3-a0b460380b36 with scrape type 2
2026-03-30 07:36:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95e33c17-8293-5e80-aff3-a0b460380b36 with scrape type 2
2026-03-30 07:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95e33c17-8293-5e80-aff3-a0b460380b36, identifier: YW60751
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_03423f49705c9637bcf292b16e5f9d27.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_03423f49705c9637bcf292b16e5f9d27.jpg not downloaded yet
2026-03-30 07:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95e33c17-8293-5e80-aff3-a0b460380b36 with identifier: YW60751
2026-03-30 07:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95e33c17-8293-5e80-aff3-a0b460380b36 with identifier: YW60751
2026-03-30 07:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95e33c17-8293-5e80-aff3-a0b460380b36 with identifier: YW60751 to the API
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:43:32Z',
 'fuel_type': 'petrol',
 'id': '95e33c17-8293-5e80-aff3-a0b460380b36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW60751',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 93902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-17',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.4 TSI Scout 4x4',
 'transmission': 'automatic',
 'trim': 'Scout 4x4',
 'year': 2017}
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW60751%27 HTTP/1.1" 200 None
2026-03-30 07:36:49 [auto1.de] INFO: Saving data for YW60751: {'auction_closing_time': 1774971812.0, 'created_time': 1773661834.067708, 'last_price_update_time': 1774856209.465098}
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW60751') HTTP/1.1" 204 0
2026-03-30 07:36:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_67fde5ad55deca6b0b295d979051443d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:49 [auto1.de] INFO: Found listing with ID: PC62388
2026-03-30 07:36:49 [auto1.de] INFO: Found listing with ID: ZL97952
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL97952%27 HTTP/1.1" 200 None
2026-03-30 07:36:49 [auto1.de] INFO: Scrape type for ZL97952: 2
2026-03-30 07:36:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b67f886-09be-53be-ac98-48f982c18b4a with identifier: ZL97952
2026-03-30 07:36:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b67f886-09be-53be-ac98-48f982c18b4a with scrape type 2
2026-03-30 07:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b67f886-09be-53be-ac98-48f982c18b4a with scrape type 2
2026-03-30 07:36:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b67f886-09be-53be-ac98-48f982c18b4a, identifier: ZL97952
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_734e3e5518ffc3f8219d3ebf76372c27.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_734e3e5518ffc3f8219d3ebf76372c27.jpg not downloaded yet
2026-03-30 07:36:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b67f886-09be-53be-ac98-48f982c18b4a with identifier: ZL97952
2026-03-30 07:36:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b67f886-09be-53be-ac98-48f982c18b4a with identifier: ZL97952
2026-03-30 07:36:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b67f886-09be-53be-ac98-48f982c18b4a with identifier: ZL97952 to the API
2026-03-30 07:36:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:08:33Z',
 'fuel_type': 'petrol',
 'id': '9b67f886-09be-53be-ac98-48f982c18b4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL97952',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 8691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-05',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2016}
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL97952%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Saving data for ZL97952: {'auction_closing_time': 1774969713.0, 'created_time': 1773772538.526272, 'last_price_update_time': 1774856210.248996}
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL97952') HTTP/1.1" 204 0
2026-03-30 07:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d74690>
2026-03-30 07:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_2b5f1a4314a3392a9b76f610bce9042c.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_2b5f1a4314a3392a9b76f610bce9042c.jpg saved to cache
2026-03-30 07:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f1f7557c-fb27-542e-8401-9e5715d99c01
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: YR16927
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR16927%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Scrape type for YR16927: 2
2026-03-30 07:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4057fc73-7b46-59f6-ab8a-96f46100fbde with identifier: YR16927
2026-03-30 07:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4057fc73-7b46-59f6-ab8a-96f46100fbde with scrape type 2
2026-03-30 07:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4057fc73-7b46-59f6-ab8a-96f46100fbde with scrape type 2
2026-03-30 07:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4057fc73-7b46-59f6-ab8a-96f46100fbde, identifier: YR16927
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_ee09e1d158ccde165ae4331aad2f2c0d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_ee09e1d158ccde165ae4331aad2f2c0d.jpg not downloaded yet
2026-03-30 07:36:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4057fc73-7b46-59f6-ab8a-96f46100fbde with identifier: YR16927
2026-03-30 07:36:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4057fc73-7b46-59f6-ab8a-96f46100fbde with identifier: YR16927
2026-03-30 07:36:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4057fc73-7b46-59f6-ab8a-96f46100fbde with identifier: YR16927 to the API
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:56:21Z',
 'fuel_type': 'diesel',
 'id': '4057fc73-7b46-59f6-ab8a-96f46100fbde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR16927',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 233352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-04',
 'seller_name': None,
 'title': 'Mazda 5 1.6 CD Diesel Sendo',
 'transmission': 'manual',
 'trim': 'Sendo',
 'year': 2014}
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR16927%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Saving data for YR16927: {'auction_closing_time': 1774972581.0, 'created_time': 1774463871.601618, 'last_price_update_time': 1774856210.7898}
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR16927') HTTP/1.1" 204 0
2026-03-30 07:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE91366/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e0b2d0>
2026-03-30 07:36:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_67fde5ad55deca6b0b295d979051443d.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_67fde5ad55deca6b0b295d979051443d.jpg saved to cache
2026-03-30 07:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f1f7557c-fb27-542e-8401-9e5715d99c01
2026-03-30 07:36:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_42529730ecaf8f25911e24cb5ff84e91.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: NY36854
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: XT70791
2026-03-30 07:36:50 [auto1.de] INFO: Found listing with ID: KW33977
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW33977%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [auto1.de] INFO: Scrape type for KW33977: 2
2026-03-30 07:36:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95ff93ef-bf02-566b-b281-8864ea6abcdf with identifier: KW33977
2026-03-30 07:36:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95ff93ef-bf02-566b-b281-8864ea6abcdf with scrape type 2
2026-03-30 07:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95ff93ef-bf02-566b-b281-8864ea6abcdf with scrape type 2
2026-03-30 07:36:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95ff93ef-bf02-566b-b281-8864ea6abcdf, identifier: KW33977
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_df9fa7422ff12966fbb70b9124346bc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_df9fa7422ff12966fbb70b9124346bc9.jpg not downloaded yet
2026-03-30 07:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95ff93ef-bf02-566b-b281-8864ea6abcdf with identifier: KW33977
2026-03-30 07:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95ff93ef-bf02-566b-b281-8864ea6abcdf with identifier: KW33977
2026-03-30 07:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95ff93ef-bf02-566b-b281-8864ea6abcdf with identifier: KW33977 to the API
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:52:31Z',
 'fuel_type': 'diesel',
 'id': '95ff93ef-bf02-566b-b281-8864ea6abcdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW33977',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 153042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Life 4Motion',
 'transmission': 'automatic',
 'trim': 'Life 4Motion',
 'year': 2013}
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW33977%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Saving data for KW33977: {'auction_closing_time': 1774972351.0, 'created_time': 1773342969.823864, 'last_price_update_time': 1774856211.362582}
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW33977') HTTP/1.1" 204 0
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: TR81994
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR81994%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for TR81994: 2
2026-03-30 07:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00fe0c52-7ce5-504a-b011-6ca8bb0c3f83 with identifier: TR81994
2026-03-30 07:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00fe0c52-7ce5-504a-b011-6ca8bb0c3f83 with scrape type 2
2026-03-30 07:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00fe0c52-7ce5-504a-b011-6ca8bb0c3f83 with scrape type 2
2026-03-30 07:36:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00fe0c52-7ce5-504a-b011-6ca8bb0c3f83, identifier: TR81994
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_592c4b3eb354a7404700ba20c3f9ce83.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_592c4b3eb354a7404700ba20c3f9ce83.jpg not downloaded yet
2026-03-30 07:36:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00fe0c52-7ce5-504a-b011-6ca8bb0c3f83 with identifier: TR81994
2026-03-30 07:36:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00fe0c52-7ce5-504a-b011-6ca8bb0c3f83 with identifier: TR81994
2026-03-30 07:36:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00fe0c52-7ce5-504a-b011-6ca8bb0c3f83 with identifier: TR81994 to the API
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-31T15:46:48Z',
 'fuel_type': 'diesel',
 'id': '00fe0c52-7ce5-504a-b011-6ca8bb0c3f83',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR81994',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 17296,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-22',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2022}
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR81994%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Saving data for TR81994: {'auction_closing_time': 1774972008.0, 'created_time': 1773308333.465253, 'last_price_update_time': 1774856211.859697}
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR81994') HTTP/1.1" 204 0
2026-03-30 07:36:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d764d0>
2026-03-30 07:36:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_42529730ecaf8f25911e24cb5ff84e91.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_42529730ecaf8f25911e24cb5ff84e91.jpg saved to cache
2026-03-30 07:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f1f7557c-fb27-542e-8401-9e5715d99c01
2026-03-30 07:36:51 [auto1.de] INFO: Found listing with ID: EE94897
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE94897%27 HTTP/1.1" 200 None
2026-03-30 07:36:51 [auto1.de] INFO: Scrape type for EE94897: 2
2026-03-30 07:36:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa20283f-efea-5614-aa8b-7e300078129f with identifier: EE94897
2026-03-30 07:36:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa20283f-efea-5614-aa8b-7e300078129f with scrape type 2
2026-03-30 07:36:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa20283f-efea-5614-aa8b-7e300078129f with scrape type 2
2026-03-30 07:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa20283f-efea-5614-aa8b-7e300078129f, identifier: EE94897
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_a1fd78f8e4398d69b59aa7eba6caeaad.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_a1fd78f8e4398d69b59aa7eba6caeaad.jpg not downloaded yet
2026-03-30 07:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa20283f-efea-5614-aa8b-7e300078129f with identifier: EE94897
2026-03-30 07:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa20283f-efea-5614-aa8b-7e300078129f with identifier: EE94897
2026-03-30 07:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa20283f-efea-5614-aa8b-7e300078129f with identifier: EE94897 to the API
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:17:46Z',
 'fuel_type': 'diesel',
 'id': 'fa20283f-efea-5614-aa8b-7e300078129f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE94897',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 155790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-11',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2015}
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE94897%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Saving data for EE94897: {'auction_closing_time': 1774970266.0, 'created_time': 1774381340.894263, 'last_price_update_time': 1774856212.38561}
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE94897') HTTP/1.1" 204 0
2026-03-30 07:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LY71761> (referer: https://www.auto1.com/v1/car-details-view/LY71761/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: LN73232
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73232%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Scrape type for LN73232: 2
2026-03-30 07:36:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10257d7c-23b1-5ff3-8a85-e1ad243336b5 with identifier: LN73232
2026-03-30 07:36:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10257d7c-23b1-5ff3-8a85-e1ad243336b5 with scrape type 2
2026-03-30 07:36:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10257d7c-23b1-5ff3-8a85-e1ad243336b5 with scrape type 2
2026-03-30 07:36:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10257d7c-23b1-5ff3-8a85-e1ad243336b5, identifier: LN73232
2026-03-30 07:36:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10257d7c-23b1-5ff3-8a85-e1ad243336b5 with identifier: LN73232
2026-03-30 07:36:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10257d7c-23b1-5ff3-8a85-e1ad243336b5 with identifier: LN73232
2026-03-30 07:36:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10257d7c-23b1-5ff3-8a85-e1ad243336b5 with identifier: LN73232 to the API
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:53:28Z',
 'fuel_type': 'diesel',
 'id': '10257d7c-23b1-5ff3-8a85-e1ad243336b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN73232',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 181000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-05',
 'seller_name': None,
 'title': 'Seat Leon 1.6 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73232%27 HTTP/1.1" 200 None
2026-03-30 07:36:52 [auto1.de] INFO: Saving data for LN73232: {'auction_closing_time': 1774972408.0, 'created_time': 1774381401.40928, 'last_price_update_time': 1774856212.976647}
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN73232') HTTP/1.1" 204 0
2026-03-30 07:36:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA34461> (referer: https://www.auto1.com/v1/car-details-view/YA34461/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:52 [auto1.de] INFO: Found listing with ID: AY88007
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY88007%27 HTTP/1.1" 200 None
2026-03-30 07:36:53 [auto1.de] INFO: Scrape type for AY88007: 1
2026-03-30 07:36:53 [auto1.de] INFO: Channel: 24h | Page: 11 | totalHits: 7665 | hits on page: 40
2026-03-30 07:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02f7ec57-0eae-5da7-90a0-01ed112c4811 with identifier: LY71761
2026-03-30 07:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02f7ec57-0eae-5da7-90a0-01ed112c4811 with scrape type 1
2026-03-30 07:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02f7ec57-0eae-5da7-90a0-01ed112c4811
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_0e54e2951c5155f8aedc3cb25626e387.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_0e54e2951c5155f8aedc3cb25626e387.jpg not downloaded yet
2026-03-30 07:36:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_592c4b3eb354a7404700ba20c3f9ce83.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:53 [auto1.de] INFO: Found listing with ID: CY03369
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY03369%27 HTTP/1.1" 200 None
2026-03-30 07:36:53 [auto1.de] INFO: Scrape type for CY03369: 2
2026-03-30 07:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 147e9f14-ead3-578a-8ee7-54965b2be7e7 with identifier: CY03369
2026-03-30 07:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 147e9f14-ead3-578a-8ee7-54965b2be7e7 with scrape type 2
2026-03-30 07:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 147e9f14-ead3-578a-8ee7-54965b2be7e7 with scrape type 2
2026-03-30 07:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 147e9f14-ead3-578a-8ee7-54965b2be7e7, identifier: CY03369
2026-03-30 07:36:53 [auto1.de] INFO: Found listing with ID: EG89523
2026-03-30 07:36:53 [auto1.de] INFO: Found listing with ID: PE93085
2026-03-30 07:36:53 [auto1.de] INFO: Found listing with ID: WM94615
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM94615%27 HTTP/1.1" 200 None
2026-03-30 07:36:53 [auto1.de] INFO: Scrape type for WM94615: 2
2026-03-30 07:36:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7759d26-2a61-5c2c-8fac-5add08f583ce with identifier: WM94615
2026-03-30 07:36:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7759d26-2a61-5c2c-8fac-5add08f583ce with scrape type 2
2026-03-30 07:36:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7759d26-2a61-5c2c-8fac-5add08f583ce with scrape type 2
2026-03-30 07:36:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7759d26-2a61-5c2c-8fac-5add08f583ce, identifier: WM94615
2026-03-30 07:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 147e9f14-ead3-578a-8ee7-54965b2be7e7 with identifier: CY03369
2026-03-30 07:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 147e9f14-ead3-578a-8ee7-54965b2be7e7 with identifier: CY03369
2026-03-30 07:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 147e9f14-ead3-578a-8ee7-54965b2be7e7 with identifier: CY03369 to the API
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:50:41Z',
 'fuel_type': 'petrol',
 'id': '147e9f14-ead3-578a-8ee7-54965b2be7e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY03369',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 7057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 200 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2023}
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY03369%27 HTTP/1.1" 200 None
2026-03-30 07:36:53 [auto1.de] INFO: Saving data for CY03369: {'auction_closing_time': 1774972241.0, 'created_time': 1773341807.817937, 'last_price_update_time': 1774856213.66049}
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY03369') HTTP/1.1" 204 0
2026-03-30 07:36:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7759d26-2a61-5c2c-8fac-5add08f583ce with identifier: WM94615
2026-03-30 07:36:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7759d26-2a61-5c2c-8fac-5add08f583ce with identifier: WM94615
2026-03-30 07:36:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7759d26-2a61-5c2c-8fac-5add08f583ce with identifier: WM94615 to the API
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:34:41Z',
 'fuel_type': 'hybrid',
 'id': 'c7759d26-2a61-5c2c-8fac-5add08f583ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM94615',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 28802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-08',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2020}
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM94615%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Saving data for WM94615: {'auction_closing_time': 1774971281.0, 'created_time': 1774463939.690744, 'last_price_update_time': 1774856214.011214}
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM94615') HTTP/1.1" 204 0
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_76e0e5318530c8ef0b89c3789ce2ab0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_76e0e5318530c8ef0b89c3789ce2ab0b.jpg not downloaded yet
2026-03-30 07:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: CM48950
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM48950%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for CM48950: 2
2026-03-30 07:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96ca8029-f9ad-5cd5-954f-caeb03a9b957 with identifier: CM48950
2026-03-30 07:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96ca8029-f9ad-5cd5-954f-caeb03a9b957 with scrape type 2
2026-03-30 07:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96ca8029-f9ad-5cd5-954f-caeb03a9b957 with scrape type 2
2026-03-30 07:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 96ca8029-f9ad-5cd5-954f-caeb03a9b957, identifier: CM48950
2026-03-30 07:36:54 [auto1.de] INFO: Found listing with ID: KV84716
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84716%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Scrape type for KV84716: 2
2026-03-30 07:36:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5022f15-8c8a-5bf4-8a82-d71dced0d52a with identifier: KV84716
2026-03-30 07:36:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5022f15-8c8a-5bf4-8a82-d71dced0d52a with scrape type 2
2026-03-30 07:36:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5022f15-8c8a-5bf4-8a82-d71dced0d52a with scrape type 2
2026-03-30 07:36:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5022f15-8c8a-5bf4-8a82-d71dced0d52a, identifier: KV84716
2026-03-30 07:36:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_a1fd78f8e4398d69b59aa7eba6caeaad.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 96ca8029-f9ad-5cd5-954f-caeb03a9b957 with identifier: CM48950
2026-03-30 07:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 96ca8029-f9ad-5cd5-954f-caeb03a9b957 with identifier: CM48950
2026-03-30 07:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 96ca8029-f9ad-5cd5-954f-caeb03a9b957 with identifier: CM48950 to the API
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-31T15:23:06Z',
 'fuel_type': 'hybrid',
 'id': '96ca8029-f9ad-5cd5-954f-caeb03a9b957',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM48950',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Kona',
 'odometer': 147591,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-27',
 'seller_name': None,
 'title': 'Hyundai Kona 1.6 Hybrid Trend 2WD',
 'transmission': 'automatic',
 'trim': 'Trend 2WD',
 'year': 2020}
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM48950%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Saving data for CM48950: {'auction_closing_time': 1774970586.0, 'created_time': 1774381391.780473, 'last_price_update_time': 1774856214.651311}
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM48950') HTTP/1.1" 204 0
2026-03-30 07:36:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5022f15-8c8a-5bf4-8a82-d71dced0d52a with identifier: KV84716
2026-03-30 07:36:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5022f15-8c8a-5bf4-8a82-d71dced0d52a with identifier: KV84716
2026-03-30 07:36:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5022f15-8c8a-5bf4-8a82-d71dced0d52a with identifier: KV84716 to the API
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:18:22Z',
 'fuel_type': 'petrol',
 'id': 'b5022f15-8c8a-5bf4-8a82-d71dced0d52a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV84716',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 142032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 FSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84716%27 HTTP/1.1" 200 None
2026-03-30 07:36:54 [auto1.de] INFO: Saving data for KV84716: {'auction_closing_time': 1774970302.0, 'created_time': 1773689034.43364, 'last_price_update_time': 1774856214.982256}
2026-03-30 07:36:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV84716') HTTP/1.1" 204 0
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_ad5c0c9a1ed8fd1f0c64a54f7ec56dfb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_ad5c0c9a1ed8fd1f0c64a54f7ec56dfb.jpg not downloaded yet
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: GG80957
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG80957%27 HTTP/1.1" 200 None
2026-03-30 07:36:55 [auto1.de] INFO: Scrape type for GG80957: 2
2026-03-30 07:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2c0471c-6ea5-522f-9b46-6d00adbd1091 with identifier: GG80957
2026-03-30 07:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2c0471c-6ea5-522f-9b46-6d00adbd1091 with scrape type 2
2026-03-30 07:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2c0471c-6ea5-522f-9b46-6d00adbd1091 with scrape type 2
2026-03-30 07:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2c0471c-6ea5-522f-9b46-6d00adbd1091, identifier: GG80957
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: BS29922
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: DB31408
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: YK86609
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: WG79560
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: PC84380
2026-03-30 07:36:55 [auto1.de] INFO: Found listing with ID: GM71398
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM71398%27 HTTP/1.1" 200 None
2026-03-30 07:36:55 [auto1.de] INFO: Scrape type for GM71398: 2
2026-03-30 07:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cddc0dd-3bb8-59f8-8683-64ea6c32c0de with identifier: GM71398
2026-03-30 07:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cddc0dd-3bb8-59f8-8683-64ea6c32c0de with scrape type 2
2026-03-30 07:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cddc0dd-3bb8-59f8-8683-64ea6c32c0de with scrape type 2
2026-03-30 07:36:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8cddc0dd-3bb8-59f8-8683-64ea6c32c0de, identifier: GM71398
2026-03-30 07:36:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ebdb05-7cf8-5f48-a281-9edf48c62783 with identifier: YA34461
2026-03-30 07:36:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ebdb05-7cf8-5f48-a281-9edf48c62783 with scrape type 1
2026-03-30 07:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1ebdb05-7cf8-5f48-a281-9edf48c62783
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_263dd2164c87646b109b40e1a54090d9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_263dd2164c87646b109b40e1a54090d9.jpg not downloaded yet
2026-03-30 07:36:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24a7f90>
2026-03-30 07:36:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_592c4b3eb354a7404700ba20c3f9ce83.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_592c4b3eb354a7404700ba20c3f9ce83.jpg saved to cache
2026-03-30 07:36:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f1f7557c-fb27-542e-8401-9e5715d99c01
2026-03-30 07:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2c0471c-6ea5-522f-9b46-6d00adbd1091 with identifier: GG80957
2026-03-30 07:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2c0471c-6ea5-522f-9b46-6d00adbd1091 with identifier: GG80957
2026-03-30 07:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2c0471c-6ea5-522f-9b46-6d00adbd1091 with identifier: GG80957 to the API
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:58:14Z',
 'fuel_type': 'petrol',
 'id': 'b2c0471c-6ea5-522f-9b46-6d00adbd1091',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG80957',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Aveo',
 'odometer': 125460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-31',
 'seller_name': None,
 'title': 'Chevrolet Aveo 1.2 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2009}
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG80957%27 HTTP/1.1" 200 None
2026-03-30 07:36:55 [auto1.de] INFO: Saving data for GG80957: {'auction_closing_time': 1774972694.0, 'created_time': 1774381448.909485, 'last_price_update_time': 1774856215.680998}
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG80957') HTTP/1.1" 204 0
2026-03-30 07:36:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8cddc0dd-3bb8-59f8-8683-64ea6c32c0de with identifier: GM71398
2026-03-30 07:36:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8cddc0dd-3bb8-59f8-8683-64ea6c32c0de with identifier: GM71398
2026-03-30 07:36:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8cddc0dd-3bb8-59f8-8683-64ea6c32c0de with identifier: GM71398 to the API
2026-03-30 07:36:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-31T15:29:13Z',
 'fuel_type': 'petrol',
 'id': '8cddc0dd-3bb8-59f8-8683-64ea6c32c0de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GM71398',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S5',
 'odometer': 120549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-29',
 'seller_name': None,
 'title': 'Audi S5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM71398%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Saving data for GM71398: {'auction_closing_time': 1774970953.0, 'created_time': 1773773221.338422, 'last_price_update_time': 1774856216.151738}
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GM71398') HTTP/1.1" 204 0
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_1d333475323fe9afda2e4ea3868aebcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_1d333475323fe9afda2e4ea3868aebcc.jpg not downloaded yet
2026-03-30 07:36:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_0e54e2951c5155f8aedc3cb25626e387.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: UX22346
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: GB09367
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: EG89523
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: PE93085
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: WM94615
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM94615%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for WM94615: 0
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: KV84716
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV84716%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for KV84716: 0
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: BS29922
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: DB31408
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: YK86609
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: WG79560
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: PC84380
2026-03-30 07:36:56 [auto1.de] INFO: Found listing with ID: ML46855
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML46855%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [auto1.de] INFO: Scrape type for ML46855: 2
2026-03-30 07:36:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e23f4c-4264-5d58-bc91-821fbb620564 with identifier: ML46855
2026-03-30 07:36:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75e23f4c-4264-5d58-bc91-821fbb620564 with scrape type 2
2026-03-30 07:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75e23f4c-4264-5d58-bc91-821fbb620564 with scrape type 2
2026-03-30 07:36:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75e23f4c-4264-5d58-bc91-821fbb620564, identifier: ML46855
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_f7dfbe5fd2c04979a67d87873fcb62f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_f7dfbe5fd2c04979a67d87873fcb62f4.jpg not downloaded yet
2026-03-30 07:36:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d233a790>
2026-03-30 07:36:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_a1fd78f8e4398d69b59aa7eba6caeaad.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_a1fd78f8e4398d69b59aa7eba6caeaad.jpg saved to cache
2026-03-30 07:36:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f1f7557c-fb27-542e-8401-9e5715d99c01
2026-03-30 07:36:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75e23f4c-4264-5d58-bc91-821fbb620564 with identifier: ML46855
2026-03-30 07:36:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75e23f4c-4264-5d58-bc91-821fbb620564 with identifier: ML46855
2026-03-30 07:36:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75e23f4c-4264-5d58-bc91-821fbb620564 with identifier: ML46855 to the API
2026-03-30 07:36:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:03:26Z',
 'fuel_type': 'diesel',
 'id': '75e23f4c-4264-5d58-bc91-821fbb620564',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML46855',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Fiorino',
 'odometer': 72268,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-19',
 'seller_name': None,
 'title': 'Fiat Fiorino 1.3 JTD Basis Kasten',
 'transmission': 'manual',
 'trim': 'Basis Kasten',
 'year': 2012}
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML46855%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [auto1.de] INFO: Saving data for ML46855: {'auction_closing_time': 1774969406.0, 'created_time': 1773429201.106596, 'last_price_update_time': 1774856217.352883}
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML46855') HTTP/1.1" 204 0
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_02d58981ecf3e386a65fb28b7074736a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_02d58981ecf3e386a65fb28b7074736a.jpg not downloaded yet
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: YC00634
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: JD44610
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: WC68946
2026-03-30 07:36:57 [auto1.de] INFO: Found listing with ID: CM75281
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM75281%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [auto1.de] INFO: Scrape type for CM75281: 2
2026-03-30 07:36:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 275c1442-62b8-52b4-a639-67574d1d3293 with identifier: CM75281
2026-03-30 07:36:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 275c1442-62b8-52b4-a639-67574d1d3293 with scrape type 2
2026-03-30 07:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 275c1442-62b8-52b4-a639-67574d1d3293 with scrape type 2
2026-03-30 07:36:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 275c1442-62b8-52b4-a639-67574d1d3293, identifier: CM75281
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_fafd7624857e1aead0b48cdbaaf5b446.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_fafd7624857e1aead0b48cdbaaf5b446.jpg not downloaded yet
2026-03-30 07:36:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_76e0e5318530c8ef0b89c3789ce2ab0b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 275c1442-62b8-52b4-a639-67574d1d3293 with identifier: CM75281
2026-03-30 07:36:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 275c1442-62b8-52b4-a639-67574d1d3293 with identifier: CM75281
2026-03-30 07:36:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 275c1442-62b8-52b4-a639-67574d1d3293 with identifier: CM75281 to the API
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:01:35Z',
 'fuel_type': 'petrol',
 'id': '275c1442-62b8-52b4-a639-67574d1d3293',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM75281',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 184291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-08',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 White up!',
 'transmission': 'manual',
 'trim': 'White',
 'year': 2014}
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM75281%27 HTTP/1.1" 200 None
2026-03-30 07:36:58 [auto1.de] INFO: Saving data for CM75281: {'auction_closing_time': 1774969295.0, 'created_time': 1773659968.5799, 'last_price_update_time': 1774856218.014775}
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM75281') HTTP/1.1" 204 0
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_8943002cb411080e55bc64872d9037e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_8943002cb411080e55bc64872d9037e9.jpg not downloaded yet
2026-03-30 07:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d3d410>
2026-03-30 07:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_0e54e2951c5155f8aedc3cb25626e387.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_0e54e2951c5155f8aedc3cb25626e387.jpg saved to cache
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02f7ec57-0eae-5da7-90a0-01ed112c4811
2026-03-30 07:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_ad5c0c9a1ed8fd1f0c64a54f7ec56dfb.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:58 [auto1.de] INFO: Found listing with ID: UN10442
2026-03-30 07:36:58 [auto1.de] INFO: Found listing with ID: BS87926
2026-03-30 07:36:58 [auto1.de] INFO: Found listing with ID: RY52055
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY52055%27 HTTP/1.1" 200 None
2026-03-30 07:36:58 [auto1.de] INFO: Scrape type for RY52055: 1
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_5ef357913c3a8cd7a1ab8b077afc060d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_5ef357913c3a8cd7a1ab8b077afc060d.jpg not downloaded yet
2026-03-30 07:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_263dd2164c87646b109b40e1a54090d9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_1eba6c431ddefe2ef5df30d2733522c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_1eba6c431ddefe2ef5df30d2733522c3.jpg not downloaded yet
2026-03-30 07:36:58 [auto1.de] INFO: Found listing with ID: NE14712
2026-03-30 07:36:58 [auto1.de] INFO: Found listing with ID: CE86831
2026-03-30 07:36:58 [auto1.de] INFO: Found listing with ID: JC54567
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC54567%27 HTTP/1.1" 200 None
2026-03-30 07:36:58 [auto1.de] INFO: Scrape type for JC54567: 2
2026-03-30 07:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4db701e-f458-5783-8124-1fe8a84e72e1 with identifier: JC54567
2026-03-30 07:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4db701e-f458-5783-8124-1fe8a84e72e1 with scrape type 2
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4db701e-f458-5783-8124-1fe8a84e72e1 with scrape type 2
2026-03-30 07:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4db701e-f458-5783-8124-1fe8a84e72e1, identifier: JC54567
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_b6e9e5bc32a15886b1b30652385a6be6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_b6e9e5bc32a15886b1b30652385a6be6.jpg not downloaded yet
2026-03-30 07:36:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:36:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d178d0>
2026-03-30 07:36:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_76e0e5318530c8ef0b89c3789ce2ab0b.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_76e0e5318530c8ef0b89c3789ce2ab0b.jpg saved to cache
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02f7ec57-0eae-5da7-90a0-01ed112c4811
2026-03-30 07:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4db701e-f458-5783-8124-1fe8a84e72e1 with identifier: JC54567
2026-03-30 07:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4db701e-f458-5783-8124-1fe8a84e72e1 with identifier: JC54567
2026-03-30 07:36:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4db701e-f458-5783-8124-1fe8a84e72e1 with identifier: JC54567 to the API
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:35:10Z',
 'fuel_type': 'diesel',
 'id': 'a4db701e-f458-5783-8124-1fe8a84e72e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC54567',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 244904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-30',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2010}
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC54567%27 HTTP/1.1" 200 None
2026-03-30 07:36:58 [auto1.de] INFO: Saving data for JC54567: {'auction_closing_time': 1774971310.0, 'created_time': 1773138699.42857, 'last_price_update_time': 1774856218.733455}
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC54567') HTTP/1.1" 204 0
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_c4b041bcc8535b9722e1a8ee3073d892.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_c4b041bcc8535b9722e1a8ee3073d892.jpg not downloaded yet
2026-03-30 07:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_1d333475323fe9afda2e4ea3868aebcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:58 [auto1.de] INFO: Found listing with ID: AJ98197
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ98197%27 HTTP/1.1" 200 None
2026-03-30 07:36:58 [auto1.de] INFO: Scrape type for AJ98197: 2
2026-03-30 07:36:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e43ad932-e3c3-5a08-a12f-abd12f201740 with identifier: AJ98197
2026-03-30 07:36:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e43ad932-e3c3-5a08-a12f-abd12f201740 with scrape type 2
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e43ad932-e3c3-5a08-a12f-abd12f201740 with scrape type 2
2026-03-30 07:36:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e43ad932-e3c3-5a08-a12f-abd12f201740, identifier: AJ98197
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_25691bc2a09aff3f5d854ac8fc1503bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_25691bc2a09aff3f5d854ac8fc1503bf.jpg not downloaded yet
2026-03-30 07:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_f7dfbe5fd2c04979a67d87873fcb62f4.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_02d58981ecf3e386a65fb28b7074736a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:36:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e43ad932-e3c3-5a08-a12f-abd12f201740 with identifier: AJ98197
2026-03-30 07:36:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e43ad932-e3c3-5a08-a12f-abd12f201740 with identifier: AJ98197
2026-03-30 07:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e43ad932-e3c3-5a08-a12f-abd12f201740 with identifier: AJ98197 to the API
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:13:57Z',
 'fuel_type': 'petrol',
 'id': 'e43ad932-e3c3-5a08-a12f-abd12f201740',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ98197',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 153085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-17',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 170 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2008}
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ98197%27 HTTP/1.1" 200 None
2026-03-30 07:36:59 [auto1.de] INFO: Saving data for AJ98197: {'auction_closing_time': 1774970037.0, 'created_time': 1773686766.388048, 'last_price_update_time': 1774856219.249822}
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ98197') HTTP/1.1" 204 0
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_edf6fc85ee16691d327c865f7b0737ca.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_edf6fc85ee16691d327c865f7b0737ca.jpg not downloaded yet
2026-03-30 07:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24bbd10>
2026-03-30 07:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_ad5c0c9a1ed8fd1f0c64a54f7ec56dfb.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_ad5c0c9a1ed8fd1f0c64a54f7ec56dfb.jpg saved to cache
2026-03-30 07:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02f7ec57-0eae-5da7-90a0-01ed112c4811
2026-03-30 07:36:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:36:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f9d5d0>
2026-03-30 07:36:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:36:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_263dd2164c87646b109b40e1a54090d9.jpg') HTTP/1.1" 204 0
2026-03-30 07:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_263dd2164c87646b109b40e1a54090d9.jpg saved to cache
2026-03-30 07:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1ebdb05-7cf8-5f48-a281-9edf48c62783
2026-03-30 07:36:59 [auto1.de] INFO: Found listing with ID: HA89318
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89318%27 HTTP/1.1" 200 None
2026-03-30 07:36:59 [auto1.de] INFO: Scrape type for HA89318: 2
2026-03-30 07:36:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d866e26a-1e41-5fed-bfd9-26fc7640ec34 with identifier: HA89318
2026-03-30 07:36:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d866e26a-1e41-5fed-bfd9-26fc7640ec34 with scrape type 2
2026-03-30 07:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d866e26a-1e41-5fed-bfd9-26fc7640ec34 with scrape type 2
2026-03-30 07:36:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d866e26a-1e41-5fed-bfd9-26fc7640ec34, identifier: HA89318
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_1a97f9007335e209f3de6b53d71d152b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:36:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_1a97f9007335e209f3de6b53d71d152b.jpg not downloaded yet
2026-03-30 07:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE91366> (referer: https://www.auto1.com/v1/car-details-view/DE91366/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY88007/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:36:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d866e26a-1e41-5fed-bfd9-26fc7640ec34 with identifier: HA89318
2026-03-30 07:36:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d866e26a-1e41-5fed-bfd9-26fc7640ec34 with identifier: HA89318
2026-03-30 07:36:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d866e26a-1e41-5fed-bfd9-26fc7640ec34 with identifier: HA89318 to the API
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:36:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:33:54Z',
 'fuel_type': 'petrol',
 'id': 'd866e26a-1e41-5fed-bfd9-26fc7640ec34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA89318',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 129199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-10',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2008}
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA89318%27 HTTP/1.1" 200 None
2026-03-30 07:36:59 [auto1.de] INFO: Saving data for HA89318: {'auction_closing_time': 1774971234.0, 'created_time': 1773380966.621649, 'last_price_update_time': 1774856219.98229}
2026-03-30 07:36:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA89318') HTTP/1.1" 204 0
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_8a3a325d04c6e4e545227a95f521e2c3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_8a3a325d04c6e4e545227a95f521e2c3.jpg not downloaded yet
2026-03-30 07:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_5ef357913c3a8cd7a1ab8b077afc060d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: LC13671
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC13671%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for LC13671: 2
2026-03-30 07:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04532b8b-1780-546e-8fc6-ea8f2f36a75d with identifier: LC13671
2026-03-30 07:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04532b8b-1780-546e-8fc6-ea8f2f36a75d with scrape type 2
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04532b8b-1780-546e-8fc6-ea8f2f36a75d with scrape type 2
2026-03-30 07:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04532b8b-1780-546e-8fc6-ea8f2f36a75d, identifier: LC13671
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_2213d4cd5713a9e0617ded6c1d008656.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_2213d4cd5713a9e0617ded6c1d008656.jpg not downloaded yet
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2ed2e10>
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_1d333475323fe9afda2e4ea3868aebcc.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_1d333475323fe9afda2e4ea3868aebcc.jpg saved to cache
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02f7ec57-0eae-5da7-90a0-01ed112c4811
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24f48d0>
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_f7dfbe5fd2c04979a67d87873fcb62f4.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_f7dfbe5fd2c04979a67d87873fcb62f4.jpg saved to cache
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1ebdb05-7cf8-5f48-a281-9edf48c62783
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24dd150>
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_02d58981ecf3e386a65fb28b7074736a.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_02d58981ecf3e386a65fb28b7074736a.jpg saved to cache
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02f7ec57-0eae-5da7-90a0-01ed112c4811
2026-03-30 07:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_fafd7624857e1aead0b48cdbaaf5b446.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04532b8b-1780-546e-8fc6-ea8f2f36a75d with identifier: LC13671
2026-03-30 07:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04532b8b-1780-546e-8fc6-ea8f2f36a75d with identifier: LC13671
2026-03-30 07:37:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04532b8b-1780-546e-8fc6-ea8f2f36a75d with identifier: LC13671 to the API
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:40:31Z',
 'fuel_type': 'petrol',
 'id': '04532b8b-1780-546e-8fc6-ea8f2f36a75d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC13671',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 191022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-30',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2016}
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC13671%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Saving data for LC13671: {'auction_closing_time': 1774971631.0, 'created_time': 1773380437.385664, 'last_price_update_time': 1774856220.682758}
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LC13671') HTTP/1.1" 204 0
2026-03-30 07:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_8943002cb411080e55bc64872d9037e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: GG09705
2026-03-30 07:37:00 [auto1.de] INFO: Found listing with ID: NT37937
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT37937%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [auto1.de] INFO: Scrape type for NT37937: 2
2026-03-30 07:37:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bfee1c3-3e34-5ea6-8d3c-e3b9dd675780 with identifier: NT37937
2026-03-30 07:37:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bfee1c3-3e34-5ea6-8d3c-e3b9dd675780 with scrape type 2
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bfee1c3-3e34-5ea6-8d3c-e3b9dd675780 with scrape type 2
2026-03-30 07:37:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bfee1c3-3e34-5ea6-8d3c-e3b9dd675780, identifier: NT37937
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_453e5e35594e089ca2398e6946213c11.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_453e5e35594e089ca2398e6946213c11.jpg not downloaded yet
2026-03-30 07:37:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_1eba6c431ddefe2ef5df30d2733522c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bfee1c3-3e34-5ea6-8d3c-e3b9dd675780 with identifier: NT37937
2026-03-30 07:37:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bfee1c3-3e34-5ea6-8d3c-e3b9dd675780 with identifier: NT37937
2026-03-30 07:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bfee1c3-3e34-5ea6-8d3c-e3b9dd675780 with identifier: NT37937 to the API
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:02:07Z',
 'fuel_type': 'petrol',
 'id': '0bfee1c3-3e34-5ea6-8d3c-e3b9dd675780',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT37937',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 221541,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-29',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT37937%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Saving data for NT37937: {'auction_closing_time': 1774969327.0, 'created_time': 1774262556.434384, 'last_price_update_time': 1774856221.28972}
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT37937') HTTP/1.1" 204 0
2026-03-30 07:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28467aca-d749-5a9b-96a4-acaad10b4ca0 with identifier: DE91366
2026-03-30 07:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28467aca-d749-5a9b-96a4-acaad10b4ca0 with scrape type 1
2026-03-30 07:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 28467aca-d749-5a9b-96a4-acaad10b4ca0
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F02%252F12026ff9eb47214acc22bfff8c4bf2d8%252Fpa%252FDE91366_2c1a28597f008c4a474a0e0d40e27480.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_2c1a28597f008c4a474a0e0d40e27480.jpg not downloaded yet
2026-03-30 07:37:01 [auto1.de] INFO: Channel: 24h | Page: 12 | totalHits: 7673 | hits on page: 40
2026-03-30 07:37:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f84dd0>
2026-03-30 07:37:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_5ef357913c3a8cd7a1ab8b077afc060d.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_5ef357913c3a8cd7a1ab8b077afc060d.jpg saved to cache
2026-03-30 07:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1ebdb05-7cf8-5f48-a281-9edf48c62783
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: FJ28912
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: HK26466
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK26466%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Scrape type for HK26466: 2
2026-03-30 07:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c11e417-0860-55cf-93ee-f6f02dd3fb63 with identifier: HK26466
2026-03-30 07:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c11e417-0860-55cf-93ee-f6f02dd3fb63 with scrape type 2
2026-03-30 07:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c11e417-0860-55cf-93ee-f6f02dd3fb63 with scrape type 2
2026-03-30 07:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c11e417-0860-55cf-93ee-f6f02dd3fb63, identifier: HK26466
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_ab6c917d62df6d2a4f0d99f078cf8eb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_ab6c917d62df6d2a4f0d99f078cf8eb9.jpg not downloaded yet
2026-03-30 07:37:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_c4b041bcc8535b9722e1a8ee3073d892.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c11e417-0860-55cf-93ee-f6f02dd3fb63 with identifier: HK26466
2026-03-30 07:37:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c11e417-0860-55cf-93ee-f6f02dd3fb63 with identifier: HK26466
2026-03-30 07:37:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c11e417-0860-55cf-93ee-f6f02dd3fb63 with identifier: HK26466 to the API
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-31T15:37:55Z',
 'fuel_type': 'petrol',
 'id': '7c11e417-0860-55cf-93ee-f6f02dd3fb63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK26466',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 215684,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-26',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2007}
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK26466%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Saving data for HK26466: {'auction_closing_time': 1774971475.0, 'created_time': 1773224832.433844, 'last_price_update_time': 1774856221.845753}
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK26466') HTTP/1.1" 204 0
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F02%252F12026ff9eb47214acc22bfff8c4bf2d8%252Fpa%252FDE91366_5d35bf813519fb8b4e8054843d198d40.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_5d35bf813519fb8b4e8054843d198d40.jpg not downloaded yet
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: VN84329
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: DK08351
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08351%27 HTTP/1.1" 200 None
2026-03-30 07:37:01 [auto1.de] INFO: Scrape type for DK08351: 2
2026-03-30 07:37:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 922715e1-e36f-53c5-8977-0cf184105e11 with identifier: DK08351
2026-03-30 07:37:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 922715e1-e36f-53c5-8977-0cf184105e11 with scrape type 2
2026-03-30 07:37:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 922715e1-e36f-53c5-8977-0cf184105e11 with scrape type 2
2026-03-30 07:37:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 922715e1-e36f-53c5-8977-0cf184105e11, identifier: DK08351
2026-03-30 07:37:01 [auto1.de] INFO: Found listing with ID: EG62319
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG62319%27 HTTP/1.1" 200 None
2026-03-30 07:37:02 [auto1.de] INFO: Scrape type for EG62319: 2
2026-03-30 07:37:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb3e4794-4a1b-5e8a-ad28-8c304d80aea4 with identifier: EG62319
2026-03-30 07:37:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb3e4794-4a1b-5e8a-ad28-8c304d80aea4 with scrape type 2
2026-03-30 07:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb3e4794-4a1b-5e8a-ad28-8c304d80aea4 with scrape type 2
2026-03-30 07:37:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb3e4794-4a1b-5e8a-ad28-8c304d80aea4, identifier: EG62319
2026-03-30 07:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 922715e1-e36f-53c5-8977-0cf184105e11 with identifier: DK08351
2026-03-30 07:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 922715e1-e36f-53c5-8977-0cf184105e11 with identifier: DK08351
2026-03-30 07:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 922715e1-e36f-53c5-8977-0cf184105e11 with identifier: DK08351 to the API
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:47:36Z',
 'fuel_type': 'diesel',
 'id': '922715e1-e36f-53c5-8977-0cf184105e11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK08351',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 183991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-09',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Style BlueMotion',
 'transmission': 'automatic',
 'trim': 'Style BlueMotion',
 'year': 2012}
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08351%27 HTTP/1.1" 200 None
2026-03-30 07:37:02 [auto1.de] INFO: Saving data for DK08351: {'auction_closing_time': 1774972056.0, 'created_time': 1774464292.540328, 'last_price_update_time': 1774856222.423409}
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK08351') HTTP/1.1" 204 0
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d8e1fd90>
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_fafd7624857e1aead0b48cdbaaf5b446.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_fafd7624857e1aead0b48cdbaaf5b446.jpg saved to cache
2026-03-30 07:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1ebdb05-7cf8-5f48-a281-9edf48c62783
2026-03-30 07:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23e2b10>
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_8943002cb411080e55bc64872d9037e9.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_8943002cb411080e55bc64872d9037e9.jpg saved to cache
2026-03-30 07:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02f7ec57-0eae-5da7-90a0-01ed112c4811
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23e1550>
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_1eba6c431ddefe2ef5df30d2733522c3.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_1eba6c431ddefe2ef5df30d2733522c3.jpg saved to cache
2026-03-30 07:37:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02f7ec57-0eae-5da7-90a0-01ed112c4811
2026-03-30 07:37:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_25691bc2a09aff3f5d854ac8fc1503bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb3e4794-4a1b-5e8a-ad28-8c304d80aea4 with identifier: EG62319
2026-03-30 07:37:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb3e4794-4a1b-5e8a-ad28-8c304d80aea4 with identifier: EG62319
2026-03-30 07:37:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb3e4794-4a1b-5e8a-ad28-8c304d80aea4 with identifier: EG62319 to the API
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:09:25Z',
 'fuel_type': 'diesel',
 'id': 'fb3e4794-4a1b-5e8a-ad28-8c304d80aea4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG62319',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 78373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-23',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2019}
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG62319%27 HTTP/1.1" 200 None
2026-03-30 07:37:02 [auto1.de] INFO: Saving data for EG62319: {'auction_closing_time': 1774969765.0, 'created_time': 1773306268.272819, 'last_price_update_time': 1774856222.970999}
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG62319') HTTP/1.1" 204 0
2026-03-30 07:37:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F02%252F12026ff9eb47214acc22bfff8c4bf2d8%252Fpa%252FDE91366_08bb2429c8c309a65e3ce017e284ffa1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_08bb2429c8c309a65e3ce017e284ffa1.jpg not downloaded yet
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: LU02094
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU02094%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for LU02094: 2
2026-03-30 07:37:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3253078a-2ffd-58d8-9348-926cbe78b198 with identifier: LU02094
2026-03-30 07:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3253078a-2ffd-58d8-9348-926cbe78b198 with scrape type 2
2026-03-30 07:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3253078a-2ffd-58d8-9348-926cbe78b198 with scrape type 2
2026-03-30 07:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3253078a-2ffd-58d8-9348-926cbe78b198, identifier: LU02094
2026-03-30 07:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_b6e9e5bc32a15886b1b30652385a6be6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: CT63766
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: MH30608
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: YF33441
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: VN84329
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: DK08351
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08351%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for DK08351: 0
2026-03-30 07:37:03 [auto1.de] INFO: Found listing with ID: LU02094
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU02094%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Scrape type for LU02094: 2
2026-03-30 07:37:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3253078a-2ffd-58d8-9348-926cbe78b198 with scrape type 2
2026-03-30 07:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3253078a-2ffd-58d8-9348-926cbe78b198 with scrape type 2
2026-03-30 07:37:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3253078a-2ffd-58d8-9348-926cbe78b198, identifier: LU02094
2026-03-30 07:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3253078a-2ffd-58d8-9348-926cbe78b198 with identifier: LU02094
2026-03-30 07:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3253078a-2ffd-58d8-9348-926cbe78b198 with identifier: LU02094
2026-03-30 07:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3253078a-2ffd-58d8-9348-926cbe78b198 with identifier: LU02094 to the API
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:02:14Z',
 'fuel_type': 'diesel',
 'id': '3253078a-2ffd-58d8-9348-926cbe78b198',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU02094',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 210407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU02094%27 HTTP/1.1" 200 None
2026-03-30 07:37:03 [auto1.de] INFO: Saving data for LU02094: {'auction_closing_time': 1774969334.0, 'created_time': 1774463877.670777, 'last_price_update_time': 1774856223.632172}
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU02094') HTTP/1.1" 204 0
2026-03-30 07:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY52055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23d9e90>
2026-03-30 07:37:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_c4b041bcc8535b9722e1a8ee3073d892.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_c4b041bcc8535b9722e1a8ee3073d892.jpg saved to cache
2026-03-30 07:37:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02f7ec57-0eae-5da7-90a0-01ed112c4811
2026-03-30 07:37:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_1a97f9007335e209f3de6b53d71d152b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3253078a-2ffd-58d8-9348-926cbe78b198 with identifier: LU02094
2026-03-30 07:37:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3253078a-2ffd-58d8-9348-926cbe78b198 with identifier: LU02094
2026-03-30 07:37:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3253078a-2ffd-58d8-9348-926cbe78b198 with identifier: LU02094 to the API
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:02:14Z',
 'fuel_type': 'diesel',
 'id': '3253078a-2ffd-58d8-9348-926cbe78b198',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU02094',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6 Allroad',
 'odometer': 210407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-07',
 'seller_name': None,
 'title': 'Audi A6 Allroad 3.0 V6 TDI clean diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU02094%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Saving data for LU02094: {'auction_closing_time': 1774969334.0, 'created_time': 1774463877.670777, 'last_price_update_time': 1774856224.083993}
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU02094') HTTP/1.1" 204 0
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F02%252F12026ff9eb47214acc22bfff8c4bf2d8%252Fpa%252FDE91366_cba5eee3df430a5078b644430d83668f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_cba5eee3df430a5078b644430d83668f.jpg not downloaded yet
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: LX46621
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX46621%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for LX46621: 1
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: LX46621
2026-03-30 07:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_edf6fc85ee16691d327c865f7b0737ca.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F02%252F12026ff9eb47214acc22bfff8c4bf2d8%252Fpa%252FDE91366_d4084e7067a656d0ada27c5595441f22.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_d4084e7067a656d0ada27c5595441f22.jpg not downloaded yet
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: VJ16820
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: LC23112
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: SS89837
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: DE25074
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE25074%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for DE25074: 2
2026-03-30 07:37:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 864c61b9-3352-576c-9144-2d5386cc0687 with identifier: DE25074
2026-03-30 07:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 864c61b9-3352-576c-9144-2d5386cc0687 with scrape type 2
2026-03-30 07:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 864c61b9-3352-576c-9144-2d5386cc0687 with scrape type 2
2026-03-30 07:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 864c61b9-3352-576c-9144-2d5386cc0687, identifier: DE25074
2026-03-30 07:37:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d239bc50>
2026-03-30 07:37:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_25691bc2a09aff3f5d854ac8fc1503bf.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_25691bc2a09aff3f5d854ac8fc1503bf.jpg saved to cache
2026-03-30 07:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1ebdb05-7cf8-5f48-a281-9edf48c62783
2026-03-30 07:37:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23a2e50>
2026-03-30 07:37:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_b6e9e5bc32a15886b1b30652385a6be6.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_b6e9e5bc32a15886b1b30652385a6be6.jpg saved to cache
2026-03-30 07:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1ebdb05-7cf8-5f48-a281-9edf48c62783
2026-03-30 07:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_8a3a325d04c6e4e545227a95f521e2c3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: VJ16820
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: LC23112
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: SS89837
2026-03-30 07:37:04 [auto1.de] INFO: Found listing with ID: DE25074
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE25074%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Scrape type for DE25074: 2
2026-03-30 07:37:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 864c61b9-3352-576c-9144-2d5386cc0687 with scrape type 2
2026-03-30 07:37:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 864c61b9-3352-576c-9144-2d5386cc0687 with scrape type 2
2026-03-30 07:37:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 864c61b9-3352-576c-9144-2d5386cc0687, identifier: DE25074
2026-03-30 07:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 864c61b9-3352-576c-9144-2d5386cc0687 with identifier: DE25074
2026-03-30 07:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 864c61b9-3352-576c-9144-2d5386cc0687 with identifier: DE25074
2026-03-30 07:37:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 864c61b9-3352-576c-9144-2d5386cc0687 with identifier: DE25074 to the API
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-31T15:00:49Z',
 'fuel_type': 'diesel',
 'id': '864c61b9-3352-576c-9144-2d5386cc0687',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE25074',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 157243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 400 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE25074%27 HTTP/1.1" 200 None
2026-03-30 07:37:04 [auto1.de] INFO: Saving data for DE25074: {'auction_closing_time': 1774969249.0, 'created_time': 1773302389.77003, 'last_price_update_time': 1774856224.889818}
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE25074') HTTP/1.1" 204 0
2026-03-30 07:37:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_2213d4cd5713a9e0617ded6c1d008656.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 864c61b9-3352-576c-9144-2d5386cc0687 with identifier: DE25074
2026-03-30 07:37:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 864c61b9-3352-576c-9144-2d5386cc0687 with identifier: DE25074
2026-03-30 07:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 864c61b9-3352-576c-9144-2d5386cc0687 with identifier: DE25074 to the API
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 330,
 'expiration_date': '2026-03-31T15:00:49Z',
 'fuel_type': 'diesel',
 'id': '864c61b9-3352-576c-9144-2d5386cc0687',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE25074',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 157243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 400 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE25074%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Saving data for DE25074: {'auction_closing_time': 1774969249.0, 'created_time': 1773302389.77003, 'last_price_update_time': 1774856225.190515}
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE25074') HTTP/1.1" 204 0
2026-03-30 07:37:05 [auto1.de] INFO: Found listing with ID: FF52766
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF52766%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Scrape type for FF52766: 1
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d3e850>
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_1a97f9007335e209f3de6b53d71d152b.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_1a97f9007335e209f3de6b53d71d152b.jpg saved to cache
2026-03-30 07:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1ebdb05-7cf8-5f48-a281-9edf48c62783
2026-03-30 07:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_453e5e35594e089ca2398e6946213c11.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:05 [auto1.de] INFO: Found listing with ID: CT52786
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT52786%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Scrape type for CT52786: 2
2026-03-30 07:37:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52456ac2-16d6-5143-8f32-e2a78641dde2 with identifier: CT52786
2026-03-30 07:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52456ac2-16d6-5143-8f32-e2a78641dde2 with scrape type 2
2026-03-30 07:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52456ac2-16d6-5143-8f32-e2a78641dde2 with scrape type 2
2026-03-30 07:37:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52456ac2-16d6-5143-8f32-e2a78641dde2, identifier: CT52786
2026-03-30 07:37:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_6966829bc9581511d4d5da4ba7cb1db0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52456ac2-16d6-5143-8f32-e2a78641dde2 with identifier: CT52786
2026-03-30 07:37:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52456ac2-16d6-5143-8f32-e2a78641dde2 with identifier: CT52786
2026-03-30 07:37:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52456ac2-16d6-5143-8f32-e2a78641dde2 with identifier: CT52786 to the API
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:34:56Z',
 'fuel_type': 'diesel',
 'id': '52456ac2-16d6-5143-8f32-e2a78641dde2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT52786',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 347900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-12-15',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 111 CDI Kompakt',
 'transmission': 'manual',
 'trim': 'Kompakt',
 'year': 2005}
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT52786%27 HTTP/1.1" 200 None
2026-03-30 07:37:05 [auto1.de] INFO: Saving data for CT52786: {'auction_closing_time': 1774971296.0, 'created_time': 1773945774.359056, 'last_price_update_time': 1774856225.767295}
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT52786') HTTP/1.1" 204 0
2026-03-30 07:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d8e7c610>
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_edf6fc85ee16691d327c865f7b0737ca.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_edf6fc85ee16691d327c865f7b0737ca.jpg saved to cache
2026-03-30 07:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02f7ec57-0eae-5da7-90a0-01ed112c4811
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d8514110>
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg13%252F7f%252F137fb885ea7d7e3481d62b28e19b832c%252Fpa%252FLY71761_8a3a325d04c6e4e545227a95f521e2c3.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_8a3a325d04c6e4e545227a95f521e2c3.jpg saved to cache
2026-03-30 07:37:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02f7ec57-0eae-5da7-90a0-01ed112c4811
2026-03-30 07:37:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02f7ec57-0eae-5da7-90a0-01ed112c4811, skipping ID generation
2026-03-30 07:37:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02f7ec57-0eae-5da7-90a0-01ed112c4811 with scrape type 1
2026-03-30 07:37:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02f7ec57-0eae-5da7-90a0-01ed112c4811 sending to next pipeline
2026-03-30 07:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 02f7ec57-0eae-5da7-90a0-01ed112c4811, identifier: LY71761
2026-03-30 07:37:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2ed0ed0>
2026-03-30 07:37:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_2213d4cd5713a9e0617ded6c1d008656.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_2213d4cd5713a9e0617ded6c1d008656.jpg saved to cache
2026-03-30 07:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1ebdb05-7cf8-5f48-a281-9edf48c62783
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: VT05900
2026-03-30 07:37:06 [auto1.de] INFO: Found listing with ID: NR70794
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR70794%27 HTTP/1.1" 200 None
2026-03-30 07:37:06 [auto1.de] INFO: Scrape type for NR70794: 2
2026-03-30 07:37:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5081995-a756-52de-b68f-8b71e5b0f18a with identifier: NR70794
2026-03-30 07:37:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5081995-a756-52de-b68f-8b71e5b0f18a with scrape type 2
2026-03-30 07:37:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5081995-a756-52de-b68f-8b71e5b0f18a with scrape type 2
2026-03-30 07:37:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5081995-a756-52de-b68f-8b71e5b0f18a, identifier: NR70794
2026-03-30 07:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 02f7ec57-0eae-5da7-90a0-01ed112c4811 with identifier: LY71761
2026-03-30 07:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 02f7ec57-0eae-5da7-90a0-01ed112c4811 with identifier: LY71761
2026-03-30 07:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 02f7ec57-0eae-5da7-90a0-01ed112c4811 with identifier: LY71761 to the API
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_8a3a325d04c6e4e545227a95f521e2c3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 177,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:09:38Z',
 'fuel_type': 'petrol',
 'id': '02f7ec57-0eae-5da7-90a0-01ed112c4811',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LY71761',
 'listing': 'auction',
 'location': 'DE, Offenbach am Main',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 16447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_0e54e2951c5155f8aedc3cb25626e387.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84125,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_76e0e5318530c8ef0b89c3789ce2ab0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79545,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_ad5c0c9a1ed8fd1f0c64a54f7ec56dfb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_1d333475323fe9afda2e4ea3868aebcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_02d58981ecf3e386a65fb28b7074736a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_8943002cb411080e55bc64872d9037e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_1eba6c431ddefe2ef5df30d2733522c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81950,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_c4b041bcc8535b9722e1a8ee3073d892.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_edf6fc85ee16691d327c865f7b0737ca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02f7ec57-0eae-5da7-90a0-01ed112c4811/02f7ec57-0eae-5da7-90a0-01ed112c4811_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img13/7f/137fb885ea7d7e3481d62b28e19b832c/pa/LY71761_8a3a325d04c6e4e545227a95f521e2c3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 250 4Matic Progressive',
 'transmission': 'automatic',
 'trim': '4Matic Progressive',
 'year': 2023}
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LY71761%27 HTTP/1.1" 200 None
2026-03-30 07:37:06 [auto1.de] INFO: Saving data for LY71761: {'created_time': 1774856226.663356, 'last_price_update_time': 1774856226.66337, 'auction_closing_time': 1774969778.0}
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LY71761') HTTP/1.1" 204 0
2026-03-30 07:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_5d35bf813519fb8b4e8054843d198d40.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_2c1a28597f008c4a474a0e0d40e27480.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_ab6c917d62df6d2a4f0d99f078cf8eb9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:06 [scrapy.extensions.logstats] INFO: Crawled 39 pages (at 25 pages/min), scraped 178 items (at 98 items/min)
2026-03-30 07:37:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 184MiB
2026-03-30 07:37:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5081995-a756-52de-b68f-8b71e5b0f18a with identifier: NR70794
2026-03-30 07:37:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5081995-a756-52de-b68f-8b71e5b0f18a with identifier: NR70794
2026-03-30 07:37:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5081995-a756-52de-b68f-8b71e5b0f18a with identifier: NR70794 to the API
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:51:45Z',
 'fuel_type': 'diesel',
 'id': 'f5081995-a756-52de-b68f-8b71e5b0f18a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR70794',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 77132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-10',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR70794%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Saving data for NR70794: {'auction_closing_time': 1774972305.0, 'created_time': 1773305978.752047, 'last_price_update_time': 1774856227.056636}
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR70794') HTTP/1.1" 204 0
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e09bd0>
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_453e5e35594e089ca2398e6946213c11.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_453e5e35594e089ca2398e6946213c11.jpg saved to cache
2026-03-30 07:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1ebdb05-7cf8-5f48-a281-9edf48c62783
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: MS10711
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: YK91002
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK91002%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for YK91002: 2
2026-03-30 07:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31350ec2-63de-588e-b8fd-34edf89e9eac with identifier: YK91002
2026-03-30 07:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31350ec2-63de-588e-b8fd-34edf89e9eac with scrape type 2
2026-03-30 07:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31350ec2-63de-588e-b8fd-34edf89e9eac with scrape type 2
2026-03-30 07:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 31350ec2-63de-588e-b8fd-34edf89e9eac, identifier: YK91002
2026-03-30 07:37:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23f5050>
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_6966829bc9581511d4d5da4ba7cb1db0.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_6966829bc9581511d4d5da4ba7cb1db0.jpg saved to cache
2026-03-30 07:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f1f7557c-fb27-542e-8401-9e5715d99c01
2026-03-30 07:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_03423f49705c9637bcf292b16e5f9d27.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_08bb2429c8c309a65e3ce017e284ffa1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 31350ec2-63de-588e-b8fd-34edf89e9eac with identifier: YK91002
2026-03-30 07:37:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 31350ec2-63de-588e-b8fd-34edf89e9eac with identifier: YK91002
2026-03-30 07:37:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 31350ec2-63de-588e-b8fd-34edf89e9eac with identifier: YK91002 to the API
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:11:31Z',
 'fuel_type': 'diesel',
 'id': '31350ec2-63de-588e-b8fd-34edf89e9eac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK91002',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 223902,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-09',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2019}
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK91002%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Saving data for YK91002: {'auction_closing_time': 1774969891.0, 'created_time': 1773305752.340799, 'last_price_update_time': 1774856227.789472}
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK91002') HTTP/1.1" 204 0
2026-03-30 07:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY88007> (referer: https://www.auto1.com/v1/car-details-view/AY88007/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_cba5eee3df430a5078b644430d83668f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: ZF79650
2026-03-30 07:37:07 [auto1.de] INFO: Found listing with ID: TR42945
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR42945%27 HTTP/1.1" 200 None
2026-03-30 07:37:07 [auto1.de] INFO: Scrape type for TR42945: 2
2026-03-30 07:37:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c121b97-f65c-5821-a0d9-b1dc7f445e7f with identifier: TR42945
2026-03-30 07:37:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c121b97-f65c-5821-a0d9-b1dc7f445e7f with scrape type 2
2026-03-30 07:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c121b97-f65c-5821-a0d9-b1dc7f445e7f with scrape type 2
2026-03-30 07:37:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c121b97-f65c-5821-a0d9-b1dc7f445e7f, identifier: TR42945
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f8cad0>
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28467aca-d749-5a9b-96a4-acaad10b4ca0/28467aca-d749-5a9b-96a4-acaad10b4ca0_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F02%252F12026ff9eb47214acc22bfff8c4bf2d8%252Fpa%252FDE91366_5d35bf813519fb8b4e8054843d198d40.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_5d35bf813519fb8b4e8054843d198d40.jpg saved to cache
2026-03-30 07:37:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28467aca-d749-5a9b-96a4-acaad10b4ca0
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f997d0>
2026-03-30 07:37:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28467aca-d749-5a9b-96a4-acaad10b4ca0/28467aca-d749-5a9b-96a4-acaad10b4ca0_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F02%252F12026ff9eb47214acc22bfff8c4bf2d8%252Fpa%252FDE91366_2c1a28597f008c4a474a0e0d40e27480.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_2c1a28597f008c4a474a0e0d40e27480.jpg saved to cache
2026-03-30 07:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28467aca-d749-5a9b-96a4-acaad10b4ca0
2026-03-30 07:37:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d86d50>
2026-03-30 07:37:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg17%252F39%252F17393f5e2eb478badff0d00082cb5ce0%252Fpa%252FYA34461_ab6c917d62df6d2a4f0d99f078cf8eb9.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_ab6c917d62df6d2a4f0d99f078cf8eb9.jpg saved to cache
2026-03-30 07:37:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1ebdb05-7cf8-5f48-a281-9edf48c62783
2026-03-30 07:37:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1ebdb05-7cf8-5f48-a281-9edf48c62783, skipping ID generation
2026-03-30 07:37:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ebdb05-7cf8-5f48-a281-9edf48c62783 with scrape type 1
2026-03-30 07:37:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1ebdb05-7cf8-5f48-a281-9edf48c62783 sending to next pipeline
2026-03-30 07:37:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1ebdb05-7cf8-5f48-a281-9edf48c62783, identifier: YA34461
2026-03-30 07:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_ee09e1d158ccde165ae4331aad2f2c0d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_d4084e7067a656d0ada27c5595441f22.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c121b97-f65c-5821-a0d9-b1dc7f445e7f with identifier: TR42945
2026-03-30 07:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c121b97-f65c-5821-a0d9-b1dc7f445e7f with identifier: TR42945
2026-03-30 07:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c121b97-f65c-5821-a0d9-b1dc7f445e7f with identifier: TR42945 to the API
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-31T15:24:40Z',
 'fuel_type': 'diesel',
 'id': '1c121b97-f65c-5821-a0d9-b1dc7f445e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR42945',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 86932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-29',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR42945%27 HTTP/1.1" 200 None
2026-03-30 07:37:08 [auto1.de] INFO: Saving data for TR42945: {'auction_closing_time': 1774970680.0, 'created_time': 1772726126.553329, 'last_price_update_time': 1774856228.543193}
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TR42945') HTTP/1.1" 204 0
2026-03-30 07:37:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1ebdb05-7cf8-5f48-a281-9edf48c62783 with identifier: YA34461
2026-03-30 07:37:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1ebdb05-7cf8-5f48-a281-9edf48c62783 with identifier: YA34461
2026-03-30 07:37:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1ebdb05-7cf8-5f48-a281-9edf48c62783 with identifier: YA34461 to the API
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_ab6c917d62df6d2a4f0d99f078cf8eb9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 194,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 178,
 'expiration_date': '2026-03-31T15:18:49Z',
 'fuel_type': 'diesel',
 'id': 'a1ebdb05-7cf8-5f48-a281-9edf48c62783',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA34461',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Ssangyong',
 'model': 'Rexton',
 'odometer': 166507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_263dd2164c87646b109b40e1a54090d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57204,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_f7dfbe5fd2c04979a67d87873fcb62f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_fafd7624857e1aead0b48cdbaaf5b446.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50302,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_5ef357913c3a8cd7a1ab8b077afc060d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67195,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_b6e9e5bc32a15886b1b30652385a6be6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_25691bc2a09aff3f5d854ac8fc1503bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_1a97f9007335e209f3de6b53d71d152b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_2213d4cd5713a9e0617ded6c1d008656.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_453e5e35594e089ca2398e6946213c11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1ebdb05-7cf8-5f48-a281-9edf48c62783/a1ebdb05-7cf8-5f48-a281-9edf48c62783_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img17/39/17393f5e2eb478badff0d00082cb5ce0/pa/YA34461_ab6c917d62df6d2a4f0d99f078cf8eb9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-14',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Ssangyong Rexton 2.2 TD Quartz 4x4',
 'transmission': 'automatic',
 'trim': 'Quartz 4x4',
 'year': 2016}
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA34461%27 HTTP/1.1" 200 None
2026-03-30 07:37:08 [auto1.de] INFO: Saving data for YA34461: {'created_time': 1774856228.986194, 'last_price_update_time': 1774856228.986207, 'auction_closing_time': 1774970329.0}
2026-03-30 07:37:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YA34461') HTTP/1.1" 204 0
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: DA75370
2026-03-30 07:37:09 [auto1.de] INFO: Found listing with ID: TN32839
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32839%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Scrape type for TN32839: 2
2026-03-30 07:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b83a33c4-c558-5285-b85f-aa5a75d1bb6d with identifier: TN32839
2026-03-30 07:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b83a33c4-c558-5285-b85f-aa5a75d1bb6d with scrape type 2
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b83a33c4-c558-5285-b85f-aa5a75d1bb6d with scrape type 2
2026-03-30 07:37:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b83a33c4-c558-5285-b85f-aa5a75d1bb6d, identifier: TN32839
2026-03-30 07:37:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b83a33c4-c558-5285-b85f-aa5a75d1bb6d with identifier: TN32839
2026-03-30 07:37:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b83a33c4-c558-5285-b85f-aa5a75d1bb6d with identifier: TN32839
2026-03-30 07:37:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b83a33c4-c558-5285-b85f-aa5a75d1bb6d with identifier: TN32839 to the API
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:06:11Z',
 'fuel_type': 'petrol',
 'id': 'b83a33c4-c558-5285-b85f-aa5a75d1bb6d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN32839',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Baleno',
 'odometer': 73632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-04',
 'seller_name': None,
 'title': 'Suzuki Baleno 1.2 DualJet Basic',
 'transmission': 'manual',
 'trim': 'Basic',
 'year': 2017}
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN32839%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [auto1.de] INFO: Saving data for TN32839: {'auction_closing_time': 1774969571.0, 'created_time': 1773308228.902667, 'last_price_update_time': 1774856229.489846}
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN32839') HTTP/1.1" 204 0
2026-03-30 07:37:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2483750>
2026-03-30 07:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_03423f49705c9637bcf292b16e5f9d27.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_03423f49705c9637bcf292b16e5f9d27.jpg saved to cache
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f1f7557c-fb27-542e-8401-9e5715d99c01
2026-03-30 07:37:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24d1790>
2026-03-30 07:37:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28467aca-d749-5a9b-96a4-acaad10b4ca0/28467aca-d749-5a9b-96a4-acaad10b4ca0_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F02%252F12026ff9eb47214acc22bfff8c4bf2d8%252Fpa%252FDE91366_08bb2429c8c309a65e3ce017e284ffa1.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_08bb2429c8c309a65e3ce017e284ffa1.jpg saved to cache
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28467aca-d749-5a9b-96a4-acaad10b4ca0
2026-03-30 07:37:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e1fef81-e25d-5c8e-8b49-34c232121057 with identifier: AY88007
2026-03-30 07:37:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e1fef81-e25d-5c8e-8b49-34c232121057 with scrape type 1
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e1fef81-e25d-5c8e-8b49-34c232121057
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F90%252F3c90ff483a01cd536f94f2babf98d790%252Fpa%252FAY88007_976a239327c304f14671d31e75b81265.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_976a239327c304f14671d31e75b81265.jpg already downloaded
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F90%252F3c90ff483a01cd536f94f2babf98d790%252Fpa%252FAY88007_8f5841847dbbd82343ace9b1f1061281.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_8f5841847dbbd82343ace9b1f1061281.jpg already downloaded
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F90%252F3c90ff483a01cd536f94f2babf98d790%252Fpa%252FAY88007_ca0c5e9d5362bf898fb1c7cd393c9611.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_ca0c5e9d5362bf898fb1c7cd393c9611.jpg already downloaded
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F90%252F3c90ff483a01cd536f94f2babf98d790%252Fpa%252FAY88007_be2fe74370dd8b5ac146ebd84abe3ba7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_be2fe74370dd8b5ac146ebd84abe3ba7.jpg already downloaded
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F90%252F3c90ff483a01cd536f94f2babf98d790%252Fpa%252FAY88007_e86c6a9171e9da78717c50e41b3af152.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_e86c6a9171e9da78717c50e41b3af152.jpg already downloaded
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F90%252F3c90ff483a01cd536f94f2babf98d790%252Fpa%252FAY88007_2ac02f8610dd1aae75d190e1dcdd1cb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_2ac02f8610dd1aae75d190e1dcdd1cb8.jpg already downloaded
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F90%252F3c90ff483a01cd536f94f2babf98d790%252Fpa%252FAY88007_97dd6e643a13dccc3f7728722add5c35.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_97dd6e643a13dccc3f7728722add5c35.jpg already downloaded
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F90%252F3c90ff483a01cd536f94f2babf98d790%252Fpa%252FAY88007_b010099d33e7b1b5467d6ab995d6bf00.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_b010099d33e7b1b5467d6ab995d6bf00.jpg already downloaded
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F90%252F3c90ff483a01cd536f94f2babf98d790%252Fpa%252FAY88007_bdc8165fa5fa10da12f99f48b76abe79.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_bdc8165fa5fa10da12f99f48b76abe79.jpg already downloaded
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3c%252F90%252F3c90ff483a01cd536f94f2babf98d790%252Fpa%252FAY88007_8160859439a0395d2f4597dca577e7d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_8160859439a0395d2f4597dca577e7d7.jpg already downloaded
2026-03-30 07:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3e1fef81-e25d-5c8e-8b49-34c232121057, identifier: AY88007
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2fbabd0>
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28467aca-d749-5a9b-96a4-acaad10b4ca0/28467aca-d749-5a9b-96a4-acaad10b4ca0_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F02%252F12026ff9eb47214acc22bfff8c4bf2d8%252Fpa%252FDE91366_cba5eee3df430a5078b644430d83668f.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_cba5eee3df430a5078b644430d83668f.jpg saved to cache
2026-03-30 07:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28467aca-d749-5a9b-96a4-acaad10b4ca0
2026-03-30 07:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_734e3e5518ffc3f8219d3ebf76372c27.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: SY11471
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: CF57490
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF57490%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for CF57490: 1
2026-03-30 07:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3e1fef81-e25d-5c8e-8b49-34c232121057 with identifier: AY88007
2026-03-30 07:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3e1fef81-e25d-5c8e-8b49-34c232121057 with identifier: AY88007
2026-03-30 07:37:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3e1fef81-e25d-5c8e-8b49-34c232121057 with identifier: AY88007 to the API
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AY88007>
{'auction_title': '',
 'c_o_2_emission_value': 50,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 326,
 'expiration_date': '2026-03-31T15:18:26Z',
 'fuel_type': 'hybrid',
 'id': '3e1fef81-e25d-5c8e-8b49-34c232121057',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY88007',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'BMW',
 'model': '7er',
 'odometer': 70372,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_976a239327c304f14671d31e75b81265.jpg',
                'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_8f5841847dbbd82343ace9b1f1061281.jpg',
                'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_ca0c5e9d5362bf898fb1c7cd393c9611.jpg',
                'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_be2fe74370dd8b5ac146ebd84abe3ba7.jpg',
                'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_e86c6a9171e9da78717c50e41b3af152.jpg',
                'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_2ac02f8610dd1aae75d190e1dcdd1cb8.jpg',
                'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_97dd6e643a13dccc3f7728722add5c35.jpg',
                'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_b010099d33e7b1b5467d6ab995d6bf00.jpg',
                'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_bdc8165fa5fa10da12f99f48b76abe79.jpg',
                'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_8160859439a0395d2f4597dca577e7d7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1fef81-e25d-5c8e-8b49-34c232121057/3e1fef81-e25d-5c8e-8b49-34c232121057_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_976a239327c304f14671d31e75b81265.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1fef81-e25d-5c8e-8b49-34c232121057/3e1fef81-e25d-5c8e-8b49-34c232121057_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71550,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_8f5841847dbbd82343ace9b1f1061281.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1fef81-e25d-5c8e-8b49-34c232121057/3e1fef81-e25d-5c8e-8b49-34c232121057_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_ca0c5e9d5362bf898fb1c7cd393c9611.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1fef81-e25d-5c8e-8b49-34c232121057/3e1fef81-e25d-5c8e-8b49-34c232121057_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_be2fe74370dd8b5ac146ebd84abe3ba7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1fef81-e25d-5c8e-8b49-34c232121057/3e1fef81-e25d-5c8e-8b49-34c232121057_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54594,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_e86c6a9171e9da78717c50e41b3af152.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1fef81-e25d-5c8e-8b49-34c232121057/3e1fef81-e25d-5c8e-8b49-34c232121057_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_2ac02f8610dd1aae75d190e1dcdd1cb8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1fef81-e25d-5c8e-8b49-34c232121057/3e1fef81-e25d-5c8e-8b49-34c232121057_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55349,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_97dd6e643a13dccc3f7728722add5c35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1fef81-e25d-5c8e-8b49-34c232121057/3e1fef81-e25d-5c8e-8b49-34c232121057_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_b010099d33e7b1b5467d6ab995d6bf00.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1fef81-e25d-5c8e-8b49-34c232121057/3e1fef81-e25d-5c8e-8b49-34c232121057_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66778,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_bdc8165fa5fa10da12f99f48b76abe79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e1fef81-e25d-5c8e-8b49-34c232121057/3e1fef81-e25d-5c8e-8b49-34c232121057_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58983,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3c/90/3c90ff483a01cd536f94f2babf98d790/pa/AY88007_8160859439a0395d2f4597dca577e7d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 7er 740e IPerformance',
 'transmission': 'automatic',
 'trim': 'IPerformance',
 'year': 2018}
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY88007%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Saving data for AY88007: {'created_time': 1774856230.563498, 'last_price_update_time': 1774856230.56351, 'auction_closing_time': 1774970306.0}
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY88007') HTTP/1.1" 204 0
2026-03-30 07:37:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24d1310>
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_ee09e1d158ccde165ae4331aad2f2c0d.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_ee09e1d158ccde165ae4331aad2f2c0d.jpg saved to cache
2026-03-30 07:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f1f7557c-fb27-542e-8401-9e5715d99c01
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d237ad90>
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28467aca-d749-5a9b-96a4-acaad10b4ca0/28467aca-d749-5a9b-96a4-acaad10b4ca0_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg12%252F02%252F12026ff9eb47214acc22bfff8c4bf2d8%252Fpa%252FDE91366_d4084e7067a656d0ada27c5595441f22.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_d4084e7067a656d0ada27c5595441f22.jpg saved to cache
2026-03-30 07:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28467aca-d749-5a9b-96a4-acaad10b4ca0
2026-03-30 07:37:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28467aca-d749-5a9b-96a4-acaad10b4ca0, skipping ID generation
2026-03-30 07:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28467aca-d749-5a9b-96a4-acaad10b4ca0 with scrape type 1
2026-03-30 07:37:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28467aca-d749-5a9b-96a4-acaad10b4ca0 sending to next pipeline
2026-03-30 07:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28467aca-d749-5a9b-96a4-acaad10b4ca0, identifier: DE91366
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: XA59462
2026-03-30 07:37:10 [auto1.de] INFO: Found listing with ID: XE05025
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05025%27 HTTP/1.1" 200 None
2026-03-30 07:37:10 [auto1.de] INFO: Scrape type for XE05025: 2
2026-03-30 07:37:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93ce8630-d738-5e19-9282-69601713ed7f with identifier: XE05025
2026-03-30 07:37:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93ce8630-d738-5e19-9282-69601713ed7f with scrape type 2
2026-03-30 07:37:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93ce8630-d738-5e19-9282-69601713ed7f with scrape type 2
2026-03-30 07:37:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93ce8630-d738-5e19-9282-69601713ed7f, identifier: XE05025
2026-03-30 07:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF52766/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY52055> (referer: https://www.auto1.com/v1/car-details-view/RY52055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28467aca-d749-5a9b-96a4-acaad10b4ca0 with identifier: DE91366
2026-03-30 07:37:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28467aca-d749-5a9b-96a4-acaad10b4ca0 with identifier: DE91366
2026-03-30 07:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28467aca-d749-5a9b-96a4-acaad10b4ca0 with identifier: DE91366 to the API
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_d4084e7067a656d0ada27c5595441f22.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': 'Rental',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 2',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:36:14Z',
 'fuel_type': 'petrol',
 'id': '28467aca-d749-5a9b-96a4-acaad10b4ca0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE91366',
 'listing': 'auction',
 'location': 'DE, Nürnberg',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 57218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28467aca-d749-5a9b-96a4-acaad10b4ca0/28467aca-d749-5a9b-96a4-acaad10b4ca0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93189,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_2c1a28597f008c4a474a0e0d40e27480.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28467aca-d749-5a9b-96a4-acaad10b4ca0/28467aca-d749-5a9b-96a4-acaad10b4ca0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_5d35bf813519fb8b4e8054843d198d40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28467aca-d749-5a9b-96a4-acaad10b4ca0/28467aca-d749-5a9b-96a4-acaad10b4ca0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70822,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_08bb2429c8c309a65e3ce017e284ffa1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28467aca-d749-5a9b-96a4-acaad10b4ca0/28467aca-d749-5a9b-96a4-acaad10b4ca0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64061,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_cba5eee3df430a5078b644430d83668f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28467aca-d749-5a9b-96a4-acaad10b4ca0/28467aca-d749-5a9b-96a4-acaad10b4ca0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96527,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img12/02/12026ff9eb47214acc22bfff8c4bf2d8/pa/DE91366_d4084e7067a656d0ada27c5595441f22.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1996-10-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.6 Season',
 'transmission': 'automatic',
 'trim': 'Season',
 'year': 1996}
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE91366%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Saving data for DE91366: {'created_time': 1774856231.356105, 'last_price_update_time': 1774856231.356117, 'auction_closing_time': 1774971374.0}
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE91366') HTTP/1.1" 204 0
2026-03-30 07:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_df9fa7422ff12966fbb70b9124346bc9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93ce8630-d738-5e19-9282-69601713ed7f with identifier: XE05025
2026-03-30 07:37:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93ce8630-d738-5e19-9282-69601713ed7f with identifier: XE05025
2026-03-30 07:37:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93ce8630-d738-5e19-9282-69601713ed7f with identifier: XE05025 to the API
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:06:41Z',
 'fuel_type': 'hybrid',
 'id': '93ce8630-d738-5e19-9282-69601713ed7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE05025',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 79413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-22',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2017}
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE05025%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Saving data for XE05025: {'auction_closing_time': 1774969601.0, 'created_time': 1774435750.449472, 'last_price_update_time': 1774856231.810481}
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE05025') HTTP/1.1" 204 0
2026-03-30 07:37:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX46621/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:11 [auto1.de] INFO: Found listing with ID: RH52660
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH52660%27 HTTP/1.1" 200 None
2026-03-30 07:37:11 [auto1.de] INFO: Scrape type for RH52660: 2
2026-03-30 07:37:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0040a59-d6fb-5494-a453-40015b96ca84 with identifier: RH52660
2026-03-30 07:37:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0040a59-d6fb-5494-a453-40015b96ca84 with scrape type 2
2026-03-30 07:37:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0040a59-d6fb-5494-a453-40015b96ca84 with scrape type 2
2026-03-30 07:37:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0040a59-d6fb-5494-a453-40015b96ca84, identifier: RH52660
2026-03-30 07:37:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:37:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d9118290>
2026-03-30 07:37:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_734e3e5518ffc3f8219d3ebf76372c27.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_734e3e5518ffc3f8219d3ebf76372c27.jpg saved to cache
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f1f7557c-fb27-542e-8401-9e5715d99c01
2026-03-30 07:37:12 [auto1.de] INFO: Channel: 24h | Page: 13 | totalHits: 7690 | hits on page: 40
2026-03-30 07:37:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0040a59-d6fb-5494-a453-40015b96ca84 with identifier: RH52660
2026-03-30 07:37:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0040a59-d6fb-5494-a453-40015b96ca84 with identifier: RH52660
2026-03-30 07:37:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0040a59-d6fb-5494-a453-40015b96ca84 with identifier: RH52660 to the API
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:33:45Z',
 'fuel_type': 'petrol',
 'id': 'e0040a59-d6fb-5494-a453-40015b96ca84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH52660',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 62362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-15',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH52660%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [auto1.de] INFO: Saving data for RH52660: {'auction_closing_time': 1774971225.0, 'created_time': 1773301799.003112, 'last_price_update_time': 1774856232.430375}
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH52660') HTTP/1.1" 204 0
2026-03-30 07:37:12 [auto1.de] INFO: Found listing with ID: SV97177
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV97177%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [auto1.de] INFO: Scrape type for SV97177: 2
2026-03-30 07:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbef2da7-1a23-55a2-956c-0ba75e0b0c9b with identifier: SV97177
2026-03-30 07:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbef2da7-1a23-55a2-956c-0ba75e0b0c9b with scrape type 2
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbef2da7-1a23-55a2-956c-0ba75e0b0c9b with scrape type 2
2026-03-30 07:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbef2da7-1a23-55a2-956c-0ba75e0b0c9b, identifier: SV97177
2026-03-30 07:37:12 [auto1.de] INFO: Found listing with ID: SV97177
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV97177%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [auto1.de] INFO: Scrape type for SV97177: 2
2026-03-30 07:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbef2da7-1a23-55a2-956c-0ba75e0b0c9b with scrape type 2
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbef2da7-1a23-55a2-956c-0ba75e0b0c9b with scrape type 2
2026-03-30 07:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbef2da7-1a23-55a2-956c-0ba75e0b0c9b, identifier: SV97177
2026-03-30 07:37:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc91c279-e522-57c5-ace7-5eb59707c2d0 with identifier: RY52055
2026-03-30 07:37:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc91c279-e522-57c5-ace7-5eb59707c2d0 with scrape type 1
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc91c279-e522-57c5-ace7-5eb59707c2d0
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fbf%252F0fbf573919b627c30b5053c5b29bbcb3%252Fpa%252FRY52055_e714ce1095db8b8e2262bd5479aae035.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_e714ce1095db8b8e2262bd5479aae035.jpg already downloaded
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fbf%252F0fbf573919b627c30b5053c5b29bbcb3%252Fpa%252FRY52055_4f91ed15f246f26992d41c10664519cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_4f91ed15f246f26992d41c10664519cb.jpg already downloaded
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fbf%252F0fbf573919b627c30b5053c5b29bbcb3%252Fpa%252FRY52055_a27785b245518f64b92b0557ee056bfd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_a27785b245518f64b92b0557ee056bfd.jpg already downloaded
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fbf%252F0fbf573919b627c30b5053c5b29bbcb3%252Fpa%252FRY52055_708c9b9ee2fbdba9c564e7c47986fe3e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_708c9b9ee2fbdba9c564e7c47986fe3e.jpg already downloaded
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fbf%252F0fbf573919b627c30b5053c5b29bbcb3%252Fpa%252FRY52055_ec3c1be7d779b3eac1443d56bbef830a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_ec3c1be7d779b3eac1443d56bbef830a.jpg already downloaded
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fbf%252F0fbf573919b627c30b5053c5b29bbcb3%252Fpa%252FRY52055_ead290dd95345918ebf8c34464e1568b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_ead290dd95345918ebf8c34464e1568b.jpg already downloaded
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fbf%252F0fbf573919b627c30b5053c5b29bbcb3%252Fpa%252FRY52055_93c8db49496e78b605d2ee173bffd783.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_93c8db49496e78b605d2ee173bffd783.jpg already downloaded
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fbf%252F0fbf573919b627c30b5053c5b29bbcb3%252Fpa%252FRY52055_dcab916acdbe06f8ef50191a6f4eb4df.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_dcab916acdbe06f8ef50191a6f4eb4df.jpg already downloaded
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fbf%252F0fbf573919b627c30b5053c5b29bbcb3%252Fpa%252FRY52055_403662043db9d4e90325a661c9138bf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_403662043db9d4e90325a661c9138bf3.jpg already downloaded
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fbf%252F0fbf573919b627c30b5053c5b29bbcb3%252Fpa%252FRY52055_05b820e522ab42300257e4cf58b48939.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_05b820e522ab42300257e4cf58b48939.jpg already downloaded
2026-03-30 07:37:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc91c279-e522-57c5-ace7-5eb59707c2d0, identifier: RY52055
2026-03-30 07:37:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:37:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23d0090>
2026-03-30 07:37:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga0%252F4d%252Fa04dede17fc0658ddb5f8ad815206711%252Fpa%252FFB79973_df9fa7422ff12966fbb70b9124346bc9.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_df9fa7422ff12966fbb70b9124346bc9.jpg saved to cache
2026-03-30 07:37:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f1f7557c-fb27-542e-8401-9e5715d99c01
2026-03-30 07:37:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f1f7557c-fb27-542e-8401-9e5715d99c01, skipping ID generation
2026-03-30 07:37:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1f7557c-fb27-542e-8401-9e5715d99c01 with scrape type 1
2026-03-30 07:37:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f1f7557c-fb27-542e-8401-9e5715d99c01 sending to next pipeline
2026-03-30 07:37:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1f7557c-fb27-542e-8401-9e5715d99c01, identifier: FB79973
2026-03-30 07:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbef2da7-1a23-55a2-956c-0ba75e0b0c9b with identifier: SV97177
2026-03-30 07:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbef2da7-1a23-55a2-956c-0ba75e0b0c9b with identifier: SV97177
2026-03-30 07:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbef2da7-1a23-55a2-956c-0ba75e0b0c9b with identifier: SV97177 to the API
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:40:31Z',
 'fuel_type': 'diesel',
 'id': 'bbef2da7-1a23-55a2-956c-0ba75e0b0c9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV97177',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 183565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV97177%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Saving data for SV97177: {'auction_closing_time': 1774971631.0, 'created_time': 1773134606.593986, 'last_price_update_time': 1774856233.667263}
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV97177') HTTP/1.1" 204 0
2026-03-30 07:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbef2da7-1a23-55a2-956c-0ba75e0b0c9b with identifier: SV97177
2026-03-30 07:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbef2da7-1a23-55a2-956c-0ba75e0b0c9b with identifier: SV97177
2026-03-30 07:37:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbef2da7-1a23-55a2-956c-0ba75e0b0c9b with identifier: SV97177 to the API
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:40:31Z',
 'fuel_type': 'diesel',
 'id': 'bbef2da7-1a23-55a2-956c-0ba75e0b0c9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV97177',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 183565,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV97177%27 HTTP/1.1" 200 None
2026-03-30 07:37:13 [auto1.de] INFO: Saving data for SV97177: {'auction_closing_time': 1774971631.0, 'created_time': 1773134606.593986, 'last_price_update_time': 1774856233.951043}
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV97177') HTTP/1.1" 204 0
2026-03-30 07:37:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc91c279-e522-57c5-ace7-5eb59707c2d0 with identifier: RY52055
2026-03-30 07:37:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc91c279-e522-57c5-ace7-5eb59707c2d0 with identifier: RY52055
2026-03-30 07:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc91c279-e522-57c5-ace7-5eb59707c2d0 with identifier: RY52055 to the API
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RY52055>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:43:11Z',
 'fuel_type': 'diesel',
 'id': 'dc91c279-e522-57c5-ace7-5eb59707c2d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY52055',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 189702,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_e714ce1095db8b8e2262bd5479aae035.jpg',
                'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_4f91ed15f246f26992d41c10664519cb.jpg',
                'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_a27785b245518f64b92b0557ee056bfd.jpg',
                'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_708c9b9ee2fbdba9c564e7c47986fe3e.jpg',
                'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_ec3c1be7d779b3eac1443d56bbef830a.jpg',
                'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_ead290dd95345918ebf8c34464e1568b.jpg',
                'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_93c8db49496e78b605d2ee173bffd783.jpg',
                'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_dcab916acdbe06f8ef50191a6f4eb4df.jpg',
                'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_403662043db9d4e90325a661c9138bf3.jpg',
                'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_05b820e522ab42300257e4cf58b48939.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc91c279-e522-57c5-ace7-5eb59707c2d0/dc91c279-e522-57c5-ace7-5eb59707c2d0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77984,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_e714ce1095db8b8e2262bd5479aae035.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc91c279-e522-57c5-ace7-5eb59707c2d0/dc91c279-e522-57c5-ace7-5eb59707c2d0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_4f91ed15f246f26992d41c10664519cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc91c279-e522-57c5-ace7-5eb59707c2d0/dc91c279-e522-57c5-ace7-5eb59707c2d0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69766,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_a27785b245518f64b92b0557ee056bfd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc91c279-e522-57c5-ace7-5eb59707c2d0/dc91c279-e522-57c5-ace7-5eb59707c2d0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_708c9b9ee2fbdba9c564e7c47986fe3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc91c279-e522-57c5-ace7-5eb59707c2d0/dc91c279-e522-57c5-ace7-5eb59707c2d0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58604,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_ec3c1be7d779b3eac1443d56bbef830a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc91c279-e522-57c5-ace7-5eb59707c2d0/dc91c279-e522-57c5-ace7-5eb59707c2d0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_ead290dd95345918ebf8c34464e1568b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc91c279-e522-57c5-ace7-5eb59707c2d0/dc91c279-e522-57c5-ace7-5eb59707c2d0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_93c8db49496e78b605d2ee173bffd783.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc91c279-e522-57c5-ace7-5eb59707c2d0/dc91c279-e522-57c5-ace7-5eb59707c2d0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_dcab916acdbe06f8ef50191a6f4eb4df.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc91c279-e522-57c5-ace7-5eb59707c2d0/dc91c279-e522-57c5-ace7-5eb59707c2d0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_403662043db9d4e90325a661c9138bf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc91c279-e522-57c5-ace7-5eb59707c2d0/dc91c279-e522-57c5-ace7-5eb59707c2d0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59810,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/bf/0fbf573919b627c30b5053c5b29bbcb3/pa/RY52055_05b820e522ab42300257e4cf58b48939.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Clever',
 'transmission': 'automatic',
 'trim': 'Clever',
 'year': 2018}
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY52055%27 HTTP/1.1" 200 None
2026-03-30 07:37:14 [auto1.de] INFO: Saving data for RY52055: {'created_time': 1774856234.351886, 'last_price_update_time': 1774856234.351899, 'auction_closing_time': 1774971791.0}
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY52055') HTTP/1.1" 204 0
2026-03-30 07:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1f7557c-fb27-542e-8401-9e5715d99c01 with identifier: FB79973
2026-03-30 07:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1f7557c-fb27-542e-8401-9e5715d99c01 with identifier: FB79973
2026-03-30 07:37:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1f7557c-fb27-542e-8401-9e5715d99c01 with identifier: FB79973 to the API
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_df9fa7422ff12966fbb70b9124346bc9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-31T15:54:12Z',
 'fuel_type': 'diesel',
 'id': 'f1f7557c-fb27-542e-8401-9e5715d99c01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB79973',
 'listing': 'auction',
 'location': 'DE, Brühl',
 'make': 'BMW',
 'model': '5er',
 'odometer': 177907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_2b5f1a4314a3392a9b76f610bce9042c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93321,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_67fde5ad55deca6b0b295d979051443d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3186951,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_6966829bc9581511d4d5da4ba7cb1db0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82601,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_42529730ecaf8f25911e24cb5ff84e91.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3168528,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_03423f49705c9637bcf292b16e5f9d27.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3300095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_734e3e5518ffc3f8219d3ebf76372c27.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3053709,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_ee09e1d158ccde165ae4331aad2f2c0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3278890,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_df9fa7422ff12966fbb70b9124346bc9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79795,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_592c4b3eb354a7404700ba20c3f9ce83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1f7557c-fb27-542e-8401-9e5715d99c01/f1f7557c-fb27-542e-8401-9e5715d99c01_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga0/4d/a04dede17fc0658ddb5f8ad815206711/pa/FB79973_a1fd78f8e4398d69b59aa7eba6caeaad.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 540d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB79973%27 HTTP/1.1" 200 None
2026-03-30 07:37:14 [auto1.de] INFO: Saving data for FB79973: {'created_time': 1774856234.753098, 'last_price_update_time': 1774856234.753111, 'auction_closing_time': 1774972452.0}
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB79973') HTTP/1.1" 204 0
2026-03-30 07:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:14 [auto1.de] INFO: Found listing with ID: MK30505
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK30505%27 HTTP/1.1" 200 None
2026-03-30 07:37:14 [auto1.de] INFO: Scrape type for MK30505: 2
2026-03-30 07:37:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f24faf4-e64e-55e4-bf3c-b347da00051e with identifier: MK30505
2026-03-30 07:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f24faf4-e64e-55e4-bf3c-b347da00051e with scrape type 2
2026-03-30 07:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f24faf4-e64e-55e4-bf3c-b347da00051e with scrape type 2
2026-03-30 07:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f24faf4-e64e-55e4-bf3c-b347da00051e, identifier: MK30505
2026-03-30 07:37:14 [auto1.de] INFO: Found listing with ID: MK30505
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK30505%27 HTTP/1.1" 200 None
2026-03-30 07:37:14 [auto1.de] INFO: Scrape type for MK30505: 2
2026-03-30 07:37:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f24faf4-e64e-55e4-bf3c-b347da00051e with scrape type 2
2026-03-30 07:37:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f24faf4-e64e-55e4-bf3c-b347da00051e with scrape type 2
2026-03-30 07:37:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f24faf4-e64e-55e4-bf3c-b347da00051e, identifier: MK30505
2026-03-30 07:37:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f24faf4-e64e-55e4-bf3c-b347da00051e with identifier: MK30505
2026-03-30 07:37:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f24faf4-e64e-55e4-bf3c-b347da00051e with identifier: MK30505
2026-03-30 07:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f24faf4-e64e-55e4-bf3c-b347da00051e with identifier: MK30505 to the API
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:27:05Z',
 'fuel_type': 'diesel',
 'id': '5f24faf4-e64e-55e4-bf3c-b347da00051e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK30505',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 171562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-18',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK30505%27 HTTP/1.1" 200 None
2026-03-30 07:37:15 [auto1.de] INFO: Saving data for MK30505: {'auction_closing_time': 1774970825.0, 'created_time': 1774380503.663391, 'last_price_update_time': 1774856235.328826}
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK30505') HTTP/1.1" 204 0
2026-03-30 07:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f24faf4-e64e-55e4-bf3c-b347da00051e with identifier: MK30505
2026-03-30 07:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f24faf4-e64e-55e4-bf3c-b347da00051e with identifier: MK30505
2026-03-30 07:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f24faf4-e64e-55e4-bf3c-b347da00051e with identifier: MK30505 to the API
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:27:05Z',
 'fuel_type': 'diesel',
 'id': '5f24faf4-e64e-55e4-bf3c-b347da00051e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK30505',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 171562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-18',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK30505%27 HTTP/1.1" 200 None
2026-03-30 07:37:15 [auto1.de] INFO: Saving data for MK30505: {'auction_closing_time': 1774970825.0, 'created_time': 1774380503.663391, 'last_price_update_time': 1774856235.63513}
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK30505') HTTP/1.1" 204 0
2026-03-30 07:37:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: UC30179
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: FM76670
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM76670%27 HTTP/1.1" 200 None
2026-03-30 07:37:15 [auto1.de] INFO: Scrape type for FM76670: 2
2026-03-30 07:37:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7 with identifier: FM76670
2026-03-30 07:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7 with scrape type 2
2026-03-30 07:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7 with scrape type 2
2026-03-30 07:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7, identifier: FM76670
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: UC30179
2026-03-30 07:37:15 [auto1.de] INFO: Found listing with ID: FM76670
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM76670%27 HTTP/1.1" 200 None
2026-03-30 07:37:15 [auto1.de] INFO: Scrape type for FM76670: 2
2026-03-30 07:37:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7 with scrape type 2
2026-03-30 07:37:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7 with scrape type 2
2026-03-30 07:37:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7, identifier: FM76670
2026-03-30 07:37:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7 with identifier: FM76670
2026-03-30 07:37:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7 with identifier: FM76670
2026-03-30 07:37:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7 with identifier: FM76670 to the API
2026-03-30 07:37:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:02:27Z',
 'fuel_type': 'petrol',
 'id': '5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM76670',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 24540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-21',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 XTRA',
 'transmission': 'manual',
 'trim': 'XTRA',
 'year': 2011}
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM76670%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Saving data for FM76670: {'auction_closing_time': 1774969347.0, 'created_time': 1774416960.553676, 'last_price_update_time': 1774856236.229881}
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM76670') HTTP/1.1" 204 0
2026-03-30 07:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7 with identifier: FM76670
2026-03-30 07:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7 with identifier: FM76670
2026-03-30 07:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7 with identifier: FM76670 to the API
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:02:27Z',
 'fuel_type': 'petrol',
 'id': '5a5025c4-8a8c-5eb5-a5d7-812d6dcaa2a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM76670',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 24540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-21',
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 XTRA',
 'transmission': 'manual',
 'trim': 'XTRA',
 'year': 2011}
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM76670%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Saving data for FM76670: {'auction_closing_time': 1774969347.0, 'created_time': 1774416960.553676, 'last_price_update_time': 1774856236.533115}
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM76670') HTTP/1.1" 204 0
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: XF39485
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF39485%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for XF39485: 2
2026-03-30 07:37:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7382651-6bbf-5303-8a0e-d68c20d5aaf0 with identifier: XF39485
2026-03-30 07:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7382651-6bbf-5303-8a0e-d68c20d5aaf0 with scrape type 2
2026-03-30 07:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7382651-6bbf-5303-8a0e-d68c20d5aaf0 with scrape type 2
2026-03-30 07:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7382651-6bbf-5303-8a0e-d68c20d5aaf0, identifier: XF39485
2026-03-30 07:37:16 [auto1.de] INFO: Found listing with ID: XF39485
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF39485%27 HTTP/1.1" 200 None
2026-03-30 07:37:16 [auto1.de] INFO: Scrape type for XF39485: 2
2026-03-30 07:37:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7382651-6bbf-5303-8a0e-d68c20d5aaf0 with scrape type 2
2026-03-30 07:37:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7382651-6bbf-5303-8a0e-d68c20d5aaf0 with scrape type 2
2026-03-30 07:37:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7382651-6bbf-5303-8a0e-d68c20d5aaf0, identifier: XF39485
2026-03-30 07:37:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7382651-6bbf-5303-8a0e-d68c20d5aaf0 with identifier: XF39485
2026-03-30 07:37:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7382651-6bbf-5303-8a0e-d68c20d5aaf0 with identifier: XF39485
2026-03-30 07:37:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7382651-6bbf-5303-8a0e-d68c20d5aaf0 with identifier: XF39485 to the API
2026-03-30 07:37:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-31T15:40:59Z',
 'fuel_type': 'diesel',
 'id': 'b7382651-6bbf-5303-8a0e-d68c20d5aaf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF39485',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 89566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seller_name': None,
 'title': 'BMW 5er 520d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-30 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF39485%27 HTTP/1.1" 200 None
2026-03-30 07:37:17 [auto1.de] INFO: Saving data for XF39485: {'auction_closing_time': 1774971659.0, 'created_time': 1774468177.953325, 'last_price_update_time': 1774856237.11739}
2026-03-30 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF39485') HTTP/1.1" 204 0
2026-03-30 07:37:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7382651-6bbf-5303-8a0e-d68c20d5aaf0 with identifier: XF39485
2026-03-30 07:37:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7382651-6bbf-5303-8a0e-d68c20d5aaf0 with identifier: XF39485
2026-03-30 07:37:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7382651-6bbf-5303-8a0e-d68c20d5aaf0 with identifier: XF39485 to the API
2026-03-30 07:37:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 201,
 'expiration_date': '2026-03-31T15:40:59Z',
 'fuel_type': 'diesel',
 'id': 'b7382651-6bbf-5303-8a0e-d68c20d5aaf0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF39485',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 89566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seller_name': None,
 'title': 'BMW 5er 520d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF39485%27 HTTP/1.1" 200 None
2026-03-30 07:37:19 [auto1.de] INFO: Saving data for XF39485: {'auction_closing_time': 1774971659.0, 'created_time': 1774468177.953325, 'last_price_update_time': 1774856239.362205}
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF39485') HTTP/1.1" 204 0
2026-03-30 07:37:19 [auto1.de] INFO: Found listing with ID: XH71010
2026-03-30 07:37:19 [auto1.de] INFO: Found listing with ID: LD10656
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD10656%27 HTTP/1.1" 200 None
2026-03-30 07:37:19 [auto1.de] INFO: Scrape type for LD10656: 2
2026-03-30 07:37:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac with identifier: LD10656
2026-03-30 07:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac with scrape type 2
2026-03-30 07:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac with scrape type 2
2026-03-30 07:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac, identifier: LD10656
2026-03-30 07:37:19 [auto1.de] INFO: Found listing with ID: XH71010
2026-03-30 07:37:19 [auto1.de] INFO: Found listing with ID: LD10656
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD10656%27 HTTP/1.1" 200 None
2026-03-30 07:37:19 [auto1.de] INFO: Scrape type for LD10656: 2
2026-03-30 07:37:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac with scrape type 2
2026-03-30 07:37:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac with scrape type 2
2026-03-30 07:37:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac, identifier: LD10656
2026-03-30 07:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac with identifier: LD10656
2026-03-30 07:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac with identifier: LD10656
2026-03-30 07:37:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac with identifier: LD10656 to the API
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:11:04Z',
 'fuel_type': 'diesel',
 'id': 'd69d1c41-2bbc-5002-a5fe-a6d1972bc6ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD10656',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T7 Multivan',
 'odometer': 62890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-03',
 'seller_name': None,
 'title': 'Volkswagen T7 Multivan 2.0 TDI Style lang',
 'transmission': 'automatic',
 'trim': 'Style lang',
 'year': 2024}
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD10656%27 HTTP/1.1" 200 None
2026-03-30 07:37:19 [auto1.de] INFO: Saving data for LD10656: {'auction_closing_time': 1774969864.0, 'created_time': 1773688680.68465, 'last_price_update_time': 1774856239.969557}
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD10656') HTTP/1.1" 204 0
2026-03-30 07:37:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac with identifier: LD10656
2026-03-30 07:37:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac with identifier: LD10656
2026-03-30 07:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d69d1c41-2bbc-5002-a5fe-a6d1972bc6ac with identifier: LD10656 to the API
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:11:04Z',
 'fuel_type': 'diesel',
 'id': 'd69d1c41-2bbc-5002-a5fe-a6d1972bc6ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD10656',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T7 Multivan',
 'odometer': 62890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-07-03',
 'seller_name': None,
 'title': 'Volkswagen T7 Multivan 2.0 TDI Style lang',
 'transmission': 'automatic',
 'trim': 'Style lang',
 'year': 2024}
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD10656%27 HTTP/1.1" 200 None
2026-03-30 07:37:20 [auto1.de] INFO: Saving data for LD10656: {'auction_closing_time': 1774969864.0, 'created_time': 1773688680.68465, 'last_price_update_time': 1774856240.292392}
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD10656') HTTP/1.1" 204 0
2026-03-30 07:37:20 [auto1.de] INFO: Found listing with ID: MS24005
2026-03-30 07:37:20 [auto1.de] INFO: Found listing with ID: UX16759
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX16759%27 HTTP/1.1" 200 None
2026-03-30 07:37:20 [auto1.de] INFO: Scrape type for UX16759: 2
2026-03-30 07:37:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5 with identifier: UX16759
2026-03-30 07:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5 with scrape type 2
2026-03-30 07:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5 with scrape type 2
2026-03-30 07:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5, identifier: UX16759
2026-03-30 07:37:20 [auto1.de] INFO: Found listing with ID: MS24005
2026-03-30 07:37:20 [auto1.de] INFO: Found listing with ID: UX16759
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX16759%27 HTTP/1.1" 200 None
2026-03-30 07:37:20 [auto1.de] INFO: Scrape type for UX16759: 2
2026-03-30 07:37:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5 with scrape type 2
2026-03-30 07:37:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5 with scrape type 2
2026-03-30 07:37:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5, identifier: UX16759
2026-03-30 07:37:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5 with identifier: UX16759
2026-03-30 07:37:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5 with identifier: UX16759
2026-03-30 07:37:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5 with identifier: UX16759 to the API
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:49:15Z',
 'fuel_type': 'petrol',
 'id': '9ad6cd2e-acac-53e4-a1b3-62ac6a073df5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX16759',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 131243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-18',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2015}
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX16759%27 HTTP/1.1" 200 None
2026-03-30 07:37:20 [auto1.de] INFO: Saving data for UX16759: {'auction_closing_time': 1774972155.0, 'created_time': 1773136299.138102, 'last_price_update_time': 1774856240.982036}
2026-03-30 07:37:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX16759') HTTP/1.1" 204 0
2026-03-30 07:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5 with identifier: UX16759
2026-03-30 07:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5 with identifier: UX16759
2026-03-30 07:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ad6cd2e-acac-53e4-a1b3-62ac6a073df5 with identifier: UX16759 to the API
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:49:15Z',
 'fuel_type': 'petrol',
 'id': '9ad6cd2e-acac-53e4-a1b3-62ac6a073df5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX16759',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 131243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-18',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2015}
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX16759%27 HTTP/1.1" 200 None
2026-03-30 07:37:21 [auto1.de] INFO: Saving data for UX16759: {'auction_closing_time': 1774972155.0, 'created_time': 1773136299.138102, 'last_price_update_time': 1774856241.377333}
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX16759') HTTP/1.1" 204 0
2026-03-30 07:37:21 [auto1.de] INFO: Found listing with ID: XL44945
2026-03-30 07:37:21 [auto1.de] INFO: Found listing with ID: WU59517
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU59517%27 HTTP/1.1" 200 None
2026-03-30 07:37:21 [auto1.de] INFO: Scrape type for WU59517: 2
2026-03-30 07:37:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 858aa78e-1ae6-5086-a92c-59ca7c755373 with identifier: WU59517
2026-03-30 07:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 858aa78e-1ae6-5086-a92c-59ca7c755373 with scrape type 2
2026-03-30 07:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 858aa78e-1ae6-5086-a92c-59ca7c755373 with scrape type 2
2026-03-30 07:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 858aa78e-1ae6-5086-a92c-59ca7c755373, identifier: WU59517
2026-03-30 07:37:21 [auto1.de] INFO: Found listing with ID: XL44945
2026-03-30 07:37:21 [auto1.de] INFO: Found listing with ID: WU59517
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU59517%27 HTTP/1.1" 200 None
2026-03-30 07:37:21 [auto1.de] INFO: Scrape type for WU59517: 2
2026-03-30 07:37:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 858aa78e-1ae6-5086-a92c-59ca7c755373 with scrape type 2
2026-03-30 07:37:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 858aa78e-1ae6-5086-a92c-59ca7c755373 with scrape type 2
2026-03-30 07:37:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 858aa78e-1ae6-5086-a92c-59ca7c755373, identifier: WU59517
2026-03-30 07:37:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 858aa78e-1ae6-5086-a92c-59ca7c755373 with identifier: WU59517
2026-03-30 07:37:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 858aa78e-1ae6-5086-a92c-59ca7c755373 with identifier: WU59517
2026-03-30 07:37:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 858aa78e-1ae6-5086-a92c-59ca7c755373 with identifier: WU59517 to the API
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:32:01Z',
 'fuel_type': 'petrol',
 'id': '858aa78e-1ae6-5086-a92c-59ca7c755373',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU59517',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 171519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-20',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU59517%27 HTTP/1.1" 200 None
2026-03-30 07:37:21 [auto1.de] INFO: Saving data for WU59517: {'auction_closing_time': 1774971121.0, 'created_time': 1773686480.812883, 'last_price_update_time': 1774856241.955929}
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU59517') HTTP/1.1" 204 0
2026-03-30 07:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 858aa78e-1ae6-5086-a92c-59ca7c755373 with identifier: WU59517
2026-03-30 07:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 858aa78e-1ae6-5086-a92c-59ca7c755373 with identifier: WU59517
2026-03-30 07:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 858aa78e-1ae6-5086-a92c-59ca7c755373 with identifier: WU59517 to the API
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:32:01Z',
 'fuel_type': 'petrol',
 'id': '858aa78e-1ae6-5086-a92c-59ca7c755373',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU59517',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 171519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-20',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU59517%27 HTTP/1.1" 200 None
2026-03-30 07:37:22 [auto1.de] INFO: Saving data for WU59517: {'auction_closing_time': 1774971121.0, 'created_time': 1773686480.812883, 'last_price_update_time': 1774856242.374555}
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WU59517') HTTP/1.1" 204 0
2026-03-30 07:37:22 [auto1.de] INFO: Found listing with ID: ND84220
2026-03-30 07:37:22 [auto1.de] INFO: Found listing with ID: SB50693
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50693%27 HTTP/1.1" 200 None
2026-03-30 07:37:22 [auto1.de] INFO: Scrape type for SB50693: 2
2026-03-30 07:37:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e85f1c93-0370-5983-8ffc-ff61a1323ee8 with identifier: SB50693
2026-03-30 07:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e85f1c93-0370-5983-8ffc-ff61a1323ee8 with scrape type 2
2026-03-30 07:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e85f1c93-0370-5983-8ffc-ff61a1323ee8 with scrape type 2
2026-03-30 07:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e85f1c93-0370-5983-8ffc-ff61a1323ee8, identifier: SB50693
2026-03-30 07:37:22 [auto1.de] INFO: Found listing with ID: ND84220
2026-03-30 07:37:22 [auto1.de] INFO: Found listing with ID: SB50693
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50693%27 HTTP/1.1" 200 None
2026-03-30 07:37:22 [auto1.de] INFO: Scrape type for SB50693: 2
2026-03-30 07:37:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e85f1c93-0370-5983-8ffc-ff61a1323ee8 with scrape type 2
2026-03-30 07:37:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e85f1c93-0370-5983-8ffc-ff61a1323ee8 with scrape type 2
2026-03-30 07:37:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e85f1c93-0370-5983-8ffc-ff61a1323ee8, identifier: SB50693
2026-03-30 07:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF57490/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e85f1c93-0370-5983-8ffc-ff61a1323ee8 with identifier: SB50693
2026-03-30 07:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e85f1c93-0370-5983-8ffc-ff61a1323ee8 with identifier: SB50693
2026-03-30 07:37:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e85f1c93-0370-5983-8ffc-ff61a1323ee8 with identifier: SB50693 to the API
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:14:49Z',
 'fuel_type': 'petrol',
 'id': 'e85f1c93-0370-5983-8ffc-ff61a1323ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB50693',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 172629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-26',
 'seller_name': None,
 'title': 'BMW 2er 220i Active Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50693%27 HTTP/1.1" 200 None
2026-03-30 07:37:22 [auto1.de] INFO: Saving data for SB50693: {'auction_closing_time': 1774970089.0, 'created_time': 1773661760.389615, 'last_price_update_time': 1774856242.968484}
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB50693') HTTP/1.1" 204 0
2026-03-30 07:37:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e85f1c93-0370-5983-8ffc-ff61a1323ee8 with identifier: SB50693
2026-03-30 07:37:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e85f1c93-0370-5983-8ffc-ff61a1323ee8 with identifier: SB50693
2026-03-30 07:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e85f1c93-0370-5983-8ffc-ff61a1323ee8 with identifier: SB50693 to the API
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-31T15:14:49Z',
 'fuel_type': 'petrol',
 'id': 'e85f1c93-0370-5983-8ffc-ff61a1323ee8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB50693',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 172629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-26',
 'seller_name': None,
 'title': 'BMW 2er 220i Active Tourer Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2018}
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB50693%27 HTTP/1.1" 200 None
2026-03-30 07:37:23 [auto1.de] INFO: Saving data for SB50693: {'auction_closing_time': 1774970089.0, 'created_time': 1773661760.389615, 'last_price_update_time': 1774856243.271414}
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB50693') HTTP/1.1" 204 0
2026-03-30 07:37:23 [auto1.de] INFO: Found listing with ID: AS63846
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS63846%27 HTTP/1.1" 200 None
2026-03-30 07:37:23 [auto1.de] INFO: Scrape type for AS63846: 2
2026-03-30 07:37:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74d42746-9261-522b-ac5b-358d98d9d501 with identifier: AS63846
2026-03-30 07:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74d42746-9261-522b-ac5b-358d98d9d501 with scrape type 2
2026-03-30 07:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74d42746-9261-522b-ac5b-358d98d9d501 with scrape type 2
2026-03-30 07:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74d42746-9261-522b-ac5b-358d98d9d501, identifier: AS63846
2026-03-30 07:37:23 [auto1.de] INFO: Found listing with ID: AS63846
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS63846%27 HTTP/1.1" 200 None
2026-03-30 07:37:23 [auto1.de] INFO: Scrape type for AS63846: 2
2026-03-30 07:37:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74d42746-9261-522b-ac5b-358d98d9d501 with scrape type 2
2026-03-30 07:37:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74d42746-9261-522b-ac5b-358d98d9d501 with scrape type 2
2026-03-30 07:37:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 74d42746-9261-522b-ac5b-358d98d9d501, identifier: AS63846
2026-03-30 07:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74d42746-9261-522b-ac5b-358d98d9d501 with identifier: AS63846
2026-03-30 07:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74d42746-9261-522b-ac5b-358d98d9d501 with identifier: AS63846
2026-03-30 07:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74d42746-9261-522b-ac5b-358d98d9d501 with identifier: AS63846 to the API
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:16:19Z',
 'fuel_type': 'petrol',
 'id': '74d42746-9261-522b-ac5b-358d98d9d501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS63846',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 272688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-01',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2004}
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS63846%27 HTTP/1.1" 200 None
2026-03-30 07:37:23 [auto1.de] INFO: Saving data for AS63846: {'auction_closing_time': 1774970179.0, 'created_time': 1774379842.588046, 'last_price_update_time': 1774856243.841731}
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS63846') HTTP/1.1" 204 0
2026-03-30 07:37:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 74d42746-9261-522b-ac5b-358d98d9d501 with identifier: AS63846
2026-03-30 07:37:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 74d42746-9261-522b-ac5b-358d98d9d501 with identifier: AS63846
2026-03-30 07:37:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 74d42746-9261-522b-ac5b-358d98d9d501 with identifier: AS63846 to the API
2026-03-30 07:37:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:16:19Z',
 'fuel_type': 'petrol',
 'id': '74d42746-9261-522b-ac5b-358d98d9d501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS63846',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 272688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-03-01',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2004}
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS63846%27 HTTP/1.1" 200 None
2026-03-30 07:37:24 [auto1.de] INFO: Saving data for AS63846: {'auction_closing_time': 1774970179.0, 'created_time': 1774379842.588046, 'last_price_update_time': 1774856244.142587}
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS63846') HTTP/1.1" 204 0
2026-03-30 07:37:24 [auto1.de] INFO: Found listing with ID: DZ51927
2026-03-30 07:37:24 [auto1.de] INFO: Found listing with ID: ZD23730
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23730%27 HTTP/1.1" 200 None
2026-03-30 07:37:24 [auto1.de] INFO: Scrape type for ZD23730: 2
2026-03-30 07:37:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12fc290f-24fa-5d3d-a174-e01c55b5ec63 with identifier: ZD23730
2026-03-30 07:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12fc290f-24fa-5d3d-a174-e01c55b5ec63 with scrape type 2
2026-03-30 07:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12fc290f-24fa-5d3d-a174-e01c55b5ec63 with scrape type 2
2026-03-30 07:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12fc290f-24fa-5d3d-a174-e01c55b5ec63, identifier: ZD23730
2026-03-30 07:37:24 [auto1.de] INFO: Found listing with ID: DZ51927
2026-03-30 07:37:24 [auto1.de] INFO: Found listing with ID: ZD23730
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23730%27 HTTP/1.1" 200 None
2026-03-30 07:37:24 [auto1.de] INFO: Scrape type for ZD23730: 2
2026-03-30 07:37:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12fc290f-24fa-5d3d-a174-e01c55b5ec63 with scrape type 2
2026-03-30 07:37:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12fc290f-24fa-5d3d-a174-e01c55b5ec63 with scrape type 2
2026-03-30 07:37:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12fc290f-24fa-5d3d-a174-e01c55b5ec63, identifier: ZD23730
2026-03-30 07:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12fc290f-24fa-5d3d-a174-e01c55b5ec63 with identifier: ZD23730
2026-03-30 07:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12fc290f-24fa-5d3d-a174-e01c55b5ec63 with identifier: ZD23730
2026-03-30 07:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12fc290f-24fa-5d3d-a174-e01c55b5ec63 with identifier: ZD23730 to the API
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:11Z',
 'fuel_type': 'petrol',
 'id': '12fc290f-24fa-5d3d-a174-e01c55b5ec63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD23730',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 68709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-05',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Turbo S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2019}
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23730%27 HTTP/1.1" 200 None
2026-03-30 07:37:24 [auto1.de] INFO: Saving data for ZD23730: {'auction_closing_time': 1774970111.0, 'created_time': 1774466374.235816, 'last_price_update_time': 1774856244.738332}
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD23730') HTTP/1.1" 204 0
2026-03-30 07:37:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12fc290f-24fa-5d3d-a174-e01c55b5ec63 with identifier: ZD23730
2026-03-30 07:37:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12fc290f-24fa-5d3d-a174-e01c55b5ec63 with identifier: ZD23730
2026-03-30 07:37:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12fc290f-24fa-5d3d-a174-e01c55b5ec63 with identifier: ZD23730 to the API
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:15:11Z',
 'fuel_type': 'petrol',
 'id': '12fc290f-24fa-5d3d-a174-e01c55b5ec63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD23730',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 68709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-05',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Turbo S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2019}
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD23730%27 HTTP/1.1" 200 None
2026-03-30 07:37:25 [auto1.de] INFO: Saving data for ZD23730: {'auction_closing_time': 1774970111.0, 'created_time': 1774466374.235816, 'last_price_update_time': 1774856245.012165}
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD23730') HTTP/1.1" 204 0
2026-03-30 07:37:25 [auto1.de] INFO: Channel: 24h | Page: 14 | totalHits: 7709 | hits on page: 40
2026-03-30 07:37:25 [auto1.de] INFO: Found listing with ID: YK76722
2026-03-30 07:37:25 [auto1.de] INFO: Found listing with ID: YK76722
2026-03-30 07:37:25 [auto1.de] INFO: Found listing with ID: LX13795
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX13795%27 HTTP/1.1" 200 None
2026-03-30 07:37:25 [auto1.de] INFO: Scrape type for LX13795: 2
2026-03-30 07:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65820b3d-d2e0-52f3-8fad-ef644e5acc58 with identifier: LX13795
2026-03-30 07:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65820b3d-d2e0-52f3-8fad-ef644e5acc58 with scrape type 2
2026-03-30 07:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65820b3d-d2e0-52f3-8fad-ef644e5acc58 with scrape type 2
2026-03-30 07:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65820b3d-d2e0-52f3-8fad-ef644e5acc58, identifier: LX13795
2026-03-30 07:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65820b3d-d2e0-52f3-8fad-ef644e5acc58 with identifier: LX13795
2026-03-30 07:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65820b3d-d2e0-52f3-8fad-ef644e5acc58 with identifier: LX13795
2026-03-30 07:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65820b3d-d2e0-52f3-8fad-ef644e5acc58 with identifier: LX13795 to the API
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-31T15:31:35Z',
 'fuel_type': 'hybrid',
 'id': '65820b3d-d2e0-52f3-8fad-ef644e5acc58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX13795',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 31744,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-01',
 'seller_name': None,
 'title': 'Audi Q5 Sportback 50 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX13795%27 HTTP/1.1" 200 None
2026-03-30 07:37:25 [auto1.de] INFO: Saving data for LX13795: {'auction_closing_time': 1774971095.0, 'created_time': 1773388583.395635, 'last_price_update_time': 1774856245.466945}
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX13795') HTTP/1.1" 204 0
2026-03-30 07:37:25 [auto1.de] INFO: Found listing with ID: NH59879
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH59879%27 HTTP/1.1" 200 None
2026-03-30 07:37:25 [auto1.de] INFO: Scrape type for NH59879: 2
2026-03-30 07:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80fda406-50d0-5c21-baa7-f348af07061f with identifier: NH59879
2026-03-30 07:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80fda406-50d0-5c21-baa7-f348af07061f with scrape type 2
2026-03-30 07:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80fda406-50d0-5c21-baa7-f348af07061f with scrape type 2
2026-03-30 07:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80fda406-50d0-5c21-baa7-f348af07061f, identifier: NH59879
2026-03-30 07:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:25 [auto1.de] INFO: Found listing with ID: HE06850
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE06850%27 HTTP/1.1" 200 None
2026-03-30 07:37:25 [auto1.de] INFO: Scrape type for HE06850: 2
2026-03-30 07:37:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d08d86c-d33b-544b-b331-9c405175c5e2 with identifier: HE06850
2026-03-30 07:37:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d08d86c-d33b-544b-b331-9c405175c5e2 with scrape type 2
2026-03-30 07:37:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d08d86c-d33b-544b-b331-9c405175c5e2 with scrape type 2
2026-03-30 07:37:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d08d86c-d33b-544b-b331-9c405175c5e2, identifier: HE06850
2026-03-30 07:37:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80fda406-50d0-5c21-baa7-f348af07061f with identifier: NH59879
2026-03-30 07:37:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80fda406-50d0-5c21-baa7-f348af07061f with identifier: NH59879
2026-03-30 07:37:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80fda406-50d0-5c21-baa7-f348af07061f with identifier: NH59879 to the API
2026-03-30 07:37:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-31T15:54:45Z',
 'fuel_type': 'petrol',
 'id': '80fda406-50d0-5c21-baa7-f348af07061f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH59879',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 173675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-27',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 City',
 'transmission': 'manual',
 'trim': 'City',
 'year': 2006}
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH59879%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Saving data for NH59879: {'auction_closing_time': 1774972485.0, 'created_time': 1774349704.853633, 'last_price_update_time': 1774856246.127585}
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH59879') HTTP/1.1" 204 0
2026-03-30 07:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d08d86c-d33b-544b-b331-9c405175c5e2 with identifier: HE06850
2026-03-30 07:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d08d86c-d33b-544b-b331-9c405175c5e2 with identifier: HE06850
2026-03-30 07:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d08d86c-d33b-544b-b331-9c405175c5e2 with identifier: HE06850 to the API
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:59:56Z',
 'fuel_type': 'petrol',
 'id': '1d08d86c-d33b-544b-b331-9c405175c5e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE06850',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 130668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-15',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE06850%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Saving data for HE06850: {'auction_closing_time': 1774972796.0, 'created_time': 1773301992.607143, 'last_price_update_time': 1774856246.478693}
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE06850') HTTP/1.1" 204 0
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: HE72355
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE72355%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for HE72355: 2
2026-03-30 07:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 765f15e4-96ab-52fa-a220-cd3b9201840d with identifier: HE72355
2026-03-30 07:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 765f15e4-96ab-52fa-a220-cd3b9201840d with scrape type 2
2026-03-30 07:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 765f15e4-96ab-52fa-a220-cd3b9201840d with scrape type 2
2026-03-30 07:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 765f15e4-96ab-52fa-a220-cd3b9201840d, identifier: HE72355
2026-03-30 07:37:26 [auto1.de] INFO: Found listing with ID: EB21377
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB21377%27 HTTP/1.1" 200 None
2026-03-30 07:37:26 [auto1.de] INFO: Scrape type for EB21377: 2
2026-03-30 07:37:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a9f276e-8845-53c6-ad70-492a71f28835 with identifier: EB21377
2026-03-30 07:37:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a9f276e-8845-53c6-ad70-492a71f28835 with scrape type 2
2026-03-30 07:37:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a9f276e-8845-53c6-ad70-492a71f28835 with scrape type 2
2026-03-30 07:37:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a9f276e-8845-53c6-ad70-492a71f28835, identifier: EB21377
2026-03-30 07:37:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 765f15e4-96ab-52fa-a220-cd3b9201840d with identifier: HE72355
2026-03-30 07:37:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 765f15e4-96ab-52fa-a220-cd3b9201840d with identifier: HE72355
2026-03-30 07:37:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 765f15e4-96ab-52fa-a220-cd3b9201840d with identifier: HE72355 to the API
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:59:53Z',
 'fuel_type': 'petrol',
 'id': '765f15e4-96ab-52fa-a220-cd3b9201840d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE72355',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 160733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-15',
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 Style Plus Edition',
 'transmission': 'manual',
 'trim': 'Style Plus Edition',
 'year': 2009}
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE72355%27 HTTP/1.1" 200 None
2026-03-30 07:37:27 [auto1.de] INFO: Saving data for HE72355: {'auction_closing_time': 1774972793.0, 'created_time': 1773302663.575692, 'last_price_update_time': 1774856247.063696}
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE72355') HTTP/1.1" 204 0
2026-03-30 07:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF52766> (referer: https://www.auto1.com/v1/car-details-view/FF52766/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX46621> (referer: https://www.auto1.com/v1/car-details-view/LX46621/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a9f276e-8845-53c6-ad70-492a71f28835 with identifier: EB21377
2026-03-30 07:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a9f276e-8845-53c6-ad70-492a71f28835 with identifier: EB21377
2026-03-30 07:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a9f276e-8845-53c6-ad70-492a71f28835 with identifier: EB21377 to the API
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:16:23Z',
 'fuel_type': 'petrol',
 'id': '5a9f276e-8845-53c6-ad70-492a71f28835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB21377',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 110667,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-19',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'manual',
 'trim': 'BlueEfficiency Urban',
 'year': 2017}
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB21377%27 HTTP/1.1" 200 None
2026-03-30 07:37:27 [auto1.de] INFO: Saving data for EB21377: {'auction_closing_time': 1774970183.0, 'created_time': 1773662039.758028, 'last_price_update_time': 1774856247.426283}
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB21377') HTTP/1.1" 204 0
2026-03-30 07:37:27 [auto1.de] INFO: Found listing with ID: SC06159
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06159%27 HTTP/1.1" 200 None
2026-03-30 07:37:27 [auto1.de] INFO: Scrape type for SC06159: 2
2026-03-30 07:37:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10699f48-c943-5677-9a8d-4674c842b513 with identifier: SC06159
2026-03-30 07:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10699f48-c943-5677-9a8d-4674c842b513 with scrape type 2
2026-03-30 07:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10699f48-c943-5677-9a8d-4674c842b513 with scrape type 2
2026-03-30 07:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10699f48-c943-5677-9a8d-4674c842b513, identifier: SC06159
2026-03-30 07:37:27 [auto1.de] INFO: Found listing with ID: FU32442
2026-03-30 07:37:27 [auto1.de] INFO: Found listing with ID: NH59879
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH59879%27 HTTP/1.1" 200 None
2026-03-30 07:37:27 [auto1.de] INFO: Scrape type for NH59879: 0
2026-03-30 07:37:27 [auto1.de] INFO: Found listing with ID: HE72355
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE72355%27 HTTP/1.1" 200 None
2026-03-30 07:37:27 [auto1.de] INFO: Scrape type for HE72355: 0
2026-03-30 07:37:27 [auto1.de] INFO: Found listing with ID: SC06159
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06159%27 HTTP/1.1" 200 None
2026-03-30 07:37:27 [auto1.de] INFO: Scrape type for SC06159: 2
2026-03-30 07:37:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10699f48-c943-5677-9a8d-4674c842b513 with scrape type 2
2026-03-30 07:37:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10699f48-c943-5677-9a8d-4674c842b513 with scrape type 2
2026-03-30 07:37:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 10699f48-c943-5677-9a8d-4674c842b513, identifier: SC06159
2026-03-30 07:37:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10699f48-c943-5677-9a8d-4674c842b513 with identifier: SC06159
2026-03-30 07:37:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10699f48-c943-5677-9a8d-4674c842b513 with identifier: SC06159
2026-03-30 07:37:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10699f48-c943-5677-9a8d-4674c842b513 with identifier: SC06159 to the API
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:37:22Z',
 'fuel_type': 'diesel',
 'id': '10699f48-c943-5677-9a8d-4674c842b513',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC06159',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 232809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-11',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2015}
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06159%27 HTTP/1.1" 200 None
2026-03-30 07:37:28 [auto1.de] INFO: Saving data for SC06159: {'auction_closing_time': 1774971442.0, 'created_time': 1774467741.277094, 'last_price_update_time': 1774856248.061804}
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC06159') HTTP/1.1" 204 0
2026-03-30 07:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 10699f48-c943-5677-9a8d-4674c842b513 with identifier: SC06159
2026-03-30 07:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 10699f48-c943-5677-9a8d-4674c842b513 with identifier: SC06159
2026-03-30 07:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 10699f48-c943-5677-9a8d-4674c842b513 with identifier: SC06159 to the API
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:37:22Z',
 'fuel_type': 'diesel',
 'id': '10699f48-c943-5677-9a8d-4674c842b513',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC06159',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 232809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-11',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2015}
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC06159%27 HTTP/1.1" 200 None
2026-03-30 07:37:28 [auto1.de] INFO: Saving data for SC06159: {'auction_closing_time': 1774971442.0, 'created_time': 1774467741.277094, 'last_price_update_time': 1774856248.34965}
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC06159') HTTP/1.1" 204 0
2026-03-30 07:37:28 [auto1.de] INFO: Found listing with ID: WD01270
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD01270%27 HTTP/1.1" 200 None
2026-03-30 07:37:28 [auto1.de] INFO: Scrape type for WD01270: 2
2026-03-30 07:37:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06f0f6e2-f1ae-56b7-baed-61ecf359ded5 with identifier: WD01270
2026-03-30 07:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06f0f6e2-f1ae-56b7-baed-61ecf359ded5 with scrape type 2
2026-03-30 07:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06f0f6e2-f1ae-56b7-baed-61ecf359ded5 with scrape type 2
2026-03-30 07:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06f0f6e2-f1ae-56b7-baed-61ecf359ded5, identifier: WD01270
2026-03-30 07:37:28 [auto1.de] INFO: Found listing with ID: WD01270
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD01270%27 HTTP/1.1" 200 None
2026-03-30 07:37:28 [auto1.de] INFO: Scrape type for WD01270: 2
2026-03-30 07:37:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06f0f6e2-f1ae-56b7-baed-61ecf359ded5 with scrape type 2
2026-03-30 07:37:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06f0f6e2-f1ae-56b7-baed-61ecf359ded5 with scrape type 2
2026-03-30 07:37:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06f0f6e2-f1ae-56b7-baed-61ecf359ded5, identifier: WD01270
2026-03-30 07:37:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06f0f6e2-f1ae-56b7-baed-61ecf359ded5 with identifier: WD01270
2026-03-30 07:37:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06f0f6e2-f1ae-56b7-baed-61ecf359ded5 with identifier: WD01270
2026-03-30 07:37:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06f0f6e2-f1ae-56b7-baed-61ecf359ded5 with identifier: WD01270 to the API
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:23:46Z',
 'fuel_type': 'petrol',
 'id': '06f0f6e2-f1ae-56b7-baed-61ecf359ded5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD01270',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 176982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-02',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD01270%27 HTTP/1.1" 200 None
2026-03-30 07:37:28 [auto1.de] INFO: Saving data for WD01270: {'auction_closing_time': 1774970626.0, 'created_time': 1773301971.082132, 'last_price_update_time': 1774856248.955289}
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD01270') HTTP/1.1" 204 0
2026-03-30 07:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06f0f6e2-f1ae-56b7-baed-61ecf359ded5 with identifier: WD01270
2026-03-30 07:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06f0f6e2-f1ae-56b7-baed-61ecf359ded5 with identifier: WD01270
2026-03-30 07:37:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06f0f6e2-f1ae-56b7-baed-61ecf359ded5 with identifier: WD01270 to the API
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:23:46Z',
 'fuel_type': 'petrol',
 'id': '06f0f6e2-f1ae-56b7-baed-61ecf359ded5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD01270',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 176982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-02',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD01270%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [auto1.de] INFO: Saving data for WD01270: {'auction_closing_time': 1774970626.0, 'created_time': 1773301971.082132, 'last_price_update_time': 1774856249.360236}
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD01270') HTTP/1.1" 204 0
2026-03-30 07:37:29 [auto1.de] INFO: Found listing with ID: FP18966
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP18966%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [auto1.de] INFO: Scrape type for FP18966: 2
2026-03-30 07:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c12f37d-99ad-58f5-8a91-7da670a82ecf with identifier: FP18966
2026-03-30 07:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c12f37d-99ad-58f5-8a91-7da670a82ecf with scrape type 2
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c12f37d-99ad-58f5-8a91-7da670a82ecf with scrape type 2
2026-03-30 07:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c12f37d-99ad-58f5-8a91-7da670a82ecf, identifier: FP18966
2026-03-30 07:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bacb1e58-88d6-580c-81ac-6cb6ac5ea74a with identifier: FF52766
2026-03-30 07:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bacb1e58-88d6-580c-81ac-6cb6ac5ea74a with scrape type 1
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item bacb1e58-88d6-580c-81ac-6cb6ac5ea74a
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_52fb3b33531732ed29f9cf590666a164.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_52fb3b33531732ed29f9cf590666a164.jpg not downloaded yet
2026-03-30 07:37:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c19de2c2-7436-52b8-a310-a4a002377738 with identifier: LX46621
2026-03-30 07:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c19de2c2-7436-52b8-a310-a4a002377738 with scrape type 1
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c19de2c2-7436-52b8-a310-a4a002377738
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F28%252F8428e1d38a809be0f05607539790265e%252Fpa%252FLX46621_8032e21dc6f9c49139ecc25baf2cf285.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_8032e21dc6f9c49139ecc25baf2cf285.jpg already downloaded
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F28%252F8428e1d38a809be0f05607539790265e%252Fpa%252FLX46621_f28638e11a615e6b29bbdcb668f168a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_f28638e11a615e6b29bbdcb668f168a8.jpg already downloaded
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F28%252F8428e1d38a809be0f05607539790265e%252Fpa%252FLX46621_0b5797cc3eef1182d1567a4145f9531e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_0b5797cc3eef1182d1567a4145f9531e.jpg already downloaded
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F28%252F8428e1d38a809be0f05607539790265e%252Fpa%252FLX46621_ebfde4f5b3ba156a52e6e439ab3b836e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_ebfde4f5b3ba156a52e6e439ab3b836e.jpg already downloaded
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F28%252F8428e1d38a809be0f05607539790265e%252Fpa%252FLX46621_2ab8db21197d00bda052dcbeecc6ceb3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_2ab8db21197d00bda052dcbeecc6ceb3.jpg already downloaded
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F28%252F8428e1d38a809be0f05607539790265e%252Fpa%252FLX46621_b292299e969c31a03f346e7e88e14310.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_b292299e969c31a03f346e7e88e14310.jpg already downloaded
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F28%252F8428e1d38a809be0f05607539790265e%252Fpa%252FLX46621_8e174172bf49c8bd757a5bf83602c2be.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_8e174172bf49c8bd757a5bf83602c2be.jpg already downloaded
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F28%252F8428e1d38a809be0f05607539790265e%252Fpa%252FLX46621_d4988fcdfa2d0a804d211da211fe646e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_d4988fcdfa2d0a804d211da211fe646e.jpg already downloaded
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F28%252F8428e1d38a809be0f05607539790265e%252Fpa%252FLX46621_95ee0f15a0d8815347dac6cd8309304b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_95ee0f15a0d8815347dac6cd8309304b.jpg already downloaded
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg84%252F28%252F8428e1d38a809be0f05607539790265e%252Fpa%252FLX46621_67815c833c88a242805901a2182fced5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_67815c833c88a242805901a2182fced5.jpg already downloaded
2026-03-30 07:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c19de2c2-7436-52b8-a310-a4a002377738, identifier: LX46621
2026-03-30 07:37:29 [auto1.de] INFO: Found listing with ID: FP18966
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP18966%27 HTTP/1.1" 200 None
2026-03-30 07:37:29 [auto1.de] INFO: Scrape type for FP18966: 2
2026-03-30 07:37:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c12f37d-99ad-58f5-8a91-7da670a82ecf with scrape type 2
2026-03-30 07:37:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c12f37d-99ad-58f5-8a91-7da670a82ecf with scrape type 2
2026-03-30 07:37:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c12f37d-99ad-58f5-8a91-7da670a82ecf, identifier: FP18966
2026-03-30 07:37:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c12f37d-99ad-58f5-8a91-7da670a82ecf with identifier: FP18966
2026-03-30 07:37:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c12f37d-99ad-58f5-8a91-7da670a82ecf with identifier: FP18966
2026-03-30 07:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c12f37d-99ad-58f5-8a91-7da670a82ecf with identifier: FP18966 to the API
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 315,
 'expiration_date': '2026-03-31T15:56:35Z',
 'fuel_type': 'petrol',
 'id': '9c12f37d-99ad-58f5-8a91-7da670a82ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP18966',
 'listing': 'auction',
 'make': 'Cadillac',
 'model': 'XT5',
 'odometer': 159098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-02',
 'seller_name': None,
 'title': 'Cadillac XT5 3.6 V6 Luxury AWD',
 'transmission': 'automatic',
 'trim': 'Luxury AWD',
 'year': 2018}
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP18966%27 HTTP/1.1" 200 None
2026-03-30 07:37:30 [auto1.de] INFO: Saving data for FP18966: {'auction_closing_time': 1774972595.0, 'created_time': 1773686299.787126, 'last_price_update_time': 1774856250.331794}
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP18966') HTTP/1.1" 204 0
2026-03-30 07:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c19de2c2-7436-52b8-a310-a4a002377738 with identifier: LX46621
2026-03-30 07:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c19de2c2-7436-52b8-a310-a4a002377738 with identifier: LX46621
2026-03-30 07:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c19de2c2-7436-52b8-a310-a4a002377738 with identifier: LX46621 to the API
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LX46621>
{'auction_title': '',
 'c_o_2_emission_value': 21,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '0.8L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:12:43Z',
 'fuel_type': 'hybrid',
 'id': 'c19de2c2-7436-52b8-a310-a4a002377738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX46621',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Mazda',
 'model': 'MX-30',
 'odometer': 11458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_8032e21dc6f9c49139ecc25baf2cf285.jpg',
                'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_f28638e11a615e6b29bbdcb668f168a8.jpg',
                'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_0b5797cc3eef1182d1567a4145f9531e.jpg',
                'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_ebfde4f5b3ba156a52e6e439ab3b836e.jpg',
                'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_2ab8db21197d00bda052dcbeecc6ceb3.jpg',
                'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_b292299e969c31a03f346e7e88e14310.jpg',
                'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_8e174172bf49c8bd757a5bf83602c2be.jpg',
                'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_d4988fcdfa2d0a804d211da211fe646e.jpg',
                'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_95ee0f15a0d8815347dac6cd8309304b.jpg',
                'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_67815c833c88a242805901a2182fced5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19de2c2-7436-52b8-a310-a4a002377738/c19de2c2-7436-52b8-a310-a4a002377738_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_8032e21dc6f9c49139ecc25baf2cf285.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19de2c2-7436-52b8-a310-a4a002377738/c19de2c2-7436-52b8-a310-a4a002377738_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74292,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_f28638e11a615e6b29bbdcb668f168a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19de2c2-7436-52b8-a310-a4a002377738/c19de2c2-7436-52b8-a310-a4a002377738_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81783,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_0b5797cc3eef1182d1567a4145f9531e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19de2c2-7436-52b8-a310-a4a002377738/c19de2c2-7436-52b8-a310-a4a002377738_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_ebfde4f5b3ba156a52e6e439ab3b836e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19de2c2-7436-52b8-a310-a4a002377738/c19de2c2-7436-52b8-a310-a4a002377738_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_2ab8db21197d00bda052dcbeecc6ceb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19de2c2-7436-52b8-a310-a4a002377738/c19de2c2-7436-52b8-a310-a4a002377738_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_b292299e969c31a03f346e7e88e14310.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19de2c2-7436-52b8-a310-a4a002377738/c19de2c2-7436-52b8-a310-a4a002377738_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_8e174172bf49c8bd757a5bf83602c2be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19de2c2-7436-52b8-a310-a4a002377738/c19de2c2-7436-52b8-a310-a4a002377738_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83089,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_d4988fcdfa2d0a804d211da211fe646e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19de2c2-7436-52b8-a310-a4a002377738/c19de2c2-7436-52b8-a310-a4a002377738_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_95ee0f15a0d8815347dac6cd8309304b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c19de2c2-7436-52b8-a310-a4a002377738/c19de2c2-7436-52b8-a310-a4a002377738_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img84/28/8428e1d38a809be0f05607539790265e/pa/LX46621_67815c833c88a242805901a2182fced5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2024-11-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda MX-30 electric drive 125 kW Exclusive-Line R-EV',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line R-EV',
 'year': 2024}
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX46621%27 HTTP/1.1" 200 None
2026-03-30 07:37:30 [auto1.de] INFO: Saving data for LX46621: {'created_time': 1774856250.720172, 'last_price_update_time': 1774856250.720184, 'auction_closing_time': 1774969963.0}
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX46621') HTTP/1.1" 204 0
2026-03-30 07:37:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c12f37d-99ad-58f5-8a91-7da670a82ecf with identifier: FP18966
2026-03-30 07:37:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c12f37d-99ad-58f5-8a91-7da670a82ecf with identifier: FP18966
2026-03-30 07:37:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c12f37d-99ad-58f5-8a91-7da670a82ecf with identifier: FP18966 to the API
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 315,
 'expiration_date': '2026-03-31T15:56:35Z',
 'fuel_type': 'petrol',
 'id': '9c12f37d-99ad-58f5-8a91-7da670a82ecf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP18966',
 'listing': 'auction',
 'make': 'Cadillac',
 'model': 'XT5',
 'odometer': 159098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-02',
 'seller_name': None,
 'title': 'Cadillac XT5 3.6 V6 Luxury AWD',
 'transmission': 'automatic',
 'trim': 'Luxury AWD',
 'year': 2018}
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP18966%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Saving data for FP18966: {'auction_closing_time': 1774972595.0, 'created_time': 1773686299.787126, 'last_price_update_time': 1774856251.014797}
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP18966') HTTP/1.1" 204 0
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: LU76842
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU76842%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for LU76842: 2
2026-03-30 07:37:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95db2445-7459-532e-955d-0d5fd2bff52b with identifier: LU76842
2026-03-30 07:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95db2445-7459-532e-955d-0d5fd2bff52b with scrape type 2
2026-03-30 07:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95db2445-7459-532e-955d-0d5fd2bff52b with scrape type 2
2026-03-30 07:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95db2445-7459-532e-955d-0d5fd2bff52b, identifier: LU76842
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_b40a3706f4a1ad0981c8cc154175c528.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_b40a3706f4a1ad0981c8cc154175c528.jpg not downloaded yet
2026-03-30 07:37:31 [auto1.de] INFO: Found listing with ID: LU76842
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU76842%27 HTTP/1.1" 200 None
2026-03-30 07:37:31 [auto1.de] INFO: Scrape type for LU76842: 2
2026-03-30 07:37:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95db2445-7459-532e-955d-0d5fd2bff52b with scrape type 2
2026-03-30 07:37:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95db2445-7459-532e-955d-0d5fd2bff52b with scrape type 2
2026-03-30 07:37:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95db2445-7459-532e-955d-0d5fd2bff52b, identifier: LU76842
2026-03-30 07:37:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95db2445-7459-532e-955d-0d5fd2bff52b with identifier: LU76842
2026-03-30 07:37:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95db2445-7459-532e-955d-0d5fd2bff52b with identifier: LU76842
2026-03-30 07:37:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95db2445-7459-532e-955d-0d5fd2bff52b with identifier: LU76842 to the API
2026-03-30 07:37:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:12:14Z',
 'fuel_type': 'petrol',
 'id': '95db2445-7459-532e-955d-0d5fd2bff52b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU76842',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 98283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-22',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Eco',
 'transmission': 'manual',
 'trim': 'Eco',
 'year': 2009}
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU76842%27 HTTP/1.1" 200 None
2026-03-30 07:37:32 [auto1.de] INFO: Saving data for LU76842: {'auction_closing_time': 1774969934.0, 'created_time': 1773225943.979772, 'last_price_update_time': 1774856252.463257}
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU76842') HTTP/1.1" 204 0
2026-03-30 07:37:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95db2445-7459-532e-955d-0d5fd2bff52b with identifier: LU76842
2026-03-30 07:37:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95db2445-7459-532e-955d-0d5fd2bff52b with identifier: LU76842
2026-03-30 07:37:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95db2445-7459-532e-955d-0d5fd2bff52b with identifier: LU76842 to the API
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:12:14Z',
 'fuel_type': 'petrol',
 'id': '95db2445-7459-532e-955d-0d5fd2bff52b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU76842',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 98283,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-22',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Eco',
 'transmission': 'manual',
 'trim': 'Eco',
 'year': 2009}
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU76842%27 HTTP/1.1" 200 None
2026-03-30 07:37:32 [auto1.de] INFO: Saving data for LU76842: {'auction_closing_time': 1774969934.0, 'created_time': 1773225943.979772, 'last_price_update_time': 1774856252.758502}
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LU76842') HTTP/1.1" 204 0
2026-03-30 07:37:32 [auto1.de] INFO: Found listing with ID: HE37410
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE37410%27 HTTP/1.1" 200 None
2026-03-30 07:37:32 [auto1.de] INFO: Scrape type for HE37410: 2
2026-03-30 07:37:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 934c80fe-c2d9-5e61-aa4c-f0396e44eabd with identifier: HE37410
2026-03-30 07:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 934c80fe-c2d9-5e61-aa4c-f0396e44eabd with scrape type 2
2026-03-30 07:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 934c80fe-c2d9-5e61-aa4c-f0396e44eabd with scrape type 2
2026-03-30 07:37:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 934c80fe-c2d9-5e61-aa4c-f0396e44eabd, identifier: HE37410
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_45207f76cd82cb63dda6c98706bac157.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_45207f76cd82cb63dda6c98706bac157.jpg not downloaded yet
2026-03-30 07:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF57490> (referer: https://www.auto1.com/v1/car-details-view/CF57490/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:32 [auto1.de] INFO: Found listing with ID: HE37410
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE37410%27 HTTP/1.1" 200 None
2026-03-30 07:37:32 [auto1.de] INFO: Scrape type for HE37410: 2
2026-03-30 07:37:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 934c80fe-c2d9-5e61-aa4c-f0396e44eabd with scrape type 2
2026-03-30 07:37:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 934c80fe-c2d9-5e61-aa4c-f0396e44eabd with scrape type 2
2026-03-30 07:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 934c80fe-c2d9-5e61-aa4c-f0396e44eabd, identifier: HE37410
2026-03-30 07:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 934c80fe-c2d9-5e61-aa4c-f0396e44eabd with identifier: HE37410
2026-03-30 07:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 934c80fe-c2d9-5e61-aa4c-f0396e44eabd with identifier: HE37410
2026-03-30 07:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 934c80fe-c2d9-5e61-aa4c-f0396e44eabd with identifier: HE37410 to the API
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:42:20Z',
 'fuel_type': 'petrol',
 'id': '934c80fe-c2d9-5e61-aa4c-f0396e44eabd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE37410',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 125405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-27',
 'seller_name': None,
 'title': 'Mazda 2 1.3 Impuls',
 'transmission': 'manual',
 'trim': 'Impuls',
 'year': 2008}
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE37410%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Saving data for HE37410: {'auction_closing_time': 1774971740.0, 'created_time': 1774350743.655855, 'last_price_update_time': 1774856253.357098}
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE37410') HTTP/1.1" 204 0
2026-03-30 07:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 934c80fe-c2d9-5e61-aa4c-f0396e44eabd with identifier: HE37410
2026-03-30 07:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 934c80fe-c2d9-5e61-aa4c-f0396e44eabd with identifier: HE37410
2026-03-30 07:37:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 934c80fe-c2d9-5e61-aa4c-f0396e44eabd with identifier: HE37410 to the API
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:42:20Z',
 'fuel_type': 'petrol',
 'id': '934c80fe-c2d9-5e61-aa4c-f0396e44eabd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE37410',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 125405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-27',
 'seller_name': None,
 'title': 'Mazda 2 1.3 Impuls',
 'transmission': 'manual',
 'trim': 'Impuls',
 'year': 2008}
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE37410%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Saving data for HE37410: {'auction_closing_time': 1774971740.0, 'created_time': 1774350743.655855, 'last_price_update_time': 1774856253.659672}
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE37410') HTTP/1.1" 204 0
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: EN21542
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN21542%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for EN21542: 2
2026-03-30 07:37:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1 with identifier: EN21542
2026-03-30 07:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1 with scrape type 2
2026-03-30 07:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1 with scrape type 2
2026-03-30 07:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1, identifier: EN21542
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_1e7ae875bffd9dcd11da892e03b60fda.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_1e7ae875bffd9dcd11da892e03b60fda.jpg not downloaded yet
2026-03-30 07:37:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_52fb3b33531732ed29f9cf590666a164.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:33 [auto1.de] INFO: Found listing with ID: EN21542
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN21542%27 HTTP/1.1" 200 None
2026-03-30 07:37:33 [auto1.de] INFO: Scrape type for EN21542: 2
2026-03-30 07:37:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1 with scrape type 2
2026-03-30 07:37:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1 with scrape type 2
2026-03-30 07:37:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1, identifier: EN21542
2026-03-30 07:37:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1 with identifier: EN21542
2026-03-30 07:37:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1 with identifier: EN21542
2026-03-30 07:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1 with identifier: EN21542 to the API
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:30:04Z',
 'fuel_type': 'diesel',
 'id': 'd95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN21542',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 177645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-01',
 'seller_name': None,
 'title': 'Opel Vivaro 2.0 CDTI Kombi L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kombi L1H1 2,7t',
 'year': 2011}
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN21542%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Saving data for EN21542: {'auction_closing_time': 1774971004.0, 'created_time': 1774435075.345352, 'last_price_update_time': 1774856254.314865}
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN21542') HTTP/1.1" 204 0
2026-03-30 07:37:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1 with identifier: EN21542
2026-03-30 07:37:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1 with identifier: EN21542
2026-03-30 07:37:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1 with identifier: EN21542 to the API
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:30:04Z',
 'fuel_type': 'diesel',
 'id': 'd95ec5d5-0ec5-5853-8d6a-e8f7fd443cd1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN21542',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 177645,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-01',
 'seller_name': None,
 'title': 'Opel Vivaro 2.0 CDTI Kombi L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kombi L1H1 2,7t',
 'year': 2011}
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN21542%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Saving data for EN21542: {'auction_closing_time': 1774971004.0, 'created_time': 1774435075.345352, 'last_price_update_time': 1774856254.72518}
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN21542') HTTP/1.1" 204 0
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: PW82256
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: LT86298
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT86298%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for LT86298: 2
2026-03-30 07:37:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f6f3dd3-718b-5f01-b581-793433cfe648 with identifier: LT86298
2026-03-30 07:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f6f3dd3-718b-5f01-b581-793433cfe648 with scrape type 2
2026-03-30 07:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f6f3dd3-718b-5f01-b581-793433cfe648 with scrape type 2
2026-03-30 07:37:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f6f3dd3-718b-5f01-b581-793433cfe648, identifier: LT86298
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_8ccf1a815c1973805986d807965bb3a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_8ccf1a815c1973805986d807965bb3a9.jpg not downloaded yet
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: PW82256
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: ZU35260
2026-03-30 07:37:34 [auto1.de] INFO: Found listing with ID: LT86298
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT86298%27 HTTP/1.1" 200 None
2026-03-30 07:37:34 [auto1.de] INFO: Scrape type for LT86298: 2
2026-03-30 07:37:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f6f3dd3-718b-5f01-b581-793433cfe648 with scrape type 2
2026-03-30 07:37:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f6f3dd3-718b-5f01-b581-793433cfe648 with scrape type 2
2026-03-30 07:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f6f3dd3-718b-5f01-b581-793433cfe648, identifier: LT86298
2026-03-30 07:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f6f3dd3-718b-5f01-b581-793433cfe648 with identifier: LT86298
2026-03-30 07:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f6f3dd3-718b-5f01-b581-793433cfe648 with identifier: LT86298
2026-03-30 07:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f6f3dd3-718b-5f01-b581-793433cfe648 with identifier: LT86298 to the API
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-31T15:46:59Z',
 'fuel_type': 'hybrid',
 'id': '3f6f3dd3-718b-5f01-b581-793433cfe648',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT86298',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 113733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT86298%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Saving data for LT86298: {'auction_closing_time': 1774972019.0, 'created_time': 1773380495.871291, 'last_price_update_time': 1774856255.364911}
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT86298') HTTP/1.1" 204 0
2026-03-30 07:37:35 [auto1.de] INFO: Channel: 24h | Page: 15 | totalHits: 7718 | hits on page: 40
2026-03-30 07:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 249be1cd-e54e-502f-9f1f-5e5ad650e251 with identifier: CF57490
2026-03-30 07:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 249be1cd-e54e-502f-9f1f-5e5ad650e251 with scrape type 1
2026-03-30 07:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 249be1cd-e54e-502f-9f1f-5e5ad650e251
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_4720e6809d8351f5a59c9bc379f4597d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_4720e6809d8351f5a59c9bc379f4597d.jpg not downloaded yet
2026-03-30 07:37:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_b40a3706f4a1ad0981c8cc154175c528.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f6f3dd3-718b-5f01-b581-793433cfe648 with identifier: LT86298
2026-03-30 07:37:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f6f3dd3-718b-5f01-b581-793433cfe648 with identifier: LT86298
2026-03-30 07:37:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f6f3dd3-718b-5f01-b581-793433cfe648 with identifier: LT86298 to the API
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-31T15:46:59Z',
 'fuel_type': 'hybrid',
 'id': '3f6f3dd3-718b-5f01-b581-793433cfe648',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT86298',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 113733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'BMW X3 xDrive 30e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT86298%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Saving data for LT86298: {'auction_closing_time': 1774972019.0, 'created_time': 1773380495.871291, 'last_price_update_time': 1774856255.846983}
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT86298') HTTP/1.1" 204 0
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: KK61253
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: KK35526
2026-03-30 07:37:35 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW77341%27 HTTP/1.1" 200 None
2026-03-30 07:37:35 [auto1.de] INFO: Scrape type for VW77341: 2
2026-03-30 07:37:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba27f12e-5513-5513-aa76-0437e6f51d77 with identifier: VW77341
2026-03-30 07:37:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba27f12e-5513-5513-aa76-0437e6f51d77 with scrape type 2
2026-03-30 07:37:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba27f12e-5513-5513-aa76-0437e6f51d77 with scrape type 2
2026-03-30 07:37:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba27f12e-5513-5513-aa76-0437e6f51d77, identifier: VW77341
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_7f64d59048a9f552e37875e93ffda648.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_7f64d59048a9f552e37875e93ffda648.jpg not downloaded yet
2026-03-30 07:37:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_45207f76cd82cb63dda6c98706bac157.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: KK61253
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: KK35526
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: VW77341
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW77341%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for VW77341: 2
2026-03-30 07:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba27f12e-5513-5513-aa76-0437e6f51d77 with scrape type 2
2026-03-30 07:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba27f12e-5513-5513-aa76-0437e6f51d77 with scrape type 2
2026-03-30 07:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba27f12e-5513-5513-aa76-0437e6f51d77, identifier: VW77341
2026-03-30 07:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba27f12e-5513-5513-aa76-0437e6f51d77 with identifier: VW77341
2026-03-30 07:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba27f12e-5513-5513-aa76-0437e6f51d77 with identifier: VW77341
2026-03-30 07:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba27f12e-5513-5513-aa76-0437e6f51d77 with identifier: VW77341 to the API
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:09:40Z',
 'fuel_type': 'diesel',
 'id': 'ba27f12e-5513-5513-aa76-0437e6f51d77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW77341',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 203377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-28',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW77341%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Saving data for VW77341: {'auction_closing_time': 1774969780.0, 'created_time': 1773687092.691398, 'last_price_update_time': 1774856256.493915}
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW77341') HTTP/1.1" 204 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: NH44567
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: YB27715
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB27715%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Scrape type for YB27715: 2
2026-03-30 07:37:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38230ab5-6ee7-5b57-806a-6667a3d0d8c3 with identifier: YB27715
2026-03-30 07:37:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38230ab5-6ee7-5b57-806a-6667a3d0d8c3 with scrape type 2
2026-03-30 07:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38230ab5-6ee7-5b57-806a-6667a3d0d8c3 with scrape type 2
2026-03-30 07:37:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38230ab5-6ee7-5b57-806a-6667a3d0d8c3, identifier: YB27715
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_ea21d2447a6b055d6c400416cb794bb7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_ea21d2447a6b055d6c400416cb794bb7.jpg not downloaded yet
2026-03-30 07:37:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2daa810>
2026-03-30 07:37:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_52fb3b33531732ed29f9cf590666a164.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_52fb3b33531732ed29f9cf590666a164.jpg saved to cache
2026-03-30 07:37:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bacb1e58-88d6-580c-81ac-6cb6ac5ea74a
2026-03-30 07:37:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba27f12e-5513-5513-aa76-0437e6f51d77 with identifier: VW77341
2026-03-30 07:37:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba27f12e-5513-5513-aa76-0437e6f51d77 with identifier: VW77341
2026-03-30 07:37:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba27f12e-5513-5513-aa76-0437e6f51d77 with identifier: VW77341 to the API
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:09:40Z',
 'fuel_type': 'diesel',
 'id': 'ba27f12e-5513-5513-aa76-0437e6f51d77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW77341',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 203377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-28',
 'seller_name': None,
 'title': 'Renault Megane 1.6 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW77341%27 HTTP/1.1" 200 None
2026-03-30 07:37:36 [auto1.de] INFO: Saving data for VW77341: {'auction_closing_time': 1774969780.0, 'created_time': 1773687092.691398, 'last_price_update_time': 1774856256.975703}
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW77341') HTTP/1.1" 204 0
2026-03-30 07:37:36 [auto1.de] INFO: Found listing with ID: WZ77198
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ77198%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Scrape type for WZ77198: 2
2026-03-30 07:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d539f1e-b499-555c-90e4-f53a72ffa482 with identifier: WZ77198
2026-03-30 07:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d539f1e-b499-555c-90e4-f53a72ffa482 with scrape type 2
2026-03-30 07:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d539f1e-b499-555c-90e4-f53a72ffa482 with scrape type 2
2026-03-30 07:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d539f1e-b499-555c-90e4-f53a72ffa482, identifier: WZ77198
2026-03-30 07:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38230ab5-6ee7-5b57-806a-6667a3d0d8c3 with identifier: YB27715
2026-03-30 07:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38230ab5-6ee7-5b57-806a-6667a3d0d8c3 with identifier: YB27715
2026-03-30 07:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38230ab5-6ee7-5b57-806a-6667a3d0d8c3 with identifier: YB27715 to the API
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:16:26Z',
 'fuel_type': 'petrol',
 'id': '38230ab5-6ee7-5b57-806a-6667a3d0d8c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB27715',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 155037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-08',
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2008}
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB27715%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Saving data for YB27715: {'auction_closing_time': 1774970186.0, 'created_time': 1774638693.036324, 'last_price_update_time': 1774856257.46711}
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB27715') HTTP/1.1" 204 0
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: WZ77198
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ77198%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Scrape type for WZ77198: 2
2026-03-30 07:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d539f1e-b499-555c-90e4-f53a72ffa482 with scrape type 2
2026-03-30 07:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d539f1e-b499-555c-90e4-f53a72ffa482 with scrape type 2
2026-03-30 07:37:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d539f1e-b499-555c-90e4-f53a72ffa482, identifier: WZ77198
2026-03-30 07:37:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d539f1e-b499-555c-90e4-f53a72ffa482 with identifier: WZ77198
2026-03-30 07:37:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d539f1e-b499-555c-90e4-f53a72ffa482 with identifier: WZ77198
2026-03-30 07:37:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d539f1e-b499-555c-90e4-f53a72ffa482 with identifier: WZ77198 to the API
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:51:39Z',
 'fuel_type': 'petrol',
 'id': '9d539f1e-b499-555c-90e4-f53a72ffa482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ77198',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 258880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2004}
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ77198%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Saving data for WZ77198: {'auction_closing_time': 1774972299.0, 'created_time': 1774380345.981157, 'last_price_update_time': 1774856257.939756}
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ77198') HTTP/1.1" 204 0
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: RC35240
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: CN96399
2026-03-30 07:37:37 [auto1.de] INFO: Found listing with ID: SW53580
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW53580%27 HTTP/1.1" 200 None
2026-03-30 07:37:37 [auto1.de] INFO: Scrape type for SW53580: 2
2026-03-30 07:37:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac280568-d725-51a7-b0ba-295cb4bc8488 with identifier: SW53580
2026-03-30 07:37:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac280568-d725-51a7-b0ba-295cb4bc8488 with scrape type 2
2026-03-30 07:37:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac280568-d725-51a7-b0ba-295cb4bc8488 with scrape type 2
2026-03-30 07:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac280568-d725-51a7-b0ba-295cb4bc8488, identifier: SW53580
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_7bcb26a3682229538ecfe2450809dc79.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_7bcb26a3682229538ecfe2450809dc79.jpg not downloaded yet
2026-03-30 07:37:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d230d610>
2026-03-30 07:37:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_b40a3706f4a1ad0981c8cc154175c528.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_b40a3706f4a1ad0981c8cc154175c528.jpg saved to cache
2026-03-30 07:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bacb1e58-88d6-580c-81ac-6cb6ac5ea74a
2026-03-30 07:37:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_1e7ae875bffd9dcd11da892e03b60fda.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d539f1e-b499-555c-90e4-f53a72ffa482 with identifier: WZ77198
2026-03-30 07:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d539f1e-b499-555c-90e4-f53a72ffa482 with identifier: WZ77198
2026-03-30 07:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d539f1e-b499-555c-90e4-f53a72ffa482 with identifier: WZ77198 to the API
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:51:39Z',
 'fuel_type': 'petrol',
 'id': '9d539f1e-b499-555c-90e4-f53a72ffa482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ77198',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 258880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2004}
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ77198%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Saving data for WZ77198: {'auction_closing_time': 1774972299.0, 'created_time': 1774380345.981157, 'last_price_update_time': 1774856258.429887}
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ77198') HTTP/1.1" 204 0
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: TG94099
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-30 07:37:38 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC27013%27 HTTP/1.1" 200 None
2026-03-30 07:37:38 [auto1.de] INFO: Scrape type for UC27013: 2
2026-03-30 07:37:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c with identifier: UC27013
2026-03-30 07:37:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c with scrape type 2
2026-03-30 07:37:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c with scrape type 2
2026-03-30 07:37:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c, identifier: UC27013
2026-03-30 07:37:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac280568-d725-51a7-b0ba-295cb4bc8488 with identifier: SW53580
2026-03-30 07:37:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac280568-d725-51a7-b0ba-295cb4bc8488 with identifier: SW53580
2026-03-30 07:37:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac280568-d725-51a7-b0ba-295cb4bc8488 with identifier: SW53580 to the API
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-31T15:40:35Z',
 'fuel_type': 'petrol',
 'id': 'ac280568-d725-51a7-b0ba-295cb4bc8488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW53580',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLS-Klasse',
 'odometer': 241603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-07',
 'seller_name': None,
 'title': 'Mercedes-Benz GLS-Klasse GLS 400 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2016}
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW53580%27 HTTP/1.1" 200 None
2026-03-30 07:37:39 [auto1.de] INFO: Saving data for SW53580: {'auction_closing_time': 1774971635.0, 'created_time': 1773687183.454689, 'last_price_update_time': 1774856259.014003}
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW53580') HTTP/1.1" 204 0
2026-03-30 07:37:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e7a410>
2026-03-30 07:37:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_45207f76cd82cb63dda6c98706bac157.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_45207f76cd82cb63dda6c98706bac157.jpg saved to cache
2026-03-30 07:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bacb1e58-88d6-580c-81ac-6cb6ac5ea74a
2026-03-30 07:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_8ccf1a815c1973805986d807965bb3a9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:39 [auto1.de] INFO: Found listing with ID: TG94099
2026-03-30 07:37:39 [auto1.de] INFO: Found listing with ID: YU83796
2026-03-30 07:37:39 [auto1.de] INFO: Found listing with ID: UC27013
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC27013%27 HTTP/1.1" 200 None
2026-03-30 07:37:39 [auto1.de] INFO: Scrape type for UC27013: 2
2026-03-30 07:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c with scrape type 2
2026-03-30 07:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c with scrape type 2
2026-03-30 07:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c, identifier: UC27013
2026-03-30 07:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c with identifier: UC27013
2026-03-30 07:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c with identifier: UC27013
2026-03-30 07:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c with identifier: UC27013 to the API
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:55:19Z',
 'fuel_type': 'petrol',
 'id': '0934b9e8-c8ad-5fbb-8399-20d5aaf8768c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC27013',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 105146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC27013%27 HTTP/1.1" 200 None
2026-03-30 07:37:39 [auto1.de] INFO: Saving data for UC27013: {'auction_closing_time': 1774972519.0, 'created_time': 1773380964.650978, 'last_price_update_time': 1774856259.547905}
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC27013') HTTP/1.1" 204 0
2026-03-30 07:37:39 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM53141%27 HTTP/1.1" 200 None
2026-03-30 07:37:39 [auto1.de] INFO: Scrape type for CM53141: 2
2026-03-30 07:37:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2510d610-bf60-580d-b089-6f452162088d with identifier: CM53141
2026-03-30 07:37:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2510d610-bf60-580d-b089-6f452162088d with scrape type 2
2026-03-30 07:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2510d610-bf60-580d-b089-6f452162088d with scrape type 2
2026-03-30 07:37:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2510d610-bf60-580d-b089-6f452162088d, identifier: CM53141
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_5fc26166dc4841ce39f61855106007de.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_5fc26166dc4841ce39f61855106007de.jpg not downloaded yet
2026-03-30 07:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_7f64d59048a9f552e37875e93ffda648.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_4720e6809d8351f5a59c9bc379f4597d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c with identifier: UC27013
2026-03-30 07:37:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c with identifier: UC27013
2026-03-30 07:37:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0934b9e8-c8ad-5fbb-8399-20d5aaf8768c with identifier: UC27013 to the API
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:55:19Z',
 'fuel_type': 'petrol',
 'id': '0934b9e8-c8ad-5fbb-8399-20d5aaf8768c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC27013',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 105146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-26',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC27013%27 HTTP/1.1" 200 None
2026-03-30 07:37:39 [auto1.de] INFO: Saving data for UC27013: {'auction_closing_time': 1774972519.0, 'created_time': 1773380964.650978, 'last_price_update_time': 1774856259.988814}
2026-03-30 07:37:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC27013') HTTP/1.1" 204 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ07036%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for HJ07036: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: ZL07849
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: CK09368
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: TX17036
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: NH50671
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH50671%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for NH50671: 1
2026-03-30 07:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2510d610-bf60-580d-b089-6f452162088d with identifier: CM53141
2026-03-30 07:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2510d610-bf60-580d-b089-6f452162088d with identifier: CM53141
2026-03-30 07:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2510d610-bf60-580d-b089-6f452162088d with identifier: CM53141 to the API
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:44:41Z',
 'fuel_type': 'petrol',
 'id': '2510d610-bf60-580d-b089-6f452162088d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM53141',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 92159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-15',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2017}
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM53141%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Saving data for CM53141: {'auction_closing_time': 1774971881.0, 'created_time': 1773381185.275353, 'last_price_update_time': 1774856260.42824}
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM53141') HTTP/1.1" 204 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: HJ07036
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ07036%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for HJ07036: 0
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: BR53160
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU01908%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for ZU01908: 2
2026-03-30 07:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00472d49-e3ef-5ccf-a895-64e77d225ac9 with identifier: ZU01908
2026-03-30 07:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00472d49-e3ef-5ccf-a895-64e77d225ac9 with scrape type 2
2026-03-30 07:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00472d49-e3ef-5ccf-a895-64e77d225ac9 with scrape type 2
2026-03-30 07:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00472d49-e3ef-5ccf-a895-64e77d225ac9, identifier: ZU01908
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_9929eaa4fdbc467bb00fdb8edb1e61f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_9929eaa4fdbc467bb00fdb8edb1e61f2.jpg not downloaded yet
2026-03-30 07:37:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2388e10>
2026-03-30 07:37:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_1e7ae875bffd9dcd11da892e03b60fda.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_1e7ae875bffd9dcd11da892e03b60fda.jpg saved to cache
2026-03-30 07:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bacb1e58-88d6-580c-81ac-6cb6ac5ea74a
2026-03-30 07:37:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_ea21d2447a6b055d6c400416cb794bb7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:40 [auto1.de] INFO: Found listing with ID: JZ46683
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ46683%27 HTTP/1.1" 200 None
2026-03-30 07:37:40 [auto1.de] INFO: Scrape type for JZ46683: 2
2026-03-30 07:37:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 902583de-410c-5ef5-b968-87a7257d7eb7 with identifier: JZ46683
2026-03-30 07:37:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 902583de-410c-5ef5-b968-87a7257d7eb7 with scrape type 2
2026-03-30 07:37:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 902583de-410c-5ef5-b968-87a7257d7eb7 with scrape type 2
2026-03-30 07:37:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 902583de-410c-5ef5-b968-87a7257d7eb7, identifier: JZ46683
2026-03-30 07:37:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00472d49-e3ef-5ccf-a895-64e77d225ac9 with identifier: ZU01908
2026-03-30 07:37:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00472d49-e3ef-5ccf-a895-64e77d225ac9 with identifier: ZU01908
2026-03-30 07:37:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00472d49-e3ef-5ccf-a895-64e77d225ac9 with identifier: ZU01908 to the API
2026-03-30 07:37:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:16:57Z',
 'fuel_type': 'diesel',
 'id': '00472d49-e3ef-5ccf-a895-64e77d225ac9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU01908',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 140140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2018}
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU01908%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [auto1.de] INFO: Saving data for ZU01908: {'auction_closing_time': 1774970217.0, 'created_time': 1773138353.474004, 'last_price_update_time': 1774856261.223709}
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU01908') HTTP/1.1" 204 0
2026-03-30 07:37:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2dcde50>
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_8ccf1a815c1973805986d807965bb3a9.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_8ccf1a815c1973805986d807965bb3a9.jpg saved to cache
2026-03-30 07:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bacb1e58-88d6-580c-81ac-6cb6ac5ea74a
2026-03-30 07:37:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 902583de-410c-5ef5-b968-87a7257d7eb7 with identifier: JZ46683
2026-03-30 07:37:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 902583de-410c-5ef5-b968-87a7257d7eb7 with identifier: JZ46683
2026-03-30 07:37:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 902583de-410c-5ef5-b968-87a7257d7eb7 with identifier: JZ46683 to the API
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:34:15Z',
 'fuel_type': 'diesel',
 'id': '902583de-410c-5ef5-b968-87a7257d7eb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ46683',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 141278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-16',
 'seller_name': None,
 'title': 'Kia Sportage 1.7 CRDi Vision 2WD',
 'transmission': 'manual',
 'trim': 'Vision 2WD',
 'year': 2014}
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ46683%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [auto1.de] INFO: Saving data for JZ46683: {'auction_closing_time': 1774971255.0, 'created_time': 1773304332.84685, 'last_price_update_time': 1774856261.625276}
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ46683') HTTP/1.1" 204 0
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: SB15541
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB15541%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [auto1.de] INFO: Scrape type for SB15541: 1
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_74db19a47cb253bf377ae09d8aa6dfa3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_74db19a47cb253bf377ae09d8aa6dfa3.jpg not downloaded yet
2026-03-30 07:37:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_7bcb26a3682229538ecfe2450809dc79.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: KT14337
2026-03-30 07:37:41 [auto1.de] INFO: Found listing with ID: VP04465
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP04465%27 HTTP/1.1" 200 None
2026-03-30 07:37:41 [auto1.de] INFO: Scrape type for VP04465: 2
2026-03-30 07:37:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28cc7e76-b50f-5506-b8fc-d97370e9b358 with identifier: VP04465
2026-03-30 07:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28cc7e76-b50f-5506-b8fc-d97370e9b358 with scrape type 2
2026-03-30 07:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28cc7e76-b50f-5506-b8fc-d97370e9b358 with scrape type 2
2026-03-30 07:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 28cc7e76-b50f-5506-b8fc-d97370e9b358, identifier: VP04465
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2fe1310>
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fde%252Fdede28cdaeedae7522ae20a510810dac%252Fpa%252FFF52766_7f64d59048a9f552e37875e93ffda648.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_7f64d59048a9f552e37875e93ffda648.jpg saved to cache
2026-03-30 07:37:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bacb1e58-88d6-580c-81ac-6cb6ac5ea74a
2026-03-30 07:37:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bacb1e58-88d6-580c-81ac-6cb6ac5ea74a, skipping ID generation
2026-03-30 07:37:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bacb1e58-88d6-580c-81ac-6cb6ac5ea74a with scrape type 1
2026-03-30 07:37:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bacb1e58-88d6-580c-81ac-6cb6ac5ea74a sending to next pipeline
2026-03-30 07:37:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bacb1e58-88d6-580c-81ac-6cb6ac5ea74a, identifier: FF52766
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2ebf750>
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_4720e6809d8351f5a59c9bc379f4597d.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_4720e6809d8351f5a59c9bc379f4597d.jpg saved to cache
2026-03-30 07:37:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 249be1cd-e54e-502f-9f1f-5e5ad650e251
2026-03-30 07:37:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 28cc7e76-b50f-5506-b8fc-d97370e9b358 with identifier: VP04465
2026-03-30 07:37:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 28cc7e76-b50f-5506-b8fc-d97370e9b358 with identifier: VP04465
2026-03-30 07:37:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 28cc7e76-b50f-5506-b8fc-d97370e9b358 with identifier: VP04465 to the API
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:00:42Z',
 'fuel_type': 'diesel',
 'id': '28cc7e76-b50f-5506-b8fc-d97370e9b358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP04465',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 191470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-20',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI clean diesel Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2015}
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP04465%27 HTTP/1.1" 200 None
2026-03-30 07:37:42 [auto1.de] INFO: Saving data for VP04465: {'auction_closing_time': 1774969242.0, 'created_time': 1774463750.055681, 'last_price_update_time': 1774856262.992947}
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP04465') HTTP/1.1" 204 0
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: CX00387
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: ZJ50870
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ50870%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for ZJ50870: 2
2026-03-30 07:37:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef4e2919-8b9c-5b60-b87a-c03168d24cbd with identifier: ZJ50870
2026-03-30 07:37:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef4e2919-8b9c-5b60-b87a-c03168d24cbd with scrape type 2
2026-03-30 07:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef4e2919-8b9c-5b60-b87a-c03168d24cbd with scrape type 2
2026-03-30 07:37:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef4e2919-8b9c-5b60-b87a-c03168d24cbd, identifier: ZJ50870
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_7d38b424ba7b7f1da8040867d11dec18.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_7d38b424ba7b7f1da8040867d11dec18.jpg not downloaded yet
2026-03-30 07:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bacb1e58-88d6-580c-81ac-6cb6ac5ea74a with identifier: FF52766
2026-03-30 07:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bacb1e58-88d6-580c-81ac-6cb6ac5ea74a with identifier: FF52766
2026-03-30 07:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bacb1e58-88d6-580c-81ac-6cb6ac5ea74a with identifier: FF52766 to the API
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_7f64d59048a9f552e37875e93ffda648.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:54:28Z',
 'fuel_type': 'diesel',
 'id': 'bacb1e58-88d6-580c-81ac-6cb6ac5ea74a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF52766',
 'listing': 'auction',
 'location': 'DE, Freiburg im Breisgau',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 237100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_52fb3b33531732ed29f9cf590666a164.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90179,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_b40a3706f4a1ad0981c8cc154175c528.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_45207f76cd82cb63dda6c98706bac157.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75999,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_1e7ae875bffd9dcd11da892e03b60fda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89802,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_8ccf1a815c1973805986d807965bb3a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bacb1e58-88d6-580c-81ac-6cb6ac5ea74a/bacb1e58-88d6-580c-81ac-6cb6ac5ea74a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60860,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/de/dede28cdaeedae7522ae20a510810dac/pa/FF52766_7f64d59048a9f552e37875e93ffda648.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Style BlueMotion',
 'transmission': 'manual',
 'trim': 'Style BlueMotion',
 'year': 2011}
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF52766%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Saving data for FF52766: {'created_time': 1774856263.568178, 'last_price_update_time': 1774856263.568195, 'auction_closing_time': 1774972468.0}
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FF52766') HTTP/1.1" 204 0
2026-03-30 07:37:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_5fc26166dc4841ce39f61855106007de.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: SE69152
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: UH00780
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: NN66793
2026-03-30 07:37:43 [auto1.de] INFO: Found listing with ID: MB72804
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB72804%27 HTTP/1.1" 200 None
2026-03-30 07:37:43 [auto1.de] INFO: Scrape type for MB72804: 1
2026-03-30 07:37:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef4e2919-8b9c-5b60-b87a-c03168d24cbd with identifier: ZJ50870
2026-03-30 07:37:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef4e2919-8b9c-5b60-b87a-c03168d24cbd with identifier: ZJ50870
2026-03-30 07:37:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef4e2919-8b9c-5b60-b87a-c03168d24cbd with identifier: ZJ50870 to the API
2026-03-30 07:37:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:41:12Z',
 'fuel_type': 'petrol',
 'id': 'ef4e2919-8b9c-5b60-b87a-c03168d24cbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZJ50870',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 111104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-07',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ50870%27 HTTP/1.1" 200 None
2026-03-30 07:37:44 [auto1.de] INFO: Saving data for ZJ50870: {'auction_closing_time': 1774971672.0, 'created_time': 1774348683.136289, 'last_price_update_time': 1774856264.484095}
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZJ50870') HTTP/1.1" 204 0
2026-03-30 07:37:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d76fd0>
2026-03-30 07:37:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_ea21d2447a6b055d6c400416cb794bb7.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_ea21d2447a6b055d6c400416cb794bb7.jpg saved to cache
2026-03-30 07:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 249be1cd-e54e-502f-9f1f-5e5ad650e251
2026-03-30 07:37:44 [auto1.de] INFO: Found listing with ID: SA09294
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA09294%27 HTTP/1.1" 200 None
2026-03-30 07:37:44 [auto1.de] INFO: Scrape type for SA09294: 2
2026-03-30 07:37:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c77d5a78-3598-5f54-8657-6a2632eb19c2 with identifier: SA09294
2026-03-30 07:37:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c77d5a78-3598-5f54-8657-6a2632eb19c2 with scrape type 2
2026-03-30 07:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c77d5a78-3598-5f54-8657-6a2632eb19c2 with scrape type 2
2026-03-30 07:37:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c77d5a78-3598-5f54-8657-6a2632eb19c2, identifier: SA09294
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_cb15ba0dd9b9c8e986094f24c6faa2d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_cb15ba0dd9b9c8e986094f24c6faa2d5.jpg not downloaded yet
2026-03-30 07:37:44 [auto1.de] INFO: Found listing with ID: XL83626
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL83626%27 HTTP/1.1" 200 None
2026-03-30 07:37:44 [auto1.de] INFO: Scrape type for XL83626: 1
2026-03-30 07:37:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c77d5a78-3598-5f54-8657-6a2632eb19c2 with identifier: SA09294
2026-03-30 07:37:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c77d5a78-3598-5f54-8657-6a2632eb19c2 with identifier: SA09294
2026-03-30 07:37:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c77d5a78-3598-5f54-8657-6a2632eb19c2 with identifier: SA09294 to the API
2026-03-30 07:37:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-31T15:31:48Z',
 'fuel_type': 'petrol',
 'id': 'c77d5a78-3598-5f54-8657-6a2632eb19c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA09294',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 157364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-14',
 'seller_name': None,
 'title': 'Mazda 6 2.0 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2010}
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA09294%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Saving data for SA09294: {'auction_closing_time': 1774971108.0, 'created_time': 1774637133.062065, 'last_price_update_time': 1774856265.141691}
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA09294') HTTP/1.1" 204 0
2026-03-30 07:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d91d5690>
2026-03-30 07:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_7bcb26a3682229538ecfe2450809dc79.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_7bcb26a3682229538ecfe2450809dc79.jpg saved to cache
2026-03-30 07:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 249be1cd-e54e-502f-9f1f-5e5ad650e251
2026-03-30 07:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_9929eaa4fdbc467bb00fdb8edb1e61f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: US58549
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US58549%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Scrape type for US58549: 1
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_2bc776101ec77910b992d110e762dd7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_2bc776101ec77910b992d110e762dd7a.jpg not downloaded yet
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: NH44567
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: YB27715
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB27715%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Scrape type for YB27715: 0
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: RC35240
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: CN96399
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: SW53580
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW53580%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Scrape type for SW53580: 0
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: CM53141
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM53141%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Scrape type for CM53141: 0
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: BR53160
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: ZU01908
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU01908%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Scrape type for ZU01908: 0
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: SB15541
2026-03-30 07:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f93b50>
2026-03-30 07:37:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_5fc26166dc4841ce39f61855106007de.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_5fc26166dc4841ce39f61855106007de.jpg saved to cache
2026-03-30 07:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 249be1cd-e54e-502f-9f1f-5e5ad650e251
2026-03-30 07:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_74db19a47cb253bf377ae09d8aa6dfa3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: XS09920
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS09920%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Scrape type for XS09920: 2
2026-03-30 07:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77972974-afc6-59c6-9112-1a7e0eb6474d with identifier: XS09920
2026-03-30 07:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77972974-afc6-59c6-9112-1a7e0eb6474d with scrape type 2
2026-03-30 07:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77972974-afc6-59c6-9112-1a7e0eb6474d with scrape type 2
2026-03-30 07:37:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77972974-afc6-59c6-9112-1a7e0eb6474d, identifier: XS09920
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_2ca1cb3df5ec7258d4948f8a24ddcc7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_2ca1cb3df5ec7258d4948f8a24ddcc7d.jpg not downloaded yet
2026-03-30 07:37:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77972974-afc6-59c6-9112-1a7e0eb6474d with identifier: XS09920
2026-03-30 07:37:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77972974-afc6-59c6-9112-1a7e0eb6474d with identifier: XS09920
2026-03-30 07:37:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77972974-afc6-59c6-9112-1a7e0eb6474d with identifier: XS09920 to the API
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:09:41Z',
 'fuel_type': 'petrol',
 'id': '77972974-afc6-59c6-9112-1a7e0eb6474d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS09920',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 51418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-04',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS09920%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Saving data for XS09920: {'auction_closing_time': 1774969781.0, 'created_time': 1773689143.91746, 'last_price_update_time': 1774856265.826149}
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS09920') HTTP/1.1" 204 0
2026-03-30 07:37:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_7d38b424ba7b7f1da8040867d11dec18.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: TB77328
2026-03-30 07:37:45 [auto1.de] INFO: Found listing with ID: TH98147
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH98147%27 HTTP/1.1" 200 None
2026-03-30 07:37:45 [auto1.de] INFO: Scrape type for TH98147: 2
2026-03-30 07:37:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d2a4398-f37a-5d49-846b-f8e030c3614a with identifier: TH98147
2026-03-30 07:37:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d2a4398-f37a-5d49-846b-f8e030c3614a with scrape type 2
2026-03-30 07:37:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d2a4398-f37a-5d49-846b-f8e030c3614a with scrape type 2
2026-03-30 07:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d2a4398-f37a-5d49-846b-f8e030c3614a, identifier: TH98147
2026-03-30 07:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24bb490>
2026-03-30 07:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_9929eaa4fdbc467bb00fdb8edb1e61f2.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_9929eaa4fdbc467bb00fdb8edb1e61f2.jpg saved to cache
2026-03-30 07:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 249be1cd-e54e-502f-9f1f-5e5ad650e251
2026-03-30 07:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_cb15ba0dd9b9c8e986094f24c6faa2d5.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d2a4398-f37a-5d49-846b-f8e030c3614a with identifier: TH98147
2026-03-30 07:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d2a4398-f37a-5d49-846b-f8e030c3614a with identifier: TH98147
2026-03-30 07:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d2a4398-f37a-5d49-846b-f8e030c3614a with identifier: TH98147 to the API
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:55:06Z',
 'fuel_type': 'diesel',
 'id': '1d2a4398-f37a-5d49-846b-f8e030c3614a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH98147',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 133310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-28',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten FWD',
 'transmission': 'manual',
 'trim': 'Kasten FWD',
 'year': 2021}
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH98147%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Saving data for TH98147: {'auction_closing_time': 1774972506.0, 'created_time': 1772727321.442733, 'last_price_update_time': 1774856266.526148}
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH98147') HTTP/1.1" 204 0
2026-03-30 07:37:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2fd1d90>
2026-03-30 07:37:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_74db19a47cb253bf377ae09d8aa6dfa3.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_74db19a47cb253bf377ae09d8aa6dfa3.jpg saved to cache
2026-03-30 07:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 249be1cd-e54e-502f-9f1f-5e5ad650e251
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: RE75426
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: ML92935
2026-03-30 07:37:46 [auto1.de] INFO: Found listing with ID: RZ20134
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ20134%27 HTTP/1.1" 200 None
2026-03-30 07:37:46 [auto1.de] INFO: Scrape type for RZ20134: 2
2026-03-30 07:37:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c58595cd-34e7-579c-988c-a5bde8ecf1f3 with identifier: RZ20134
2026-03-30 07:37:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c58595cd-34e7-579c-988c-a5bde8ecf1f3 with scrape type 2
2026-03-30 07:37:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c58595cd-34e7-579c-988c-a5bde8ecf1f3 with scrape type 2
2026-03-30 07:37:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c58595cd-34e7-579c-988c-a5bde8ecf1f3, identifier: RZ20134
2026-03-30 07:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NH50671/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_2bc776101ec77910b992d110e762dd7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c58595cd-34e7-579c-988c-a5bde8ecf1f3 with identifier: RZ20134
2026-03-30 07:37:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c58595cd-34e7-579c-988c-a5bde8ecf1f3 with identifier: RZ20134
2026-03-30 07:37:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c58595cd-34e7-579c-988c-a5bde8ecf1f3 with identifier: RZ20134 to the API
2026-03-30 07:37:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:48:03Z',
 'fuel_type': 'petrol',
 'id': 'c58595cd-34e7-579c-988c-a5bde8ecf1f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ20134',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 85387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-29',
 'seller_name': None,
 'title': 'Jeep Renegade 1.3 TGDi Limited 4x2',
 'transmission': 'automatic',
 'trim': 'Limited 4x2',
 'year': 2018}
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ20134%27 HTTP/1.1" 200 None
2026-03-30 07:37:47 [auto1.de] INFO: Saving data for RZ20134: {'auction_closing_time': 1774972083.0, 'created_time': 1773133078.570666, 'last_price_update_time': 1774856267.196931}
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ20134') HTTP/1.1" 204 0
2026-03-30 07:37:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d9497e50>
2026-03-30 07:37:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_7d38b424ba7b7f1da8040867d11dec18.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_7d38b424ba7b7f1da8040867d11dec18.jpg saved to cache
2026-03-30 07:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 249be1cd-e54e-502f-9f1f-5e5ad650e251
2026-03-30 07:37:47 [auto1.de] INFO: Found listing with ID: SB11032
2026-03-30 07:37:47 [auto1.de] INFO: Found listing with ID: GW45177
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW45177%27 HTTP/1.1" 200 None
2026-03-30 07:37:47 [auto1.de] INFO: Scrape type for GW45177: 2
2026-03-30 07:37:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ead70ac4-cb1e-5087-93d5-f627efe74ab4 with identifier: GW45177
2026-03-30 07:37:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ead70ac4-cb1e-5087-93d5-f627efe74ab4 with scrape type 2
2026-03-30 07:37:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ead70ac4-cb1e-5087-93d5-f627efe74ab4 with scrape type 2
2026-03-30 07:37:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ead70ac4-cb1e-5087-93d5-f627efe74ab4, identifier: GW45177
2026-03-30 07:37:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_2ca1cb3df5ec7258d4948f8a24ddcc7d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ead70ac4-cb1e-5087-93d5-f627efe74ab4 with identifier: GW45177
2026-03-30 07:37:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ead70ac4-cb1e-5087-93d5-f627efe74ab4 with identifier: GW45177
2026-03-30 07:37:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ead70ac4-cb1e-5087-93d5-f627efe74ab4 with identifier: GW45177 to the API
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:35:41Z',
 'fuel_type': 'petrol',
 'id': 'ead70ac4-cb1e-5087-93d5-f627efe74ab4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW45177',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 216821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-11',
 'seller_name': None,
 'title': 'Honda Civic 1.4 Type S',
 'transmission': 'manual',
 'trim': 'Type S',
 'year': 2009}
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW45177%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Saving data for GW45177: {'auction_closing_time': 1774971341.0, 'created_time': 1774380511.00545, 'last_price_update_time': 1774856268.051012}
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW45177') HTTP/1.1" 204 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: PH37878
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: TS70088
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: SR07530
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR07530%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for SR07530: 2
2026-03-30 07:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7099cd7-e87a-50f1-9784-146697c01215 with identifier: SR07530
2026-03-30 07:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7099cd7-e87a-50f1-9784-146697c01215 with scrape type 2
2026-03-30 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7099cd7-e87a-50f1-9784-146697c01215 with scrape type 2
2026-03-30 07:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7099cd7-e87a-50f1-9784-146697c01215, identifier: SR07530
2026-03-30 07:37:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB15541/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24ba950>
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_cb15ba0dd9b9c8e986094f24c6faa2d5.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_cb15ba0dd9b9c8e986094f24c6faa2d5.jpg saved to cache
2026-03-30 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 249be1cd-e54e-502f-9f1f-5e5ad650e251
2026-03-30 07:37:48 [auto1.de] INFO: Channel: 24h | Page: 16 | totalHits: 7739 | hits on page: 40
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d84550>
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_2bc776101ec77910b992d110e762dd7a.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_2bc776101ec77910b992d110e762dd7a.jpg saved to cache
2026-03-30 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 249be1cd-e54e-502f-9f1f-5e5ad650e251
2026-03-30 07:37:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7099cd7-e87a-50f1-9784-146697c01215 with identifier: SR07530
2026-03-30 07:37:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7099cd7-e87a-50f1-9784-146697c01215 with identifier: SR07530
2026-03-30 07:37:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7099cd7-e87a-50f1-9784-146697c01215 with identifier: SR07530 to the API
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:03:12Z',
 'fuel_type': 'petrol',
 'id': 'f7099cd7-e87a-50f1-9784-146697c01215',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR07530',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 121420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-09',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Trend 4WD',
 'transmission': 'automatic',
 'trim': 'Trend 4WD',
 'year': 2017}
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR07530%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Saving data for SR07530: {'auction_closing_time': 1774969392.0, 'created_time': 1774381204.412157, 'last_price_update_time': 1774856268.6151}
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR07530') HTTP/1.1" 204 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: ZG29710
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: HH97697
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH97697%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for HH97697: 2
2026-03-30 07:37:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dd7af8d-0401-5559-b238-fc39f2b61e82 with identifier: HH97697
2026-03-30 07:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dd7af8d-0401-5559-b238-fc39f2b61e82 with scrape type 2
2026-03-30 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dd7af8d-0401-5559-b238-fc39f2b61e82 with scrape type 2
2026-03-30 07:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dd7af8d-0401-5559-b238-fc39f2b61e82, identifier: HH97697
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: SB11032
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: GW45177
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW45177%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for GW45177: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: PH37878
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: TS70088
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: SR07530
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR07530%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for SR07530: 0
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: ZG29710
2026-03-30 07:37:48 [auto1.de] INFO: Found listing with ID: HH97697
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH97697%27 HTTP/1.1" 200 None
2026-03-30 07:37:48 [auto1.de] INFO: Scrape type for HH97697: 2
2026-03-30 07:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dd7af8d-0401-5559-b238-fc39f2b61e82 with scrape type 2
2026-03-30 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dd7af8d-0401-5559-b238-fc39f2b61e82 with scrape type 2
2026-03-30 07:37:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dd7af8d-0401-5559-b238-fc39f2b61e82, identifier: HH97697
2026-03-30 07:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2fa0d50>
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F47%252Fb847babc4a92139c360c85fce20a23d7%252Fpa%252FCF57490_2ca1cb3df5ec7258d4948f8a24ddcc7d.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_2ca1cb3df5ec7258d4948f8a24ddcc7d.jpg saved to cache
2026-03-30 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 249be1cd-e54e-502f-9f1f-5e5ad650e251
2026-03-30 07:37:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 249be1cd-e54e-502f-9f1f-5e5ad650e251, skipping ID generation
2026-03-30 07:37:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 249be1cd-e54e-502f-9f1f-5e5ad650e251 with scrape type 1
2026-03-30 07:37:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 249be1cd-e54e-502f-9f1f-5e5ad650e251 sending to next pipeline
2026-03-30 07:37:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 249be1cd-e54e-502f-9f1f-5e5ad650e251, identifier: CF57490
2026-03-30 07:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dd7af8d-0401-5559-b238-fc39f2b61e82 with identifier: HH97697
2026-03-30 07:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dd7af8d-0401-5559-b238-fc39f2b61e82 with identifier: HH97697
2026-03-30 07:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dd7af8d-0401-5559-b238-fc39f2b61e82 with identifier: HH97697 to the API
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:19:14Z',
 'fuel_type': 'diesel',
 'id': '6dd7af8d-0401-5559-b238-fc39f2b61e82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH97697',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 32223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-03',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH97697%27 HTTP/1.1" 200 None
2026-03-30 07:37:49 [auto1.de] INFO: Saving data for HH97697: {'auction_closing_time': 1774970354.0, 'created_time': 1773305582.788663, 'last_price_update_time': 1774856269.398929}
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH97697') HTTP/1.1" 204 0
2026-03-30 07:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dd7af8d-0401-5559-b238-fc39f2b61e82 with identifier: HH97697
2026-03-30 07:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dd7af8d-0401-5559-b238-fc39f2b61e82 with identifier: HH97697
2026-03-30 07:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dd7af8d-0401-5559-b238-fc39f2b61e82 with identifier: HH97697 to the API
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:19:14Z',
 'fuel_type': 'diesel',
 'id': '6dd7af8d-0401-5559-b238-fc39f2b61e82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH97697',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 32223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-03',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi',
 'transmission': 'automatic',
 'trim': '',
 'year': 2025}
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH97697%27 HTTP/1.1" 200 None
2026-03-30 07:37:49 [auto1.de] INFO: Saving data for HH97697: {'auction_closing_time': 1774970354.0, 'created_time': 1773305582.788663, 'last_price_update_time': 1774856269.803306}
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH97697') HTTP/1.1" 204 0
2026-03-30 07:37:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB72804/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 249be1cd-e54e-502f-9f1f-5e5ad650e251 with identifier: CF57490
2026-03-30 07:37:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 249be1cd-e54e-502f-9f1f-5e5ad650e251 with identifier: CF57490
2026-03-30 07:37:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 249be1cd-e54e-502f-9f1f-5e5ad650e251 with identifier: CF57490 to the API
2026-03-30 07:37:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_2ca1cb3df5ec7258d4948f8a24ddcc7d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 165,
 'expiration_date': '2026-03-31T15:27:36Z',
 'fuel_type': 'petrol',
 'id': '249be1cd-e54e-502f-9f1f-5e5ad650e251',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF57490',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Abarth',
 'model': '595C',
 'odometer': 23335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 19,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_4720e6809d8351f5a59c9bc379f4597d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99229,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_ea21d2447a6b055d6c400416cb794bb7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_7bcb26a3682229538ecfe2450809dc79.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91043,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_5fc26166dc4841ce39f61855106007de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_9929eaa4fdbc467bb00fdb8edb1e61f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97334,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_74db19a47cb253bf377ae09d8aa6dfa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_7d38b424ba7b7f1da8040867d11dec18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111908,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_cb15ba0dd9b9c8e986094f24c6faa2d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_2bc776101ec77910b992d110e762dd7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_249be1cd-e54e-502f-9f1f-5e5ad650e251/249be1cd-e54e-502f-9f1f-5e5ad650e251_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/47/b847babc4a92139c360c85fce20a23d7/pa/CF57490_2ca1cb3df5ec7258d4948f8a24ddcc7d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-12-15',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Abarth 595C 1.4 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF57490%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Saving data for CF57490: {'created_time': 1774856270.242346, 'last_price_update_time': 1774856270.242359, 'auction_closing_time': 1774970856.0}
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF57490') HTTP/1.1" 204 0
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: LZ90334
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: CD25494
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: XV83798
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: XC52601
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: EA67051
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: ZB59914
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59914%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for ZB59914: 1
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: LZ90334
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: CD25494
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: XV83798
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: XC52601
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: EA67051
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: ZB59914
2026-03-30 07:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL83626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/US58549/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: TJ43394
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ43394%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for TJ43394: 1
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: TJ43394
2026-03-30 07:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: LS48573
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS48573%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for LS48573: 1
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: LS48573
2026-03-30 07:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: ZT46656
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT46656%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for ZT46656: 2
2026-03-30 07:37:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6b19385-b02a-5ad8-aeb4-d2897cdf5530 with identifier: ZT46656
2026-03-30 07:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6b19385-b02a-5ad8-aeb4-d2897cdf5530 with scrape type 2
2026-03-30 07:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6b19385-b02a-5ad8-aeb4-d2897cdf5530 with scrape type 2
2026-03-30 07:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6b19385-b02a-5ad8-aeb4-d2897cdf5530, identifier: ZT46656
2026-03-30 07:37:50 [auto1.de] INFO: Found listing with ID: ZT46656
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT46656%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Scrape type for ZT46656: 2
2026-03-30 07:37:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6b19385-b02a-5ad8-aeb4-d2897cdf5530 with scrape type 2
2026-03-30 07:37:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6b19385-b02a-5ad8-aeb4-d2897cdf5530 with scrape type 2
2026-03-30 07:37:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6b19385-b02a-5ad8-aeb4-d2897cdf5530, identifier: ZT46656
2026-03-30 07:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6b19385-b02a-5ad8-aeb4-d2897cdf5530 with identifier: ZT46656
2026-03-30 07:37:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6b19385-b02a-5ad8-aeb4-d2897cdf5530 with identifier: ZT46656
2026-03-30 07:37:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6b19385-b02a-5ad8-aeb4-d2897cdf5530 with identifier: ZT46656 to the API
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:24:43Z',
 'fuel_type': 'petrol',
 'id': 'b6b19385-b02a-5ad8-aeb4-d2897cdf5530',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT46656',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 223714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-15',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT46656%27 HTTP/1.1" 200 None
2026-03-30 07:37:50 [auto1.de] INFO: Saving data for ZT46656: {'auction_closing_time': 1774970683.0, 'created_time': 1773227028.040891, 'last_price_update_time': 1774856270.935394}
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT46656') HTTP/1.1" 204 0
2026-03-30 07:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6b19385-b02a-5ad8-aeb4-d2897cdf5530 with identifier: ZT46656
2026-03-30 07:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6b19385-b02a-5ad8-aeb4-d2897cdf5530 with identifier: ZT46656
2026-03-30 07:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6b19385-b02a-5ad8-aeb4-d2897cdf5530 with identifier: ZT46656 to the API
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:24:43Z',
 'fuel_type': 'petrol',
 'id': 'b6b19385-b02a-5ad8-aeb4-d2897cdf5530',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT46656',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 223714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-15',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2010}
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT46656%27 HTTP/1.1" 200 None
2026-03-30 07:37:51 [auto1.de] INFO: Saving data for ZT46656: {'auction_closing_time': 1774970683.0, 'created_time': 1773227028.040891, 'last_price_update_time': 1774856271.322214}
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT46656') HTTP/1.1" 204 0
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: EV60549
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: XP13096
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: LZ55907
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: PY11088
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY11088%27 HTTP/1.1" 200 None
2026-03-30 07:37:51 [auto1.de] INFO: Scrape type for PY11088: 1
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: EV60549
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: XP13096
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: LZ55907
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: PY11088
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: NC09398
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC09398%27 HTTP/1.1" 200 None
2026-03-30 07:37:51 [auto1.de] INFO: Scrape type for NC09398: 1
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: NC09398
2026-03-30 07:37:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: RY54075
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY54075%27 HTTP/1.1" 200 None
2026-03-30 07:37:51 [auto1.de] INFO: Scrape type for RY54075: 2
2026-03-30 07:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa03bf37-1c83-58ed-b119-235359fdf8e9 with identifier: RY54075
2026-03-30 07:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa03bf37-1c83-58ed-b119-235359fdf8e9 with scrape type 2
2026-03-30 07:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa03bf37-1c83-58ed-b119-235359fdf8e9 with scrape type 2
2026-03-30 07:37:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa03bf37-1c83-58ed-b119-235359fdf8e9, identifier: RY54075
2026-03-30 07:37:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa03bf37-1c83-58ed-b119-235359fdf8e9 with identifier: RY54075
2026-03-30 07:37:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa03bf37-1c83-58ed-b119-235359fdf8e9 with identifier: RY54075
2026-03-30 07:37:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa03bf37-1c83-58ed-b119-235359fdf8e9 with identifier: RY54075 to the API
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:13:42Z',
 'fuel_type': 'diesel',
 'id': 'aa03bf37-1c83-58ed-b119-235359fdf8e9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY54075',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 83812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-30',
 'seller_name': None,
 'title': 'BMW 2er 220d Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY54075%27 HTTP/1.1" 200 None
2026-03-30 07:37:51 [auto1.de] INFO: Saving data for RY54075: {'auction_closing_time': 1774970022.0, 'created_time': 1774552711.715089, 'last_price_update_time': 1774856271.871069}
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY54075') HTTP/1.1" 204 0
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: SN65200
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: GW59315
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: KP40220
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP40220%27 HTTP/1.1" 200 None
2026-03-30 07:37:51 [auto1.de] INFO: Scrape type for KP40220: 1
2026-03-30 07:37:51 [auto1.de] INFO: Found listing with ID: LE91288
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE91288%27 HTTP/1.1" 200 None
2026-03-30 07:37:51 [auto1.de] INFO: Scrape type for LE91288: 2
2026-03-30 07:37:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50d673af-550e-50ce-8687-3e43e5030c66 with identifier: LE91288
2026-03-30 07:37:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50d673af-550e-50ce-8687-3e43e5030c66 with scrape type 2
2026-03-30 07:37:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50d673af-550e-50ce-8687-3e43e5030c66 with scrape type 2
2026-03-30 07:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50d673af-550e-50ce-8687-3e43e5030c66, identifier: LE91288
2026-03-30 07:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50d673af-550e-50ce-8687-3e43e5030c66 with identifier: LE91288
2026-03-30 07:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50d673af-550e-50ce-8687-3e43e5030c66 with identifier: LE91288
2026-03-30 07:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50d673af-550e-50ce-8687-3e43e5030c66 with identifier: LE91288 to the API
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-31T15:11:24Z',
 'fuel_type': 'hybrid',
 'id': '50d673af-550e-50ce-8687-3e43e5030c66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE91288',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 104726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-31',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2022}
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE91288%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Saving data for LE91288: {'auction_closing_time': 1774969884.0, 'created_time': 1774522209.491797, 'last_price_update_time': 1774856272.353136}
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE91288') HTTP/1.1" 204 0
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: MZ36812
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: FM88493
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: KX98673
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98673%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for KX98673: 2
2026-03-30 07:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf599741-5528-5135-989d-a5fed44ea21d with identifier: KX98673
2026-03-30 07:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf599741-5528-5135-989d-a5fed44ea21d with scrape type 2
2026-03-30 07:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf599741-5528-5135-989d-a5fed44ea21d with scrape type 2
2026-03-30 07:37:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf599741-5528-5135-989d-a5fed44ea21d, identifier: KX98673
2026-03-30 07:37:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf599741-5528-5135-989d-a5fed44ea21d with identifier: KX98673
2026-03-30 07:37:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf599741-5528-5135-989d-a5fed44ea21d with identifier: KX98673
2026-03-30 07:37:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf599741-5528-5135-989d-a5fed44ea21d with identifier: KX98673 to the API
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:18:36Z',
 'fuel_type': 'diesel',
 'id': 'cf599741-5528-5135-989d-a5fed44ea21d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX98673',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 115872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-15',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Tour',
 'transmission': 'automatic',
 'trim': 'Tour',
 'year': 2022}
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98673%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Saving data for KX98673: {'auction_closing_time': 1774970316.0, 'created_time': 1774522202.768531, 'last_price_update_time': 1774856272.950043}
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX98673') HTTP/1.1" 204 0
2026-03-30 07:37:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: XW15114
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: TC34492
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: CL81037
2026-03-30 07:37:52 [auto1.de] INFO: Found listing with ID: CX20587
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX20587%27 HTTP/1.1" 200 None
2026-03-30 07:37:52 [auto1.de] INFO: Scrape type for CX20587: 2
2026-03-30 07:37:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a892f8b4-eeb5-5ef6-be86-69186304502e with identifier: CX20587
2026-03-30 07:37:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a892f8b4-eeb5-5ef6-be86-69186304502e with scrape type 2
2026-03-30 07:37:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a892f8b4-eeb5-5ef6-be86-69186304502e with scrape type 2
2026-03-30 07:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a892f8b4-eeb5-5ef6-be86-69186304502e, identifier: CX20587
2026-03-30 07:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NH50671> (referer: https://www.auto1.com/v1/car-details-view/NH50671/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a892f8b4-eeb5-5ef6-be86-69186304502e with identifier: CX20587
2026-03-30 07:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a892f8b4-eeb5-5ef6-be86-69186304502e with identifier: CX20587
2026-03-30 07:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a892f8b4-eeb5-5ef6-be86-69186304502e with identifier: CX20587 to the API
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-31T15:25:08Z',
 'fuel_type': 'petrol',
 'id': 'a892f8b4-eeb5-5ef6-be86-69186304502e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX20587',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 84951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-29',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2023}
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX20587%27 HTTP/1.1" 200 None
2026-03-30 07:37:53 [auto1.de] INFO: Saving data for CX20587: {'auction_closing_time': 1774970708.0, 'created_time': 1774639827.985805, 'last_price_update_time': 1774856273.430681}
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX20587') HTTP/1.1" 204 0
2026-03-30 07:37:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: FA98768
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA98768%27 HTTP/1.1" 200 None
2026-03-30 07:37:53 [auto1.de] INFO: Scrape type for FA98768: 1
2026-03-30 07:37:53 [auto1.de] INFO: Channel: 24h | Page: 17 | totalHits: 7753 | hits on page: 40
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: VE81864
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE81864%27 HTTP/1.1" 200 None
2026-03-30 07:37:53 [auto1.de] INFO: Scrape type for VE81864: 2
2026-03-30 07:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cfd1879-c308-5642-802a-d8ea792aaf7e with identifier: VE81864
2026-03-30 07:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cfd1879-c308-5642-802a-d8ea792aaf7e with scrape type 2
2026-03-30 07:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cfd1879-c308-5642-802a-d8ea792aaf7e with scrape type 2
2026-03-30 07:37:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5cfd1879-c308-5642-802a-d8ea792aaf7e, identifier: VE81864
2026-03-30 07:37:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5cfd1879-c308-5642-802a-d8ea792aaf7e with identifier: VE81864
2026-03-30 07:37:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5cfd1879-c308-5642-802a-d8ea792aaf7e with identifier: VE81864
2026-03-30 07:37:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5cfd1879-c308-5642-802a-d8ea792aaf7e with identifier: VE81864 to the API
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:31:30Z',
 'fuel_type': 'petrol',
 'id': '5cfd1879-c308-5642-802a-d8ea792aaf7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE81864',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 53867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-05',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2019}
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE81864%27 HTTP/1.1" 200 None
2026-03-30 07:37:53 [auto1.de] INFO: Saving data for VE81864: {'auction_closing_time': 1774971090.0, 'created_time': 1773302726.384143, 'last_price_update_time': 1774856273.901355}
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE81864') HTTP/1.1" 204 0
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: MZ36812
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: FM88493
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: KX98673
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98673%27 HTTP/1.1" 200 None
2026-03-30 07:37:53 [auto1.de] INFO: Scrape type for KX98673: 0
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: XW15114
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: TC34492
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: CL81037
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: CX20587
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX20587%27 HTTP/1.1" 200 None
2026-03-30 07:37:53 [auto1.de] INFO: Scrape type for CX20587: 0
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: FA98768
2026-03-30 07:37:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 474f0d8c-6d4c-535a-9518-9133a31b6b20 with identifier: NH50671
2026-03-30 07:37:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 474f0d8c-6d4c-535a-9518-9133a31b6b20 with scrape type 1
2026-03-30 07:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 474f0d8c-6d4c-535a-9518-9133a31b6b20
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_202bdc9bf0f3c73d9f336868792db458.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_202bdc9bf0f3c73d9f336868792db458.jpg not downloaded yet
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: TD89084
2026-03-30 07:37:53 [auto1.de] INFO: Found listing with ID: NA47397
2026-03-30 07:37:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA47397%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for NA47397: 1
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: VE81864
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE81864%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for VE81864: 0
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: TD89084
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: NA47397
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_32ef90e416c068c151a53da8e34519ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_32ef90e416c068c151a53da8e34519ab.jpg not downloaded yet
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: NJ85165
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ85165%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for NJ85165: 1
2026-03-30 07:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB15541> (referer: https://www.auto1.com/v1/car-details-view/SB15541/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZB59914/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY11088/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ43394/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB72804> (referer: https://www.auto1.com/v1/car-details-view/MB72804/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: NJ85165
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_1dfe24adf8444c24ed93ad43d01501c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_1dfe24adf8444c24ed93ad43d01501c1.jpg not downloaded yet
2026-03-30 07:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: MS93141
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS93141%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for MS93141: 1
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: MS93141
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_f117064ab5d46c8e1301f6bafe78a43c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_f117064ab5d46c8e1301f6bafe78a43c.jpg not downloaded yet
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: PY91444
2026-03-30 07:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_202bdc9bf0f3c73d9f336868792db458.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: PY91444
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: MT16554
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT16554%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for MT16554: 1
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_f87b99d1ba30bc8a1bf61a2024c9b30c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_f87b99d1ba30bc8a1bf61a2024c9b30c.jpg not downloaded yet
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: UJ03238
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ03238%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for UJ03238: 1
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_e16cefc82cd51ae9259d710c24f70207.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_e16cefc82cd51ae9259d710c24f70207.jpg not downloaded yet
2026-03-30 07:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_32ef90e416c068c151a53da8e34519ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7574d6ac-1d68-5fb4-98c6-10ab125974d5 with identifier: SB15541
2026-03-30 07:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5 with scrape type 1
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_309dcb9792c5f56d918abe9bb664337a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_309dcb9792c5f56d918abe9bb664337a.jpg not downloaded yet
2026-03-30 07:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a7cab9-72fd-5d00-b950-bee55f17d6ed with identifier: MB72804
2026-03-30 07:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed with scrape type 1
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_77066dd344bf49d406ae925bb6452e39.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_77066dd344bf49d406ae925bb6452e39.jpg not downloaded yet
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: MJ68387
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ68387%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for MJ68387: 2
2026-03-30 07:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39da2092-2f6b-563d-926f-af346ca3a5b7 with identifier: MJ68387
2026-03-30 07:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39da2092-2f6b-563d-926f-af346ca3a5b7 with scrape type 2
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39da2092-2f6b-563d-926f-af346ca3a5b7 with scrape type 2
2026-03-30 07:37:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39da2092-2f6b-563d-926f-af346ca3a5b7, identifier: MJ68387
2026-03-30 07:37:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_1dfe24adf8444c24ed93ad43d01501c1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39da2092-2f6b-563d-926f-af346ca3a5b7 with identifier: MJ68387
2026-03-30 07:37:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39da2092-2f6b-563d-926f-af346ca3a5b7 with identifier: MJ68387
2026-03-30 07:37:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39da2092-2f6b-563d-926f-af346ca3a5b7 with identifier: MJ68387 to the API
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:27:28Z',
 'fuel_type': 'diesel',
 'id': '39da2092-2f6b-563d-926f-af346ca3a5b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ68387',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 347262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-12',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2013}
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ68387%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Saving data for MJ68387: {'auction_closing_time': 1774970848.0, 'created_time': 1774263257.029159, 'last_price_update_time': 1774856274.754765}
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ68387') HTTP/1.1" 204 0
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_0734c66a128fb1ba1b3b6aa274597b11.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_0734c66a128fb1ba1b3b6aa274597b11.jpg not downloaded yet
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_8a2a8c203fd7eb8a8b01e74b617c4731.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_8a2a8c203fd7eb8a8b01e74b617c4731.jpg not downloaded yet
2026-03-30 07:37:54 [auto1.de] INFO: Found listing with ID: CL53186
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL53186%27 HTTP/1.1" 200 None
2026-03-30 07:37:54 [auto1.de] INFO: Scrape type for CL53186: 2
2026-03-30 07:37:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3487a160-7e6d-5ee7-98f3-19e97ee2e1bf with identifier: CL53186
2026-03-30 07:37:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3487a160-7e6d-5ee7-98f3-19e97ee2e1bf with scrape type 2
2026-03-30 07:37:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3487a160-7e6d-5ee7-98f3-19e97ee2e1bf with scrape type 2
2026-03-30 07:37:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3487a160-7e6d-5ee7-98f3-19e97ee2e1bf, identifier: CL53186
2026-03-30 07:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_f117064ab5d46c8e1301f6bafe78a43c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3487a160-7e6d-5ee7-98f3-19e97ee2e1bf with identifier: CL53186
2026-03-30 07:37:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3487a160-7e6d-5ee7-98f3-19e97ee2e1bf with identifier: CL53186
2026-03-30 07:37:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3487a160-7e6d-5ee7-98f3-19e97ee2e1bf with identifier: CL53186 to the API
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:53:03Z',
 'fuel_type': 'diesel',
 'id': '3487a160-7e6d-5ee7-98f3-19e97ee2e1bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL53186',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 52694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2019}
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL53186%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Saving data for CL53186: {'auction_closing_time': 1774972383.0, 'created_time': 1773228454.992613, 'last_price_update_time': 1774856275.413409}
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL53186') HTTP/1.1" 204 0
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_db28aaa9ca23ddb982b102c255591084.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_db28aaa9ca23ddb982b102c255591084.jpg not downloaded yet
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_64713b1f94b70b5236c5d1c85161369b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_64713b1f94b70b5236c5d1c85161369b.jpg not downloaded yet
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f87250>
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_202bdc9bf0f3c73d9f336868792db458.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_202bdc9bf0f3c73d9f336868792db458.jpg saved to cache
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 474f0d8c-6d4c-535a-9518-9133a31b6b20
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2333490>
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_32ef90e416c068c151a53da8e34519ab.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_32ef90e416c068c151a53da8e34519ab.jpg saved to cache
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 474f0d8c-6d4c-535a-9518-9133a31b6b20
2026-03-30 07:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_f87b99d1ba30bc8a1bf61a2024c9b30c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: ZT52694
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT52694%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for ZT52694: 1
2026-03-30 07:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/US58549> (referer: https://www.auto1.com/v1/car-details-view/US58549/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e67450>
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_1dfe24adf8444c24ed93ad43d01501c1.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_1dfe24adf8444c24ed93ad43d01501c1.jpg saved to cache
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 474f0d8c-6d4c-535a-9518-9133a31b6b20
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_87d885e61cd757fcc2574db87146a3f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_87d885e61cd757fcc2574db87146a3f2.jpg not downloaded yet
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_6ce2fd58d60fe5592360e6f32024db15.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_6ce2fd58d60fe5592360e6f32024db15.jpg not downloaded yet
2026-03-30 07:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_77066dd344bf49d406ae925bb6452e39.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: VG52459
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: HX90718
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: VD66153
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: ZE47556
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: UX02896
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX02896%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for UX02896: 1
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2205850>
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_f117064ab5d46c8e1301f6bafe78a43c.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_f117064ab5d46c8e1301f6bafe78a43c.jpg saved to cache
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 474f0d8c-6d4c-535a-9518-9133a31b6b20
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_6c9d04290e9e73d517a3524a3ef1727e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_6c9d04290e9e73d517a3524a3ef1727e.jpg not downloaded yet
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_f01b270122c609809a1968a1f5407a99.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_f01b270122c609809a1968a1f5407a99.jpg not downloaded yet
2026-03-30 07:37:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL83626> (referer: https://www.auto1.com/v1/car-details-view/XL83626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:55 [auto1.de] INFO: Found listing with ID: DD06486
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD06486%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [auto1.de] INFO: Scrape type for DD06486: 1
2026-03-30 07:37:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_12b00b7bafd2bf6cdad52f91304005bf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_12b00b7bafd2bf6cdad52f91304005bf.jpg not downloaded yet
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_d140e1dce92b86b58776a9ce2bc2dee1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_d140e1dce92b86b58776a9ce2bc2dee1.jpg not downloaded yet
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24d9b90>
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_f87b99d1ba30bc8a1bf61a2024c9b30c.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_f87b99d1ba30bc8a1bf61a2024c9b30c.jpg saved to cache
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 474f0d8c-6d4c-535a-9518-9133a31b6b20
2026-03-30 07:37:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0 with identifier: US58549
2026-03-30 07:37:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0 with scrape type 1
2026-03-30 07:37:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F9d%252F2d9d1407f4d990c49ae12db25eab292a%252Fpa%252FUS58549_8b55dcb434ea315b34b54637e53baf74.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_8b55dcb434ea315b34b54637e53baf74.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F9d%252F2d9d1407f4d990c49ae12db25eab292a%252Fpa%252FUS58549_eef8be640abd5317b3597a9d7a598c1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_eef8be640abd5317b3597a9d7a598c1c.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F9d%252F2d9d1407f4d990c49ae12db25eab292a%252Fpa%252FUS58549_89f233cedac6b8e7481dd61f0b2ec8d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_89f233cedac6b8e7481dd61f0b2ec8d3.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F9d%252F2d9d1407f4d990c49ae12db25eab292a%252Fpa%252FUS58549_3842a642000ee30d0bc43cf508aec821.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_3842a642000ee30d0bc43cf508aec821.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F9d%252F2d9d1407f4d990c49ae12db25eab292a%252Fpa%252FUS58549_b2562ae89cc08e1ac0b1c08e72ff7187.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_b2562ae89cc08e1ac0b1c08e72ff7187.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F9d%252F2d9d1407f4d990c49ae12db25eab292a%252Fpa%252FUS58549_291b18bae55a23f8c22c854647f8096c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_291b18bae55a23f8c22c854647f8096c.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F9d%252F2d9d1407f4d990c49ae12db25eab292a%252Fpa%252FUS58549_b4890f6d16e4b850b68b08cc40da8525.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_b4890f6d16e4b850b68b08cc40da8525.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F9d%252F2d9d1407f4d990c49ae12db25eab292a%252Fpa%252FUS58549_3e204db7b84b8db0441bf77bce06522a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_3e204db7b84b8db0441bf77bce06522a.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F9d%252F2d9d1407f4d990c49ae12db25eab292a%252Fpa%252FUS58549_97beb977cb96390f236452c88d27d952.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_97beb977cb96390f236452c88d27d952.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252F9d%252F2d9d1407f4d990c49ae12db25eab292a%252Fpa%252FUS58549_dd20290b45677b079deadabfaba71dd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_dd20290b45677b079deadabfaba71dd3.jpg already downloaded
2026-03-30 07:37:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0, identifier: US58549
2026-03-30 07:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_8a2a8c203fd7eb8a8b01e74b617c4731.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_0734c66a128fb1ba1b3b6aa274597b11.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_64713b1f94b70b5236c5d1c85161369b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:56 [auto1.de] INFO: Found listing with ID: BF72847
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF72847%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [auto1.de] INFO: Scrape type for BF72847: 1
2026-03-30 07:37:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0 with identifier: US58549
2026-03-30 07:37:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0 with identifier: US58549
2026-03-30 07:37:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0 with identifier: US58549 to the API
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/US58549>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.1L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:42:39Z',
 'fuel_type': 'diesel',
 'id': 'a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US58549',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 176941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_8b55dcb434ea315b34b54637e53baf74.jpg',
                'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_eef8be640abd5317b3597a9d7a598c1c.jpg',
                'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_89f233cedac6b8e7481dd61f0b2ec8d3.jpg',
                'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_3842a642000ee30d0bc43cf508aec821.jpg',
                'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_b2562ae89cc08e1ac0b1c08e72ff7187.jpg',
                'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_291b18bae55a23f8c22c854647f8096c.jpg',
                'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_b4890f6d16e4b850b68b08cc40da8525.jpg',
                'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_3e204db7b84b8db0441bf77bce06522a.jpg',
                'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_97beb977cb96390f236452c88d27d952.jpg',
                'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_dd20290b45677b079deadabfaba71dd3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0/a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_8b55dcb434ea315b34b54637e53baf74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0/a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_eef8be640abd5317b3597a9d7a598c1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0/a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98882,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_89f233cedac6b8e7481dd61f0b2ec8d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0/a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3095741,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_3842a642000ee30d0bc43cf508aec821.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0/a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98429,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_b2562ae89cc08e1ac0b1c08e72ff7187.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0/a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102447,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_291b18bae55a23f8c22c854647f8096c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0/a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_b4890f6d16e4b850b68b08cc40da8525.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0/a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3316509,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_3e204db7b84b8db0441bf77bce06522a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0/a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_97beb977cb96390f236452c88d27d952.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0/a8d8b16a-84e3-5fef-9319-f2d4c6e2c4c0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/9d/2d9d1407f4d990c49ae12db25eab292a/pa/US58549_dd20290b45677b079deadabfaba71dd3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CDI T BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Elegance',
 'year': 2013}
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US58549%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [auto1.de] INFO: Saving data for US58549: {'created_time': 1774856276.698504, 'last_price_update_time': 1774856276.698518, 'auction_closing_time': 1774971759.0}
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US58549') HTTP/1.1" 204 0
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_325722c75ad52dc24bdfa921d8318253.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_325722c75ad52dc24bdfa921d8318253.jpg not downloaded yet
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_4357a97a8e87dc2591e859a895dd737f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_4357a97a8e87dc2591e859a895dd737f.jpg not downloaded yet
2026-03-30 07:37:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2fd1710>
2026-03-30 07:37:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_77066dd344bf49d406ae925bb6452e39.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_77066dd344bf49d406ae925bb6452e39.jpg saved to cache
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed
2026-03-30 07:37:56 [auto1.de] INFO: Found listing with ID: GB26940
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB26940%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [auto1.de] INFO: Scrape type for GB26940: 1
2026-03-30 07:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LS48573/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA98768/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP40220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC09398/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7163857-9bd7-5b98-a6ac-1f00846c8773 with identifier: XL83626
2026-03-30 07:37:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7163857-9bd7-5b98-a6ac-1f00846c8773 with scrape type 1
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7163857-9bd7-5b98-a6ac-1f00846c8773
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff5%252F16f5d1c17cff96517f48c79b1ab3c380%252Fpa%252FXL83626_ff26bcced32cf754b403e442ebedd647.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_ff26bcced32cf754b403e442ebedd647.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff5%252F16f5d1c17cff96517f48c79b1ab3c380%252Fpa%252FXL83626_6fe039b5a436bdae7deef974a100e6b0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_6fe039b5a436bdae7deef974a100e6b0.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff5%252F16f5d1c17cff96517f48c79b1ab3c380%252Fpa%252FXL83626_9a23c09fe31b6dbe7d8a2f5550b41852.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_9a23c09fe31b6dbe7d8a2f5550b41852.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff5%252F16f5d1c17cff96517f48c79b1ab3c380%252Fpa%252FXL83626_33960b7029ec320831f0f22ce2731a31.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_33960b7029ec320831f0f22ce2731a31.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff5%252F16f5d1c17cff96517f48c79b1ab3c380%252Fpa%252FXL83626_efca8cc5e22354e0586dd8c4e6e92944.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_efca8cc5e22354e0586dd8c4e6e92944.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff5%252F16f5d1c17cff96517f48c79b1ab3c380%252Fpa%252FXL83626_20706596be328307b94b254748f2686e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_20706596be328307b94b254748f2686e.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff5%252F16f5d1c17cff96517f48c79b1ab3c380%252Fpa%252FXL83626_6c61cb520a4f8729363a4d769c3c450a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_6c61cb520a4f8729363a4d769c3c450a.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff5%252F16f5d1c17cff96517f48c79b1ab3c380%252Fpa%252FXL83626_994e80527003d0aac1d0e97fd99f6f15.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_994e80527003d0aac1d0e97fd99f6f15.jpg already downloaded
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff5%252F16f5d1c17cff96517f48c79b1ab3c380%252Fpa%252FXL83626_b1350d40e27a0d038ae5048e0a192e89.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_b1350d40e27a0d038ae5048e0a192e89.jpg already downloaded
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg16%252Ff5%252F16f5d1c17cff96517f48c79b1ab3c380%252Fpa%252FXL83626_2c1562cff67ef12a22bc1b806ee39c57.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_2c1562cff67ef12a22bc1b806ee39c57.jpg already downloaded
2026-03-30 07:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7163857-9bd7-5b98-a6ac-1f00846c8773, identifier: XL83626
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_dee499afdcb123067b8d03a8775e53ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_dee499afdcb123067b8d03a8775e53ce.jpg not downloaded yet
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_e693167d4a0ff3d496669e5a5ab78f2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_e693167d4a0ff3d496669e5a5ab78f2c.jpg not downloaded yet
2026-03-30 07:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NA47397/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7163857-9bd7-5b98-a6ac-1f00846c8773 with identifier: XL83626
2026-03-30 07:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7163857-9bd7-5b98-a6ac-1f00846c8773 with identifier: XL83626
2026-03-30 07:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7163857-9bd7-5b98-a6ac-1f00846c8773 with identifier: XL83626 to the API
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XL83626>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-31T15:25:48Z',
 'fuel_type': 'petrol',
 'id': 'd7163857-9bd7-5b98-a6ac-1f00846c8773',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL83626',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 59538,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_ff26bcced32cf754b403e442ebedd647.jpg',
                'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_6fe039b5a436bdae7deef974a100e6b0.jpg',
                'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_9a23c09fe31b6dbe7d8a2f5550b41852.jpg',
                'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_33960b7029ec320831f0f22ce2731a31.jpg',
                'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_efca8cc5e22354e0586dd8c4e6e92944.jpg',
                'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_20706596be328307b94b254748f2686e.jpg',
                'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_6c61cb520a4f8729363a4d769c3c450a.jpg',
                'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_994e80527003d0aac1d0e97fd99f6f15.jpg',
                'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_b1350d40e27a0d038ae5048e0a192e89.jpg',
                'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_2c1562cff67ef12a22bc1b806ee39c57.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7163857-9bd7-5b98-a6ac-1f00846c8773/d7163857-9bd7-5b98-a6ac-1f00846c8773_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2518157,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_ff26bcced32cf754b403e442ebedd647.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7163857-9bd7-5b98-a6ac-1f00846c8773/d7163857-9bd7-5b98-a6ac-1f00846c8773_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_6fe039b5a436bdae7deef974a100e6b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7163857-9bd7-5b98-a6ac-1f00846c8773/d7163857-9bd7-5b98-a6ac-1f00846c8773_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_9a23c09fe31b6dbe7d8a2f5550b41852.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7163857-9bd7-5b98-a6ac-1f00846c8773/d7163857-9bd7-5b98-a6ac-1f00846c8773_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59773,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_33960b7029ec320831f0f22ce2731a31.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7163857-9bd7-5b98-a6ac-1f00846c8773/d7163857-9bd7-5b98-a6ac-1f00846c8773_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64890,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_efca8cc5e22354e0586dd8c4e6e92944.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7163857-9bd7-5b98-a6ac-1f00846c8773/d7163857-9bd7-5b98-a6ac-1f00846c8773_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_20706596be328307b94b254748f2686e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7163857-9bd7-5b98-a6ac-1f00846c8773/d7163857-9bd7-5b98-a6ac-1f00846c8773_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52953,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_6c61cb520a4f8729363a4d769c3c450a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7163857-9bd7-5b98-a6ac-1f00846c8773/d7163857-9bd7-5b98-a6ac-1f00846c8773_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_994e80527003d0aac1d0e97fd99f6f15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7163857-9bd7-5b98-a6ac-1f00846c8773/d7163857-9bd7-5b98-a6ac-1f00846c8773_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_b1350d40e27a0d038ae5048e0a192e89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7163857-9bd7-5b98-a6ac-1f00846c8773/d7163857-9bd7-5b98-a6ac-1f00846c8773_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2959119,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img16/f5/16f5d1c17cff96517f48c79b1ab3c380/pa/XL83626_2c1562cff67ef12a22bc1b806ee39c57.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-16',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Audi TT 2.0 TFSI Roadster',
 'transmission': 'manual',
 'trim': 'Roadster',
 'year': 2015}
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL83626%27 HTTP/1.1" 200 None
2026-03-30 07:37:57 [auto1.de] INFO: Saving data for XL83626: {'created_time': 1774856277.533379, 'last_price_update_time': 1774856277.533393, 'auction_closing_time': 1774970748.0}
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL83626') HTTP/1.1" 204 0
2026-03-30 07:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_6c9d04290e9e73d517a3524a3ef1727e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_f01b270122c609809a1968a1f5407a99.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:57 [auto1.de] INFO: Found listing with ID: VT33840
2026-03-30 07:37:57 [auto1.de] INFO: Found listing with ID: GC65720
2026-03-30 07:37:57 [auto1.de] INFO: Found listing with ID: FG52095
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG52095%27 HTTP/1.1" 200 None
2026-03-30 07:37:57 [auto1.de] INFO: Scrape type for FG52095: 2
2026-03-30 07:37:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b954da0-75f7-55fd-b2a2-19a6a40860df with identifier: FG52095
2026-03-30 07:37:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b954da0-75f7-55fd-b2a2-19a6a40860df with scrape type 2
2026-03-30 07:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b954da0-75f7-55fd-b2a2-19a6a40860df with scrape type 2
2026-03-30 07:37:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b954da0-75f7-55fd-b2a2-19a6a40860df, identifier: FG52095
2026-03-30 07:37:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d224cd10>
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_8a2a8c203fd7eb8a8b01e74b617c4731.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_8a2a8c203fd7eb8a8b01e74b617c4731.jpg saved to cache
2026-03-30 07:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2216150>
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_0734c66a128fb1ba1b3b6aa274597b11.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_0734c66a128fb1ba1b3b6aa274597b11.jpg saved to cache
2026-03-30 07:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e71590>
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_64713b1f94b70b5236c5d1c85161369b.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_64713b1f94b70b5236c5d1c85161369b.jpg saved to cache
2026-03-30 07:37:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed
2026-03-30 07:37:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b954da0-75f7-55fd-b2a2-19a6a40860df with identifier: FG52095
2026-03-30 07:37:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b954da0-75f7-55fd-b2a2-19a6a40860df with identifier: FG52095
2026-03-30 07:37:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b954da0-75f7-55fd-b2a2-19a6a40860df with identifier: FG52095 to the API
2026-03-30 07:37:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:50:17Z',
 'fuel_type': 'petrol',
 'id': '3b954da0-75f7-55fd-b2a2-19a6a40860df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG52095',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 75531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-05',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG52095%27 HTTP/1.1" 200 None
2026-03-30 07:37:58 [auto1.de] INFO: Saving data for FG52095: {'auction_closing_time': 1774972217.0, 'created_time': 1773400419.335248, 'last_price_update_time': 1774856278.1991}
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG52095') HTTP/1.1" 204 0
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_588ea5973d7ffc69e34944f69a8779ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_588ea5973d7ffc69e34944f69a8779ee.jpg not downloaded yet
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_3a99e0895847484e4d20165c0a5152da.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_3a99e0895847484e4d20165c0a5152da.jpg not downloaded yet
2026-03-30 07:37:58 [auto1.de] INFO: Found listing with ID: HR38686
2026-03-30 07:37:58 [auto1.de] INFO: Found listing with ID: VK11112
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK11112%27 HTTP/1.1" 200 None
2026-03-30 07:37:58 [auto1.de] INFO: Scrape type for VK11112: 2
2026-03-30 07:37:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e34e71e8-d153-566a-8cce-55c7f19683a8 with identifier: VK11112
2026-03-30 07:37:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e34e71e8-d153-566a-8cce-55c7f19683a8 with scrape type 2
2026-03-30 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e34e71e8-d153-566a-8cce-55c7f19683a8 with scrape type 2
2026-03-30 07:37:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e34e71e8-d153-566a-8cce-55c7f19683a8, identifier: VK11112
2026-03-30 07:37:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e34e71e8-d153-566a-8cce-55c7f19683a8 with identifier: VK11112
2026-03-30 07:37:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e34e71e8-d153-566a-8cce-55c7f19683a8 with identifier: VK11112
2026-03-30 07:37:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e34e71e8-d153-566a-8cce-55c7f19683a8 with identifier: VK11112 to the API
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:42:17Z',
 'fuel_type': 'petrol',
 'id': 'e34e71e8-d153-566a-8cce-55c7f19683a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK11112',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 135579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-10',
 'seller_name': None,
 'title': 'Mazda 3 1.6 Sport Active',
 'transmission': 'manual',
 'trim': 'Sport Active',
 'year': 2009}
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK11112%27 HTTP/1.1" 200 None
2026-03-30 07:37:58 [auto1.de] INFO: Saving data for VK11112: {'auction_closing_time': 1774971737.0, 'created_time': 1773775960.044503, 'last_price_update_time': 1774856278.852725}
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK11112') HTTP/1.1" 204 0
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_c16d31ffaf29e6939d9bfc2a02ce6f78.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_c16d31ffaf29e6939d9bfc2a02ce6f78.jpg not downloaded yet
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_dd477c8a26f81576f386625b9758c942.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_dd477c8a26f81576f386625b9758c942.jpg not downloaded yet
2026-03-30 07:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ85165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:58 [auto1.de] INFO: Channel: 24h | Page: 18 | totalHits: 7763 | hits on page: 40
2026-03-30 07:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23a8850>
2026-03-30 07:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_6c9d04290e9e73d517a3524a3ef1727e.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_6c9d04290e9e73d517a3524a3ef1727e.jpg saved to cache
2026-03-30 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5
2026-03-30 07:37:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:37:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d8e3b510>
2026-03-30 07:37:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:37:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_f01b270122c609809a1968a1f5407a99.jpg') HTTP/1.1" 204 0
2026-03-30 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_f01b270122c609809a1968a1f5407a99.jpg saved to cache
2026-03-30 07:37:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed
2026-03-30 07:37:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_6ce2fd58d60fe5592360e6f32024db15.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:58 [auto1.de] INFO: Found listing with ID: CX31809
2026-03-30 07:37:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX31809%27 HTTP/1.1" 200 None
2026-03-30 07:37:59 [auto1.de] INFO: Scrape type for CX31809: 1
2026-03-30 07:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_87d885e61cd757fcc2574db87146a3f2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_4357a97a8e87dc2591e859a895dd737f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_12b00b7bafd2bf6cdad52f91304005bf.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_325722c75ad52dc24bdfa921d8318253.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_d140e1dce92b86b58776a9ce2bc2dee1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:59 [auto1.de] INFO: Found listing with ID: HR38686
2026-03-30 07:37:59 [auto1.de] INFO: Found listing with ID: VK11112
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK11112%27 HTTP/1.1" 200 None
2026-03-30 07:37:59 [auto1.de] INFO: Scrape type for VK11112: 0
2026-03-30 07:37:59 [auto1.de] INFO: Found listing with ID: CX31809
2026-03-30 07:37:59 [auto1.de] INFO: Found listing with ID: XR03491
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR03491%27 HTTP/1.1" 200 None
2026-03-30 07:37:59 [auto1.de] INFO: Scrape type for XR03491: 2
2026-03-30 07:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 899682ef-c254-5499-b932-e863f69dfc08 with identifier: XR03491
2026-03-30 07:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 899682ef-c254-5499-b932-e863f69dfc08 with scrape type 2
2026-03-30 07:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 899682ef-c254-5499-b932-e863f69dfc08 with scrape type 2
2026-03-30 07:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 899682ef-c254-5499-b932-e863f69dfc08, identifier: XR03491
2026-03-30 07:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS93141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 899682ef-c254-5499-b932-e863f69dfc08 with identifier: XR03491
2026-03-30 07:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 899682ef-c254-5499-b932-e863f69dfc08 with identifier: XR03491
2026-03-30 07:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 899682ef-c254-5499-b932-e863f69dfc08 with identifier: XR03491 to the API
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:37:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:05:36Z',
 'fuel_type': 'petrol',
 'id': '899682ef-c254-5499-b932-e863f69dfc08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR03491',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 83508,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-15',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR03491%27 HTTP/1.1" 200 None
2026-03-30 07:37:59 [auto1.de] INFO: Saving data for XR03491: {'auction_closing_time': 1774969536.0, 'created_time': 1774035527.929562, 'last_price_update_time': 1774856279.508175}
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR03491') HTTP/1.1" 204 0
2026-03-30 07:37:59 [auto1.de] INFO: Found listing with ID: XR03491
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR03491%27 HTTP/1.1" 200 None
2026-03-30 07:37:59 [auto1.de] INFO: Scrape type for XR03491: 0
2026-03-30 07:37:59 [auto1.de] INFO: Found listing with ID: XN56575
2026-03-30 07:37:59 [auto1.de] INFO: Found listing with ID: CX99229
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX99229%27 HTTP/1.1" 200 None
2026-03-30 07:37:59 [auto1.de] INFO: Scrape type for CX99229: 1
2026-03-30 07:37:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:37:59 [auto1.de] INFO: Found listing with ID: XN56575
2026-03-30 07:37:59 [auto1.de] INFO: Found listing with ID: CX99229
2026-03-30 07:37:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_dd477c8a26f81576f386625b9758c942.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:37:59 [auto1.de] INFO: Found listing with ID: UB29489
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB29489%27 HTTP/1.1" 200 None
2026-03-30 07:37:59 [auto1.de] INFO: Scrape type for UB29489: 2
2026-03-30 07:37:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7052b629-d289-5468-b30b-fb88363b0671 with identifier: UB29489
2026-03-30 07:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7052b629-d289-5468-b30b-fb88363b0671 with scrape type 2
2026-03-30 07:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7052b629-d289-5468-b30b-fb88363b0671 with scrape type 2
2026-03-30 07:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7052b629-d289-5468-b30b-fb88363b0671, identifier: UB29489
2026-03-30 07:37:59 [auto1.de] INFO: Found listing with ID: UB29489
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB29489%27 HTTP/1.1" 200 None
2026-03-30 07:37:59 [auto1.de] INFO: Scrape type for UB29489: 2
2026-03-30 07:37:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7052b629-d289-5468-b30b-fb88363b0671 with scrape type 2
2026-03-30 07:37:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7052b629-d289-5468-b30b-fb88363b0671 with scrape type 2
2026-03-30 07:37:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7052b629-d289-5468-b30b-fb88363b0671, identifier: UB29489
2026-03-30 07:37:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7052b629-d289-5468-b30b-fb88363b0671 with identifier: UB29489
2026-03-30 07:37:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7052b629-d289-5468-b30b-fb88363b0671 with identifier: UB29489
2026-03-30 07:37:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7052b629-d289-5468-b30b-fb88363b0671 with identifier: UB29489 to the API
2026-03-30 07:37:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:08:23Z',
 'fuel_type': 'hybrid',
 'id': '7052b629-d289-5468-b30b-fb88363b0671',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB29489',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 71618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB29489%27 HTTP/1.1" 200 None
2026-03-30 07:38:00 [auto1.de] INFO: Saving data for UB29489: {'auction_closing_time': 1774969703.0, 'created_time': 1773776104.75521, 'last_price_update_time': 1774856280.141754}
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB29489') HTTP/1.1" 204 0
2026-03-30 07:38:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7052b629-d289-5468-b30b-fb88363b0671 with identifier: UB29489
2026-03-30 07:38:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7052b629-d289-5468-b30b-fb88363b0671 with identifier: UB29489
2026-03-30 07:38:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7052b629-d289-5468-b30b-fb88363b0671 with identifier: UB29489 to the API
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:08:23Z',
 'fuel_type': 'hybrid',
 'id': '7052b629-d289-5468-b30b-fb88363b0671',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB29489',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 71618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-14',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB29489%27 HTTP/1.1" 200 None
2026-03-30 07:38:00 [auto1.de] INFO: Saving data for UB29489: {'auction_closing_time': 1774969703.0, 'created_time': 1773776104.75521, 'last_price_update_time': 1774856280.52873}
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB29489') HTTP/1.1" 204 0
2026-03-30 07:38:00 [auto1.de] INFO: Found listing with ID: EC79499
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79499%27 HTTP/1.1" 200 None
2026-03-30 07:38:00 [auto1.de] INFO: Scrape type for EC79499: 2
2026-03-30 07:38:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 017920df-c4ca-50ce-aed5-5ece6de669f9 with identifier: EC79499
2026-03-30 07:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 017920df-c4ca-50ce-aed5-5ece6de669f9 with scrape type 2
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 017920df-c4ca-50ce-aed5-5ece6de669f9 with scrape type 2
2026-03-30 07:38:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 017920df-c4ca-50ce-aed5-5ece6de669f9, identifier: EC79499
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23a1550>
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_6ce2fd58d60fe5592360e6f32024db15.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_6ce2fd58d60fe5592360e6f32024db15.jpg saved to cache
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2101710>
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_87d885e61cd757fcc2574db87146a3f2.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_87d885e61cd757fcc2574db87146a3f2.jpg saved to cache
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2da6cd0>
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_4357a97a8e87dc2591e859a895dd737f.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_4357a97a8e87dc2591e859a895dd737f.jpg saved to cache
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d223ce90>
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_12b00b7bafd2bf6cdad52f91304005bf.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_12b00b7bafd2bf6cdad52f91304005bf.jpg saved to cache
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22e8a90>
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_325722c75ad52dc24bdfa921d8318253.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_325722c75ad52dc24bdfa921d8318253.jpg saved to cache
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d0cad0>
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_d140e1dce92b86b58776a9ce2bc2dee1.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_d140e1dce92b86b58776a9ce2bc2dee1.jpg saved to cache
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed
2026-03-30 07:38:00 [auto1.de] INFO: Found listing with ID: EC79499
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79499%27 HTTP/1.1" 200 None
2026-03-30 07:38:00 [auto1.de] INFO: Scrape type for EC79499: 2
2026-03-30 07:38:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 017920df-c4ca-50ce-aed5-5ece6de669f9 with scrape type 2
2026-03-30 07:38:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 017920df-c4ca-50ce-aed5-5ece6de669f9 with scrape type 2
2026-03-30 07:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 017920df-c4ca-50ce-aed5-5ece6de669f9, identifier: EC79499
2026-03-30 07:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 017920df-c4ca-50ce-aed5-5ece6de669f9 with identifier: EC79499
2026-03-30 07:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 017920df-c4ca-50ce-aed5-5ece6de669f9 with identifier: EC79499
2026-03-30 07:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 017920df-c4ca-50ce-aed5-5ece6de669f9 with identifier: EC79499 to the API
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:42:22Z',
 'fuel_type': 'diesel',
 'id': '017920df-c4ca-50ce-aed5-5ece6de669f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC79499',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 12092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2023}
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79499%27 HTTP/1.1" 200 None
2026-03-30 07:38:01 [auto1.de] INFO: Saving data for EC79499: {'auction_closing_time': 1774971742.0, 'created_time': 1774522322.973769, 'last_price_update_time': 1774856281.411057}
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC79499') HTTP/1.1" 204 0
2026-03-30 07:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 017920df-c4ca-50ce-aed5-5ece6de669f9 with identifier: EC79499
2026-03-30 07:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 017920df-c4ca-50ce-aed5-5ece6de669f9 with identifier: EC79499
2026-03-30 07:38:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 017920df-c4ca-50ce-aed5-5ece6de669f9 with identifier: EC79499 to the API
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:42:22Z',
 'fuel_type': 'diesel',
 'id': '017920df-c4ca-50ce-aed5-5ece6de669f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC79499',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 12092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2023}
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC79499%27 HTTP/1.1" 200 None
2026-03-30 07:38:01 [auto1.de] INFO: Saving data for EC79499: {'auction_closing_time': 1774971742.0, 'created_time': 1774522322.973769, 'last_price_update_time': 1774856281.724124}
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC79499') HTTP/1.1" 204 0
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: ZW29576
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW29576%27 HTTP/1.1" 200 None
2026-03-30 07:38:01 [auto1.de] INFO: Scrape type for ZW29576: 2
2026-03-30 07:38:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcec5902-46f0-5ab9-a410-423f8b3e074e with identifier: ZW29576
2026-03-30 07:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcec5902-46f0-5ab9-a410-423f8b3e074e with scrape type 2
2026-03-30 07:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcec5902-46f0-5ab9-a410-423f8b3e074e with scrape type 2
2026-03-30 07:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcec5902-46f0-5ab9-a410-423f8b3e074e, identifier: ZW29576
2026-03-30 07:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ43394> (referer: https://www.auto1.com/v1/car-details-view/TJ43394/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX02896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY11088> (referer: https://www.auto1.com/v1/car-details-view/PY11088/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MT16554/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e7cbd0>
2026-03-30 07:38:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_dd477c8a26f81576f386625b9758c942.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_dd477c8a26f81576f386625b9758c942.jpg saved to cache
2026-03-30 07:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed
2026-03-30 07:38:01 [auto1.de] INFO: Found listing with ID: ZW29576
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW29576%27 HTTP/1.1" 200 None
2026-03-30 07:38:01 [auto1.de] INFO: Scrape type for ZW29576: 2
2026-03-30 07:38:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcec5902-46f0-5ab9-a410-423f8b3e074e with scrape type 2
2026-03-30 07:38:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bcec5902-46f0-5ab9-a410-423f8b3e074e with scrape type 2
2026-03-30 07:38:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bcec5902-46f0-5ab9-a410-423f8b3e074e, identifier: ZW29576
2026-03-30 07:38:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcec5902-46f0-5ab9-a410-423f8b3e074e with identifier: ZW29576
2026-03-30 07:38:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcec5902-46f0-5ab9-a410-423f8b3e074e with identifier: ZW29576
2026-03-30 07:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcec5902-46f0-5ab9-a410-423f8b3e074e with identifier: ZW29576 to the API
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:43:37Z',
 'fuel_type': 'petrol',
 'id': 'bcec5902-46f0-5ab9-a410-423f8b3e074e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW29576',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 183382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Advantage blue 2WD',
 'transmission': 'manual',
 'trim': 'Advantage blue 2WD',
 'year': 2018}
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW29576%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Saving data for ZW29576: {'auction_closing_time': 1774971817.0, 'created_time': 1774294520.725473, 'last_price_update_time': 1774856282.368603}
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW29576') HTTP/1.1" 204 0
2026-03-30 07:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD06486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bcec5902-46f0-5ab9-a410-423f8b3e074e with identifier: ZW29576
2026-03-30 07:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bcec5902-46f0-5ab9-a410-423f8b3e074e with identifier: ZW29576
2026-03-30 07:38:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bcec5902-46f0-5ab9-a410-423f8b3e074e with identifier: ZW29576 to the API
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:43:37Z',
 'fuel_type': 'petrol',
 'id': 'bcec5902-46f0-5ab9-a410-423f8b3e074e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW29576',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 183382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Advantage blue 2WD',
 'transmission': 'manual',
 'trim': 'Advantage blue 2WD',
 'year': 2018}
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW29576%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Saving data for ZW29576: {'auction_closing_time': 1774971817.0, 'created_time': 1774294520.725473, 'last_price_update_time': 1774856282.675458}
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW29576') HTTP/1.1" 204 0
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: RJ65711
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ65711%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for RJ65711: 2
2026-03-30 07:38:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbbbf5f2-3be8-548c-a4b8-c6335dd548c3 with identifier: RJ65711
2026-03-30 07:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbbbf5f2-3be8-548c-a4b8-c6335dd548c3 with scrape type 2
2026-03-30 07:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbbbf5f2-3be8-548c-a4b8-c6335dd548c3 with scrape type 2
2026-03-30 07:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbbbf5f2-3be8-548c-a4b8-c6335dd548c3, identifier: RJ65711
2026-03-30 07:38:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:02 [auto1.de] INFO: Found listing with ID: RJ65711
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ65711%27 HTTP/1.1" 200 None
2026-03-30 07:38:02 [auto1.de] INFO: Scrape type for RJ65711: 2
2026-03-30 07:38:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbbbf5f2-3be8-548c-a4b8-c6335dd548c3 with scrape type 2
2026-03-30 07:38:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbbbf5f2-3be8-548c-a4b8-c6335dd548c3 with scrape type 2
2026-03-30 07:38:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbbbf5f2-3be8-548c-a4b8-c6335dd548c3, identifier: RJ65711
2026-03-30 07:38:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbbbf5f2-3be8-548c-a4b8-c6335dd548c3 with identifier: RJ65711
2026-03-30 07:38:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbbbf5f2-3be8-548c-a4b8-c6335dd548c3 with identifier: RJ65711
2026-03-30 07:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbbbf5f2-3be8-548c-a4b8-c6335dd548c3 with identifier: RJ65711 to the API
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:04:16Z',
 'fuel_type': 'diesel',
 'id': 'bbbbf5f2-3be8-548c-a4b8-c6335dd548c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ65711',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 17074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2023}
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ65711%27 HTTP/1.1" 200 None
2026-03-30 07:38:03 [auto1.de] INFO: Saving data for RJ65711: {'auction_closing_time': 1774969456.0, 'created_time': 1774467734.717471, 'last_price_update_time': 1774856283.276688}
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ65711') HTTP/1.1" 204 0
2026-03-30 07:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbbbf5f2-3be8-548c-a4b8-c6335dd548c3 with identifier: RJ65711
2026-03-30 07:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbbbf5f2-3be8-548c-a4b8-c6335dd548c3 with identifier: RJ65711
2026-03-30 07:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbbbf5f2-3be8-548c-a4b8-c6335dd548c3 with identifier: RJ65711 to the API
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:04:16Z',
 'fuel_type': 'diesel',
 'id': 'bbbbf5f2-3be8-548c-a4b8-c6335dd548c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ65711',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 17074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-16',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2023}
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ65711%27 HTTP/1.1" 200 None
2026-03-30 07:38:03 [auto1.de] INFO: Saving data for RJ65711: {'auction_closing_time': 1774969456.0, 'created_time': 1774467734.717471, 'last_price_update_time': 1774856283.588615}
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ65711') HTTP/1.1" 204 0
2026-03-30 07:38:03 [auto1.de] INFO: Found listing with ID: PT66900
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT66900%27 HTTP/1.1" 200 None
2026-03-30 07:38:03 [auto1.de] INFO: Scrape type for PT66900: 2
2026-03-30 07:38:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7066d314-3649-51ae-a7f8-aad35ba14b02 with identifier: PT66900
2026-03-30 07:38:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7066d314-3649-51ae-a7f8-aad35ba14b02 with scrape type 2
2026-03-30 07:38:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7066d314-3649-51ae-a7f8-aad35ba14b02 with scrape type 2
2026-03-30 07:38:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7066d314-3649-51ae-a7f8-aad35ba14b02, identifier: PT66900
2026-03-30 07:38:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7066d314-3649-51ae-a7f8-aad35ba14b02 with identifier: PT66900
2026-03-30 07:38:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7066d314-3649-51ae-a7f8-aad35ba14b02 with identifier: PT66900
2026-03-30 07:38:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7066d314-3649-51ae-a7f8-aad35ba14b02 with identifier: PT66900 to the API
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:01:33Z',
 'fuel_type': 'petrol',
 'id': '7066d314-3649-51ae-a7f8-aad35ba14b02',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT66900',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 19834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-02-11',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2025}
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT66900%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [auto1.de] INFO: Saving data for PT66900: {'auction_closing_time': 1774969293.0, 'created_time': 1774522321.145503, 'last_price_update_time': 1774856284.046976}
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT66900') HTTP/1.1" 204 0
2026-03-30 07:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB26940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94323638-e75a-5610-9408-d796c485f7cc with identifier: TJ43394
2026-03-30 07:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94323638-e75a-5610-9408-d796c485f7cc with scrape type 1
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94323638-e75a-5610-9408-d796c485f7cc
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_42f6ba0f634c162b2b9ce5914de4701a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_42f6ba0f634c162b2b9ce5914de4701a.jpg not downloaded yet
2026-03-30 07:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9db70db-d30a-551f-b940-764e64e56539 with identifier: PY11088
2026-03-30 07:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9db70db-d30a-551f-b940-764e64e56539 with scrape type 1
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e9db70db-d30a-551f-b940-764e64e56539
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Ff9%252F55f90408c9e043eaab459fb9296b16b5%252Fpa%252FPY11088_b954d6325a890a527a4f06d1c2905424.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_b954d6325a890a527a4f06d1c2905424.jpg already downloaded
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Ff9%252F55f90408c9e043eaab459fb9296b16b5%252Fpa%252FPY11088_a3ca5e3ea0ad428252f39a3c84a80a8b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_a3ca5e3ea0ad428252f39a3c84a80a8b.jpg already downloaded
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Ff9%252F55f90408c9e043eaab459fb9296b16b5%252Fpa%252FPY11088_69c8dafa39c05e1a6a5397134a4d6a4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_69c8dafa39c05e1a6a5397134a4d6a4c.jpg already downloaded
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Ff9%252F55f90408c9e043eaab459fb9296b16b5%252Fpa%252FPY11088_a9155e8769119863dc35f679e9bd9c3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_a9155e8769119863dc35f679e9bd9c3c.jpg already downloaded
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Ff9%252F55f90408c9e043eaab459fb9296b16b5%252Fpa%252FPY11088_e801dff9cd2ee58e975b31f3cd8f9915.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_e801dff9cd2ee58e975b31f3cd8f9915.jpg already downloaded
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Ff9%252F55f90408c9e043eaab459fb9296b16b5%252Fpa%252FPY11088_73e07be6b98d2c9437f087f3c05365f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_73e07be6b98d2c9437f087f3c05365f0.jpg already downloaded
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Ff9%252F55f90408c9e043eaab459fb9296b16b5%252Fpa%252FPY11088_c1befb0106f0fcfa27891983f5e7a4b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_c1befb0106f0fcfa27891983f5e7a4b7.jpg already downloaded
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Ff9%252F55f90408c9e043eaab459fb9296b16b5%252Fpa%252FPY11088_cf01da02227aff6a1449ae002a14001c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_cf01da02227aff6a1449ae002a14001c.jpg already downloaded
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Ff9%252F55f90408c9e043eaab459fb9296b16b5%252Fpa%252FPY11088_474aa45520a5ac7c18d464ea1661c44d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_474aa45520a5ac7c18d464ea1661c44d.jpg already downloaded
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg55%252Ff9%252F55f90408c9e043eaab459fb9296b16b5%252Fpa%252FPY11088_27fc49111056d80bcb7ba1bd3c414168.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_27fc49111056d80bcb7ba1bd3c414168.jpg already downloaded
2026-03-30 07:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9db70db-d30a-551f-b940-764e64e56539, identifier: PY11088
2026-03-30 07:38:04 [auto1.de] INFO: Found listing with ID: AH96089
2026-03-30 07:38:04 [auto1.de] INFO: Found listing with ID: MM27884
2026-03-30 07:38:04 [auto1.de] INFO: Found listing with ID: DD72399
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD72399%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [auto1.de] INFO: Scrape type for DD72399: 2
2026-03-30 07:38:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63134186-7aee-59b7-a942-0a4dace1f20e with identifier: DD72399
2026-03-30 07:38:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63134186-7aee-59b7-a942-0a4dace1f20e with scrape type 2
2026-03-30 07:38:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63134186-7aee-59b7-a942-0a4dace1f20e with scrape type 2
2026-03-30 07:38:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63134186-7aee-59b7-a942-0a4dace1f20e, identifier: DD72399
2026-03-30 07:38:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT52694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9db70db-d30a-551f-b940-764e64e56539 with identifier: PY11088
2026-03-30 07:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9db70db-d30a-551f-b940-764e64e56539 with identifier: PY11088
2026-03-30 07:38:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9db70db-d30a-551f-b940-764e64e56539 with identifier: PY11088 to the API
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PY11088>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:17:24Z',
 'fuel_type': 'petrol',
 'id': 'e9db70db-d30a-551f-b940-764e64e56539',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY11088',
 'listing': 'auction',
 'location': 'DE, Göppingen',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 73505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_b954d6325a890a527a4f06d1c2905424.jpg',
                'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_a3ca5e3ea0ad428252f39a3c84a80a8b.jpg',
                'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_69c8dafa39c05e1a6a5397134a4d6a4c.jpg',
                'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_a9155e8769119863dc35f679e9bd9c3c.jpg',
                'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_e801dff9cd2ee58e975b31f3cd8f9915.jpg',
                'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_73e07be6b98d2c9437f087f3c05365f0.jpg',
                'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_c1befb0106f0fcfa27891983f5e7a4b7.jpg',
                'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_cf01da02227aff6a1449ae002a14001c.jpg',
                'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_474aa45520a5ac7c18d464ea1661c44d.jpg',
                'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_27fc49111056d80bcb7ba1bd3c414168.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9db70db-d30a-551f-b940-764e64e56539/e9db70db-d30a-551f-b940-764e64e56539_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3125559,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_b954d6325a890a527a4f06d1c2905424.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9db70db-d30a-551f-b940-764e64e56539/e9db70db-d30a-551f-b940-764e64e56539_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3178460,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_a3ca5e3ea0ad428252f39a3c84a80a8b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9db70db-d30a-551f-b940-764e64e56539/e9db70db-d30a-551f-b940-764e64e56539_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79386,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_69c8dafa39c05e1a6a5397134a4d6a4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9db70db-d30a-551f-b940-764e64e56539/e9db70db-d30a-551f-b940-764e64e56539_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3079436,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_a9155e8769119863dc35f679e9bd9c3c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9db70db-d30a-551f-b940-764e64e56539/e9db70db-d30a-551f-b940-764e64e56539_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3179661,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_e801dff9cd2ee58e975b31f3cd8f9915.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9db70db-d30a-551f-b940-764e64e56539/e9db70db-d30a-551f-b940-764e64e56539_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_73e07be6b98d2c9437f087f3c05365f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9db70db-d30a-551f-b940-764e64e56539/e9db70db-d30a-551f-b940-764e64e56539_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_c1befb0106f0fcfa27891983f5e7a4b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9db70db-d30a-551f-b940-764e64e56539/e9db70db-d30a-551f-b940-764e64e56539_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_cf01da02227aff6a1449ae002a14001c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9db70db-d30a-551f-b940-764e64e56539/e9db70db-d30a-551f-b940-764e64e56539_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2963121,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_474aa45520a5ac7c18d464ea1661c44d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e9db70db-d30a-551f-b940-764e64e56539/e9db70db-d30a-551f-b940-764e64e56539_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img55/f9/55f90408c9e043eaab459fb9296b16b5/pa/PY11088_27fc49111056d80bcb7ba1bd3c414168.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-03-26',
 'seats_number': 6,
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 TSI Pritsche Doppelkabine',
 'transmission': 'manual',
 'trim': 'Pritsche Doppelkabine',
 'year': 2014}
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY11088%27 HTTP/1.1" 200 None
2026-03-30 07:38:04 [auto1.de] INFO: Saving data for PY11088: {'created_time': 1774856284.915434, 'last_price_update_time': 1774856284.915448, 'auction_closing_time': 1774970244.0}
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY11088') HTTP/1.1" 204 0
2026-03-30 07:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_3a99e0895847484e4d20165c0a5152da.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_c16d31ffaf29e6939d9bfc2a02ce6f78.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_588ea5973d7ffc69e34944f69a8779ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63134186-7aee-59b7-a942-0a4dace1f20e with identifier: DD72399
2026-03-30 07:38:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63134186-7aee-59b7-a942-0a4dace1f20e with identifier: DD72399
2026-03-30 07:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63134186-7aee-59b7-a942-0a4dace1f20e with identifier: DD72399 to the API
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:54:37Z',
 'fuel_type': 'petrol',
 'id': '63134186-7aee-59b7-a942-0a4dace1f20e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD72399',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 11184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-01-16',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2025}
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD72399%27 HTTP/1.1" 200 None
2026-03-30 07:38:05 [auto1.de] INFO: Saving data for DD72399: {'auction_closing_time': 1774972477.0, 'created_time': 1774552998.852163, 'last_price_update_time': 1774856285.28354}
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD72399') HTTP/1.1" 204 0
2026-03-30 07:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_2f211ff404607a700cf24aadd50e1d19.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_2f211ff404607a700cf24aadd50e1d19.jpg not downloaded yet
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: BZ48067
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: LE66161
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE66161%27 HTTP/1.1" 200 None
2026-03-30 07:38:05 [auto1.de] INFO: Scrape type for LE66161: 1
2026-03-30 07:38:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF72847/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_ccbe5fd6bbee9667d7f4aeda8130bd5c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_ccbe5fd6bbee9667d7f4aeda8130bd5c.jpg not downloaded yet
2026-03-30 07:38:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:05 [auto1.de] INFO: Found listing with ID: UA27287
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA27287%27 HTTP/1.1" 200 None
2026-03-30 07:38:05 [auto1.de] INFO: Scrape type for UA27287: 2
2026-03-30 07:38:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b871177b-864c-55bc-8f8a-1d5eb1616234 with identifier: UA27287
2026-03-30 07:38:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b871177b-864c-55bc-8f8a-1d5eb1616234 with scrape type 2
2026-03-30 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b871177b-864c-55bc-8f8a-1d5eb1616234 with scrape type 2
2026-03-30 07:38:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b871177b-864c-55bc-8f8a-1d5eb1616234, identifier: UA27287
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d0cd10>
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_3a99e0895847484e4d20165c0a5152da.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_3a99e0895847484e4d20165c0a5152da.jpg saved to cache
2026-03-30 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e2c810>
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_c16d31ffaf29e6939d9bfc2a02ce6f78.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_c16d31ffaf29e6939d9bfc2a02ce6f78.jpg saved to cache
2026-03-30 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d238eb10>
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_588ea5973d7ffc69e34944f69a8779ee.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_588ea5973d7ffc69e34944f69a8779ee.jpg saved to cache
2026-03-30 07:38:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5
2026-03-30 07:38:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b871177b-864c-55bc-8f8a-1d5eb1616234 with identifier: UA27287
2026-03-30 07:38:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b871177b-864c-55bc-8f8a-1d5eb1616234 with identifier: UA27287
2026-03-30 07:38:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b871177b-864c-55bc-8f8a-1d5eb1616234 with identifier: UA27287 to the API
2026-03-30 07:38:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-31T15:47:44Z',
 'fuel_type': 'petrol',
 'id': 'b871177b-864c-55bc-8f8a-1d5eb1616234',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA27287',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 131357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-02',
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Luna',
 'transmission': 'manual',
 'trim': 'Luna',
 'year': 2009}
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA27287%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Saving data for UA27287: {'auction_closing_time': 1774972064.0, 'created_time': 1774349872.865876, 'last_price_update_time': 1774856286.176809}
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA27287') HTTP/1.1" 204 0
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_5c12b8b30f56ebf60f88d389c3bb6c26.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_5c12b8b30f56ebf60f88d389c3bb6c26.jpg not downloaded yet
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: ME76972
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: TG05254
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: JA57202
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: SK58991
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: XZ11049
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: NF89910
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF89910%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for NF89910: 1
2026-03-30 07:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_42f6ba0f634c162b2b9ce5914de4701a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_e693167d4a0ff3d496669e5a5ab78f2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_25b55ea07bc2f382b2b866252f0df1b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_25b55ea07bc2f382b2b866252f0df1b5.jpg not downloaded yet
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: FE38357
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: ZX71728
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: ZM89162
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: DW65340
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW65340%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for DW65340: 1
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_7f398295fa257c5e01dbe4a721ff336b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_7f398295fa257c5e01dbe4a721ff336b.jpg not downloaded yet
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: MU67757
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU67757%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Scrape type for MU67757: 2
2026-03-30 07:38:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 296b49a0-f55e-5338-9cc7-ebe79b8c490e with identifier: MU67757
2026-03-30 07:38:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 296b49a0-f55e-5338-9cc7-ebe79b8c490e with scrape type 2
2026-03-30 07:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 296b49a0-f55e-5338-9cc7-ebe79b8c490e with scrape type 2
2026-03-30 07:38:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 296b49a0-f55e-5338-9cc7-ebe79b8c490e, identifier: MU67757
2026-03-30 07:38:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 296b49a0-f55e-5338-9cc7-ebe79b8c490e with identifier: MU67757
2026-03-30 07:38:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 296b49a0-f55e-5338-9cc7-ebe79b8c490e with identifier: MU67757
2026-03-30 07:38:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 296b49a0-f55e-5338-9cc7-ebe79b8c490e with identifier: MU67757 to the API
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:34:47Z',
 'fuel_type': 'petrol',
 'id': '296b49a0-f55e-5338-9cc7-ebe79b8c490e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU67757',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 129901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Renault Scenic 1.2 Paris',
 'transmission': 'manual',
 'trim': 'Paris',
 'year': 2013}
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU67757%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [auto1.de] INFO: Saving data for MU67757: {'auction_closing_time': 1774971287.0, 'created_time': 1774292945.324298, 'last_price_update_time': 1774856286.848928}
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU67757') HTTP/1.1" 204 0
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_4df4270235d0a12a9c26050ca9734652.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_4df4270235d0a12a9c26050ca9734652.jpg not downloaded yet
2026-03-30 07:38:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_5c12b8b30f56ebf60f88d389c3bb6c26.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:06 [scrapy.extensions.logstats] INFO: Crawled 79 pages (at 40 pages/min), scraped 279 items (at 101 items/min)
2026-03-30 07:38:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: PC88628
2026-03-30 07:38:06 [auto1.de] INFO: Found listing with ID: KL56138
2026-03-30 07:38:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL56138%27 HTTP/1.1" 200 None
2026-03-30 07:38:07 [auto1.de] INFO: Scrape type for KL56138: 2
2026-03-30 07:38:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65ef79c3-3513-5cee-ae7d-b3abe7aab96b with identifier: KL56138
2026-03-30 07:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ef79c3-3513-5cee-ae7d-b3abe7aab96b with scrape type 2
2026-03-30 07:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65ef79c3-3513-5cee-ae7d-b3abe7aab96b with scrape type 2
2026-03-30 07:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 65ef79c3-3513-5cee-ae7d-b3abe7aab96b, identifier: KL56138
2026-03-30 07:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 65ef79c3-3513-5cee-ae7d-b3abe7aab96b with identifier: KL56138
2026-03-30 07:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 65ef79c3-3513-5cee-ae7d-b3abe7aab96b with identifier: KL56138
2026-03-30 07:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 65ef79c3-3513-5cee-ae7d-b3abe7aab96b with identifier: KL56138 to the API
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:08:47Z',
 'fuel_type': 'diesel',
 'id': '65ef79c3-3513-5cee-ae7d-b3abe7aab96b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL56138',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 161037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-18',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI clean diesel Ambiente',
 'transmission': 'automatic',
 'trim': 'Ambiente',
 'year': 2015}
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL56138%27 HTTP/1.1" 200 None
2026-03-30 07:38:07 [auto1.de] INFO: Saving data for KL56138: {'auction_closing_time': 1774969727.0, 'created_time': 1774262906.411134, 'last_price_update_time': 1774856287.445138}
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KL56138') HTTP/1.1" 204 0
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_95c013db6fa4d5a139a4cb28b8354d7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_95c013db6fa4d5a139a4cb28b8354d7b.jpg not downloaded yet
2026-03-30 07:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d238b2d0>
2026-03-30 07:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_42f6ba0f634c162b2b9ce5914de4701a.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_42f6ba0f634c162b2b9ce5914de4701a.jpg saved to cache
2026-03-30 07:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94323638-e75a-5610-9408-d796c485f7cc
2026-03-30 07:38:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22157d0>
2026-03-30 07:38:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg36%252Fbe%252F36bea7b6e0ab3ea4b937be35f3901faf%252Fpa%252FMB72804_e693167d4a0ff3d496669e5a5ab78f2c.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_e693167d4a0ff3d496669e5a5ab78f2c.jpg saved to cache
2026-03-30 07:38:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed
2026-03-30 07:38:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d2a7cab9-72fd-5d00-b950-bee55f17d6ed, skipping ID generation
2026-03-30 07:38:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed with scrape type 1
2026-03-30 07:38:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d2a7cab9-72fd-5d00-b950-bee55f17d6ed sending to next pipeline
2026-03-30 07:38:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a7cab9-72fd-5d00-b950-bee55f17d6ed, identifier: MB72804
2026-03-30 07:38:07 [auto1.de] INFO: Found listing with ID: GD26673
2026-03-30 07:38:07 [auto1.de] INFO: Found listing with ID: HT75427
2026-03-30 07:38:07 [auto1.de] INFO: Found listing with ID: YK11401
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK11401%27 HTTP/1.1" 200 None
2026-03-30 07:38:07 [auto1.de] INFO: Scrape type for YK11401: 1
2026-03-30 07:38:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a7cab9-72fd-5d00-b950-bee55f17d6ed with identifier: MB72804
2026-03-30 07:38:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a7cab9-72fd-5d00-b950-bee55f17d6ed with identifier: MB72804
2026-03-30 07:38:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a7cab9-72fd-5d00-b950-bee55f17d6ed with identifier: MB72804 to the API
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_e693167d4a0ff3d496669e5a5ab78f2c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 211,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:48:37Z',
 'fuel_type': 'diesel',
 'id': 'd2a7cab9-72fd-5d00-b950-bee55f17d6ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB72804',
 'listing': 'auction',
 'location': 'DE, Bruchsal',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_77066dd344bf49d406ae925bb6452e39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_8a2a8c203fd7eb8a8b01e74b617c4731.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_64713b1f94b70b5236c5d1c85161369b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_6ce2fd58d60fe5592360e6f32024db15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_f01b270122c609809a1968a1f5407a99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_d140e1dce92b86b58776a9ce2bc2dee1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_4357a97a8e87dc2591e859a895dd737f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_e693167d4a0ff3d496669e5a5ab78f2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_3a99e0895847484e4d20165c0a5152da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d2a7cab9-72fd-5d00-b950-bee55f17d6ed/d2a7cab9-72fd-5d00-b950-bee55f17d6ed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img36/be/36bea7b6e0ab3ea4b937be35f3901faf/pa/MB72804_dd477c8a26f81576f386625b9758c942.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-08-20',
 'seats_number': 9,
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 320 L1 Trend',
 'transmission': 'manual',
 'trim': '320 L1 Trend',
 'year': 2019}
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB72804%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Saving data for MB72804: {'created_time': 1774856288.128026, 'last_price_update_time': 1774856288.128042, 'auction_closing_time': 1774972117.0}
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB72804') HTTP/1.1" 204 0
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_ed31665d6d0b1778d9a1acb8d9f82ce1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_ed31665d6d0b1778d9a1acb8d9f82ce1.jpg not downloaded yet
2026-03-30 07:38:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24fbe50>
2026-03-30 07:38:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_5c12b8b30f56ebf60f88d389c3bb6c26.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_5c12b8b30f56ebf60f88d389c3bb6c26.jpg saved to cache
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94323638-e75a-5610-9408-d796c485f7cc
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: FH85509
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: GT95887
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: RY03254
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY03254%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for RY03254: 2
2026-03-30 07:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 813a75b7-8051-5a3a-b207-1ec5ea47eaee with identifier: RY03254
2026-03-30 07:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 813a75b7-8051-5a3a-b207-1ec5ea47eaee with scrape type 2
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 813a75b7-8051-5a3a-b207-1ec5ea47eaee with scrape type 2
2026-03-30 07:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 813a75b7-8051-5a3a-b207-1ec5ea47eaee, identifier: RY03254
2026-03-30 07:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LS48573> (referer: https://www.auto1.com/v1/car-details-view/LS48573/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NA47397> (referer: https://www.auto1.com/v1/car-details-view/NA47397/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_7f398295fa257c5e01dbe4a721ff336b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 813a75b7-8051-5a3a-b207-1ec5ea47eaee with identifier: RY03254
2026-03-30 07:38:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 813a75b7-8051-5a3a-b207-1ec5ea47eaee with identifier: RY03254
2026-03-30 07:38:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 813a75b7-8051-5a3a-b207-1ec5ea47eaee with identifier: RY03254 to the API
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:04:44Z',
 'fuel_type': 'petrol',
 'id': '813a75b7-8051-5a3a-b207-1ec5ea47eaee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY03254',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 236834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-04',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2006}
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY03254%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Saving data for RY03254: {'auction_closing_time': 1774969484.0, 'created_time': 1773776140.877363, 'last_price_update_time': 1774856288.702719}
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY03254') HTTP/1.1" 204 0
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_f0a121358f48b76ab7ce6d760b78d12c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_f0a121358f48b76ab7ce6d760b78d12c.jpg not downloaded yet
2026-03-30 07:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX99229/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA98768> (referer: https://www.auto1.com/v1/car-details-view/FA98768/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: HC65117
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC65117%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for HC65117: 1
2026-03-30 07:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX31809/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP40220> (referer: https://www.auto1.com/v1/car-details-view/KP40220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:08 [auto1.de] INFO: Found listing with ID: GB84908
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB84908%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [auto1.de] INFO: Scrape type for GB84908: 2
2026-03-30 07:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa0c257e-58cd-5316-ba3c-bbe71886f0a3 with identifier: GB84908
2026-03-30 07:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa0c257e-58cd-5316-ba3c-bbe71886f0a3 with scrape type 2
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fa0c257e-58cd-5316-ba3c-bbe71886f0a3 with scrape type 2
2026-03-30 07:38:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fa0c257e-58cd-5316-ba3c-bbe71886f0a3, identifier: GB84908
2026-03-30 07:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC09398> (referer: https://www.auto1.com/v1/car-details-view/NC09398/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292 with identifier: LS48573
2026-03-30 07:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292 with scrape type 1
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_35a14b846e32f89d75d9303d52f8c3e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_35a14b846e32f89d75d9303d52f8c3e6.jpg not downloaded yet
2026-03-30 07:38:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73086668-e6c0-52ea-9fba-b2fb352f03b4 with identifier: NA47397
2026-03-30 07:38:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73086668-e6c0-52ea-9fba-b2fb352f03b4 with scrape type 1
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 73086668-e6c0-52ea-9fba-b2fb352f03b4
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F67%252Fd3679047b07580673c49e3150fa35664%252Fpa%252FNA47397_78fcc809e0df14f3a9a03a0c1a0d0d73.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_78fcc809e0df14f3a9a03a0c1a0d0d73.jpg already downloaded
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F67%252Fd3679047b07580673c49e3150fa35664%252Fpa%252FNA47397_29dc560c5dbdb3fb80d422ef95428754.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_29dc560c5dbdb3fb80d422ef95428754.jpg already downloaded
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F67%252Fd3679047b07580673c49e3150fa35664%252Fpa%252FNA47397_d0738719507a5afb029f2a0421248783.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_d0738719507a5afb029f2a0421248783.jpg already downloaded
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F67%252Fd3679047b07580673c49e3150fa35664%252Fpa%252FNA47397_3fc70419f6e7c781de84defdc0d416c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_3fc70419f6e7c781de84defdc0d416c1.jpg already downloaded
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F67%252Fd3679047b07580673c49e3150fa35664%252Fpa%252FNA47397_fa62d81b7462e27a1f0bc2e485843e33.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_fa62d81b7462e27a1f0bc2e485843e33.jpg already downloaded
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F67%252Fd3679047b07580673c49e3150fa35664%252Fpa%252FNA47397_d3d500564993f4778710a30ea46901ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_d3d500564993f4778710a30ea46901ee.jpg already downloaded
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F67%252Fd3679047b07580673c49e3150fa35664%252Fpa%252FNA47397_11b4b34228f8c866a005030a63f97659.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_11b4b34228f8c866a005030a63f97659.jpg already downloaded
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F67%252Fd3679047b07580673c49e3150fa35664%252Fpa%252FNA47397_e8094786d0a8dcc02e1797de3d63ab32.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_e8094786d0a8dcc02e1797de3d63ab32.jpg already downloaded
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F67%252Fd3679047b07580673c49e3150fa35664%252Fpa%252FNA47397_f5d661161d2c96e6db7a3dcd8af67348.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_f5d661161d2c96e6db7a3dcd8af67348.jpg already downloaded
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F67%252Fd3679047b07580673c49e3150fa35664%252Fpa%252FNA47397_df9c1c30e636a91ce1fcf0c6b33d105f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_df9c1c30e636a91ce1fcf0c6b33d105f.jpg already downloaded
2026-03-30 07:38:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73086668-e6c0-52ea-9fba-b2fb352f03b4, identifier: NA47397
2026-03-30 07:38:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d8e5cd10>
2026-03-30 07:38:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_7f398295fa257c5e01dbe4a721ff336b.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_7f398295fa257c5e01dbe4a721ff336b.jpg saved to cache
2026-03-30 07:38:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94323638-e75a-5610-9408-d796c485f7cc
2026-03-30 07:38:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fa0c257e-58cd-5316-ba3c-bbe71886f0a3 with identifier: GB84908
2026-03-30 07:38:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fa0c257e-58cd-5316-ba3c-bbe71886f0a3 with identifier: GB84908
2026-03-30 07:38:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fa0c257e-58cd-5316-ba3c-bbe71886f0a3 with identifier: GB84908 to the API
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 118,
 'expiration_date': '2026-03-31T15:07:04Z',
 'fuel_type': 'petrol',
 'id': 'fa0c257e-58cd-5316-ba3c-bbe71886f0a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB84908',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': '190/190 E',
 'odometer': 249021,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1990-05-30',
 'seller_name': None,
 'title': 'Mercedes-Benz 190/190 E E 190',
 'transmission': 'manual',
 'trim': '',
 'year': 1990}
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB84908%27 HTTP/1.1" 200 None
2026-03-30 07:38:10 [auto1.de] INFO: Saving data for GB84908: {'auction_closing_time': 1774969624.0, 'created_time': 1773132489.394562, 'last_price_update_time': 1774856290.000549}
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB84908') HTTP/1.1" 204 0
2026-03-30 07:38:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73086668-e6c0-52ea-9fba-b2fb352f03b4 with identifier: NA47397
2026-03-30 07:38:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73086668-e6c0-52ea-9fba-b2fb352f03b4 with identifier: NA47397
2026-03-30 07:38:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73086668-e6c0-52ea-9fba-b2fb352f03b4 with identifier: NA47397 to the API
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NA47397>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:36:28Z',
 'fuel_type': 'diesel',
 'id': '73086668-e6c0-52ea-9fba-b2fb352f03b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NA47397',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 106733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_78fcc809e0df14f3a9a03a0c1a0d0d73.jpg',
                'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_29dc560c5dbdb3fb80d422ef95428754.jpg',
                'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_d0738719507a5afb029f2a0421248783.jpg',
                'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_3fc70419f6e7c781de84defdc0d416c1.jpg',
                'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_fa62d81b7462e27a1f0bc2e485843e33.jpg',
                'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_d3d500564993f4778710a30ea46901ee.jpg',
                'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_11b4b34228f8c866a005030a63f97659.jpg',
                'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_e8094786d0a8dcc02e1797de3d63ab32.jpg',
                'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_f5d661161d2c96e6db7a3dcd8af67348.jpg',
                'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_df9c1c30e636a91ce1fcf0c6b33d105f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73086668-e6c0-52ea-9fba-b2fb352f03b4/73086668-e6c0-52ea-9fba-b2fb352f03b4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_78fcc809e0df14f3a9a03a0c1a0d0d73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73086668-e6c0-52ea-9fba-b2fb352f03b4/73086668-e6c0-52ea-9fba-b2fb352f03b4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73411,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_29dc560c5dbdb3fb80d422ef95428754.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73086668-e6c0-52ea-9fba-b2fb352f03b4/73086668-e6c0-52ea-9fba-b2fb352f03b4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73531,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_d0738719507a5afb029f2a0421248783.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73086668-e6c0-52ea-9fba-b2fb352f03b4/73086668-e6c0-52ea-9fba-b2fb352f03b4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63782,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_3fc70419f6e7c781de84defdc0d416c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73086668-e6c0-52ea-9fba-b2fb352f03b4/73086668-e6c0-52ea-9fba-b2fb352f03b4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77491,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_fa62d81b7462e27a1f0bc2e485843e33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73086668-e6c0-52ea-9fba-b2fb352f03b4/73086668-e6c0-52ea-9fba-b2fb352f03b4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72617,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_d3d500564993f4778710a30ea46901ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73086668-e6c0-52ea-9fba-b2fb352f03b4/73086668-e6c0-52ea-9fba-b2fb352f03b4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_11b4b34228f8c866a005030a63f97659.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73086668-e6c0-52ea-9fba-b2fb352f03b4/73086668-e6c0-52ea-9fba-b2fb352f03b4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_e8094786d0a8dcc02e1797de3d63ab32.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73086668-e6c0-52ea-9fba-b2fb352f03b4/73086668-e6c0-52ea-9fba-b2fb352f03b4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_f5d661161d2c96e6db7a3dcd8af67348.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_73086668-e6c0-52ea-9fba-b2fb352f03b4/73086668-e6c0-52ea-9fba-b2fb352f03b4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/67/d3679047b07580673c49e3150fa35664/pa/NA47397_df9c1c30e636a91ce1fcf0c6b33d105f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi EcoBlue Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2020}
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA47397%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Saving data for NA47397: {'created_time': 1774856291.073534, 'last_price_update_time': 1774856291.07355, 'auction_closing_time': 1774971388.0}
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NA47397') HTTP/1.1" 204 0
2026-03-30 07:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_4df4270235d0a12a9c26050ca9734652.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: EK94658
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK94658%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Scrape type for EK94658: 1
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_d983df3af4548b42729df74c70b35da7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_d983df3af4548b42729df74c70b35da7.jpg not downloaded yet
2026-03-30 07:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_95c013db6fa4d5a139a4cb28b8354d7b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_ed31665d6d0b1778d9a1acb8d9f82ce1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_f0a121358f48b76ab7ce6d760b78d12c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:11 [auto1.de] INFO: Found listing with ID: ED11962
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED11962%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [auto1.de] INFO: Scrape type for ED11962: 1
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_bad7046399b448964cabbb908bebfc9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_bad7046399b448964cabbb908bebfc9c.jpg not downloaded yet
2026-03-30 07:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf3dec33-89d4-5221-9139-a5056fae806e with identifier: FA98768
2026-03-30 07:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3dec33-89d4-5221-9139-a5056fae806e with scrape type 1
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf3dec33-89d4-5221-9139-a5056fae806e
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_fdfd24fb55d317157dffdc12db794920.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_fdfd24fb55d317157dffdc12db794920.jpg not downloaded yet
2026-03-30 07:38:11 [auto1.de] INFO: Channel: 24h | Page: 19 | totalHits: 7777 | hits on page: 40
2026-03-30 07:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a53f1954-c75e-59c3-9f7f-342f3f18c076 with identifier: KP40220
2026-03-30 07:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a53f1954-c75e-59c3-9f7f-342f3f18c076 with scrape type 1
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a53f1954-c75e-59c3-9f7f-342f3f18c076
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fcd%252F8ecd48f6803996d2cbac5d60bcfff875%252Fpa%252FKP40220_d754dfa4694879ed27898e6e4ae86285.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_d754dfa4694879ed27898e6e4ae86285.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fcd%252F8ecd48f6803996d2cbac5d60bcfff875%252Fpa%252FKP40220_10e76bae078bd89e6b98395ab4a2a740.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_10e76bae078bd89e6b98395ab4a2a740.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fcd%252F8ecd48f6803996d2cbac5d60bcfff875%252Fpa%252FKP40220_c0b490877a2cd95cba90b5954674ddb9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_c0b490877a2cd95cba90b5954674ddb9.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fcd%252F8ecd48f6803996d2cbac5d60bcfff875%252Fpa%252FKP40220_fda366ff79f39789541c83c7597803c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_fda366ff79f39789541c83c7597803c6.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fcd%252F8ecd48f6803996d2cbac5d60bcfff875%252Fpa%252FKP40220_b005d0d1b68c85a039f808ee906969a8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_b005d0d1b68c85a039f808ee906969a8.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fcd%252F8ecd48f6803996d2cbac5d60bcfff875%252Fpa%252FKP40220_71056b784902f313b7aa704529e07126.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_71056b784902f313b7aa704529e07126.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fcd%252F8ecd48f6803996d2cbac5d60bcfff875%252Fpa%252FKP40220_db1c9e544726d8401adcd772e40b4ac7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_db1c9e544726d8401adcd772e40b4ac7.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fcd%252F8ecd48f6803996d2cbac5d60bcfff875%252Fpa%252FKP40220_730d9fbd0be3469954448aba05755b5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_730d9fbd0be3469954448aba05755b5a.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fcd%252F8ecd48f6803996d2cbac5d60bcfff875%252Fpa%252FKP40220_961e79aa195b67d511736d042ce15ac4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_961e79aa195b67d511736d042ce15ac4.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8e%252Fcd%252F8ecd48f6803996d2cbac5d60bcfff875%252Fpa%252FKP40220_ed0ba33329eab76d345b3c1c6d48ec15.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_ed0ba33329eab76d345b3c1c6d48ec15.jpg already downloaded
2026-03-30 07:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a53f1954-c75e-59c3-9f7f-342f3f18c076, identifier: KP40220
2026-03-30 07:38:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00de64dc-f8a1-5be5-8149-51ca264108a4 with identifier: NC09398
2026-03-30 07:38:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00de64dc-f8a1-5be5-8149-51ca264108a4 with scrape type 1
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 00de64dc-f8a1-5be5-8149-51ca264108a4
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa2%252F2ea28116d64e10d7a12f5e36a1949e3e%252Fpa%252FNC09398_cdbe4ec03197c0d6c3900a46cb700842.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_cdbe4ec03197c0d6c3900a46cb700842.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa2%252F2ea28116d64e10d7a12f5e36a1949e3e%252Fpa%252FNC09398_f65a094d855c81163cd14404ce5a32d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_f65a094d855c81163cd14404ce5a32d7.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa2%252F2ea28116d64e10d7a12f5e36a1949e3e%252Fpa%252FNC09398_b369ecce42c19c2419c8f2bdbda66bb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_b369ecce42c19c2419c8f2bdbda66bb4.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa2%252F2ea28116d64e10d7a12f5e36a1949e3e%252Fpa%252FNC09398_99d9fd948fc34b39643bd3983dede8d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_99d9fd948fc34b39643bd3983dede8d8.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa2%252F2ea28116d64e10d7a12f5e36a1949e3e%252Fpa%252FNC09398_4e695512446f1f0aa26bb3f537d2b0ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_4e695512446f1f0aa26bb3f537d2b0ee.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa2%252F2ea28116d64e10d7a12f5e36a1949e3e%252Fpa%252FNC09398_8d926323f49899fb8cd61990f2b4fd67.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_8d926323f49899fb8cd61990f2b4fd67.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa2%252F2ea28116d64e10d7a12f5e36a1949e3e%252Fpa%252FNC09398_bd330f193b2fb9afa856ee7c1bf68f66.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_bd330f193b2fb9afa856ee7c1bf68f66.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa2%252F2ea28116d64e10d7a12f5e36a1949e3e%252Fpa%252FNC09398_5c9fbc192da5ba1a43d919f28f05e2fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_5c9fbc192da5ba1a43d919f28f05e2fe.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa2%252F2ea28116d64e10d7a12f5e36a1949e3e%252Fpa%252FNC09398_4323345f11e1183571b3cc7ee06c1ea5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_4323345f11e1183571b3cc7ee06c1ea5.jpg already downloaded
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2e%252Fa2%252F2ea28116d64e10d7a12f5e36a1949e3e%252Fpa%252FNC09398_309cc0a24c37d3ba080f0e05cb856c00.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_309cc0a24c37d3ba080f0e05cb856c00.jpg already downloaded
2026-03-30 07:38:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00de64dc-f8a1-5be5-8149-51ca264108a4, identifier: NC09398
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_20b51317848deea02f04482c789bf450.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_20b51317848deea02f04482c789bf450.jpg not downloaded yet
2026-03-30 07:38:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a53f1954-c75e-59c3-9f7f-342f3f18c076 with identifier: KP40220
2026-03-30 07:38:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a53f1954-c75e-59c3-9f7f-342f3f18c076 with identifier: KP40220
2026-03-30 07:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a53f1954-c75e-59c3-9f7f-342f3f18c076 with identifier: KP40220 to the API
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KP40220>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:28:47Z',
 'fuel_type': 'petrol',
 'id': 'a53f1954-c75e-59c3-9f7f-342f3f18c076',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP40220',
 'listing': 'auction',
 'location': 'DE, Hodenhagen',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 84135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_d754dfa4694879ed27898e6e4ae86285.jpg',
                'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_10e76bae078bd89e6b98395ab4a2a740.jpg',
                'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_c0b490877a2cd95cba90b5954674ddb9.jpg',
                'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_fda366ff79f39789541c83c7597803c6.jpg',
                'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_b005d0d1b68c85a039f808ee906969a8.jpg',
                'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_71056b784902f313b7aa704529e07126.jpg',
                'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_db1c9e544726d8401adcd772e40b4ac7.jpg',
                'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_730d9fbd0be3469954448aba05755b5a.jpg',
                'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_961e79aa195b67d511736d042ce15ac4.jpg',
                'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_ed0ba33329eab76d345b3c1c6d48ec15.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2516765,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_d754dfa4694879ed27898e6e4ae86285.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2368371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_10e76bae078bd89e6b98395ab4a2a740.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2424746,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_c0b490877a2cd95cba90b5954674ddb9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2408498,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_fda366ff79f39789541c83c7597803c6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62840,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_b005d0d1b68c85a039f808ee906969a8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_71056b784902f313b7aa704529e07126.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_db1c9e544726d8401adcd772e40b4ac7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2508341,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_730d9fbd0be3469954448aba05755b5a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2386738,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_961e79aa195b67d511736d042ce15ac4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a53f1954-c75e-59c3-9f7f-342f3f18c076/a53f1954-c75e-59c3-9f7f-342f3f18c076_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2731315,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img8e/cd/8ecd48f6803996d2cbac5d60bcfff875/pa/KP40220_ed0ba33329eab76d345b3c1c6d48ec15.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-04',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP40220%27 HTTP/1.1" 200 None
2026-03-30 07:38:12 [auto1.de] INFO: Saving data for KP40220: {'created_time': 1774856292.254515, 'last_price_update_time': 1774856292.254528, 'auction_closing_time': 1774970927.0}
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP40220') HTTP/1.1" 204 0
2026-03-30 07:38:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00de64dc-f8a1-5be5-8149-51ca264108a4 with identifier: NC09398
2026-03-30 07:38:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00de64dc-f8a1-5be5-8149-51ca264108a4 with identifier: NC09398
2026-03-30 07:38:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00de64dc-f8a1-5be5-8149-51ca264108a4 with identifier: NC09398 to the API
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NC09398>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:04:23Z',
 'fuel_type': 'diesel',
 'id': '00de64dc-f8a1-5be5-8149-51ca264108a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC09398',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 207333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_cdbe4ec03197c0d6c3900a46cb700842.jpg',
                'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_f65a094d855c81163cd14404ce5a32d7.jpg',
                'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_b369ecce42c19c2419c8f2bdbda66bb4.jpg',
                'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_99d9fd948fc34b39643bd3983dede8d8.jpg',
                'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_4e695512446f1f0aa26bb3f537d2b0ee.jpg',
                'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_8d926323f49899fb8cd61990f2b4fd67.jpg',
                'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_bd330f193b2fb9afa856ee7c1bf68f66.jpg',
                'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_5c9fbc192da5ba1a43d919f28f05e2fe.jpg',
                'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_4323345f11e1183571b3cc7ee06c1ea5.jpg',
                'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_309cc0a24c37d3ba080f0e05cb856c00.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00de64dc-f8a1-5be5-8149-51ca264108a4/00de64dc-f8a1-5be5-8149-51ca264108a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68961,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_cdbe4ec03197c0d6c3900a46cb700842.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00de64dc-f8a1-5be5-8149-51ca264108a4/00de64dc-f8a1-5be5-8149-51ca264108a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_f65a094d855c81163cd14404ce5a32d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00de64dc-f8a1-5be5-8149-51ca264108a4/00de64dc-f8a1-5be5-8149-51ca264108a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59098,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_b369ecce42c19c2419c8f2bdbda66bb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00de64dc-f8a1-5be5-8149-51ca264108a4/00de64dc-f8a1-5be5-8149-51ca264108a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_99d9fd948fc34b39643bd3983dede8d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00de64dc-f8a1-5be5-8149-51ca264108a4/00de64dc-f8a1-5be5-8149-51ca264108a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53217,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_4e695512446f1f0aa26bb3f537d2b0ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00de64dc-f8a1-5be5-8149-51ca264108a4/00de64dc-f8a1-5be5-8149-51ca264108a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_8d926323f49899fb8cd61990f2b4fd67.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00de64dc-f8a1-5be5-8149-51ca264108a4/00de64dc-f8a1-5be5-8149-51ca264108a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59786,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_bd330f193b2fb9afa856ee7c1bf68f66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00de64dc-f8a1-5be5-8149-51ca264108a4/00de64dc-f8a1-5be5-8149-51ca264108a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_5c9fbc192da5ba1a43d919f28f05e2fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00de64dc-f8a1-5be5-8149-51ca264108a4/00de64dc-f8a1-5be5-8149-51ca264108a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66939,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_4323345f11e1183571b3cc7ee06c1ea5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_00de64dc-f8a1-5be5-8149-51ca264108a4/00de64dc-f8a1-5be5-8149-51ca264108a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2e/a2/2ea28116d64e10d7a12f5e36a1949e3e/pa/NC09398_309cc0a24c37d3ba080f0e05cb856c00.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Exclusive-Line 2WD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line 2WD',
 'year': 2015}
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC09398%27 HTTP/1.1" 200 None
2026-03-30 07:38:12 [auto1.de] INFO: Saving data for NC09398: {'created_time': 1774856292.694665, 'last_price_update_time': 1774856292.69468, 'auction_closing_time': 1774969463.0}
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NC09398') HTTP/1.1" 204 0
2026-03-30 07:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_25b55ea07bc2f382b2b866252f0df1b5.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_35a14b846e32f89d75d9303d52f8c3e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_73aa26a489bc79308a3e6f12b929a5ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_73aa26a489bc79308a3e6f12b929a5ab.jpg not downloaded yet
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: DW65340
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_4d57e7fe3e235860cd35bad3b5f59c36.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_4d57e7fe3e235860cd35bad3b5f59c36.jpg not downloaded yet
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_3d13501b7e3a9f473f4e3512e824e14f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_3d13501b7e3a9f473f4e3512e824e14f.jpg not downloaded yet
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: MU67757
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU67757%27 HTTP/1.1" 200 None
2026-03-30 07:38:12 [auto1.de] INFO: Scrape type for MU67757: 0
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: PC88628
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: KL56138
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL56138%27 HTTP/1.1" 200 None
2026-03-30 07:38:12 [auto1.de] INFO: Scrape type for KL56138: 0
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: GD26673
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: HT75427
2026-03-30 07:38:12 [auto1.de] INFO: Found listing with ID: YK11401
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2201cd0>
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_4df4270235d0a12a9c26050ca9734652.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_4df4270235d0a12a9c26050ca9734652.jpg saved to cache
2026-03-30 07:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94323638-e75a-5610-9408-d796c485f7cc
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24dea50>
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_95c013db6fa4d5a139a4cb28b8354d7b.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_95c013db6fa4d5a139a4cb28b8354d7b.jpg saved to cache
2026-03-30 07:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94323638-e75a-5610-9408-d796c485f7cc
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2466d50>
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_ed31665d6d0b1778d9a1acb8d9f82ce1.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_ed31665d6d0b1778d9a1acb8d9f82ce1.jpg saved to cache
2026-03-30 07:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94323638-e75a-5610-9408-d796c485f7cc
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22e1590>
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_f0a121358f48b76ab7ce6d760b78d12c.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_f0a121358f48b76ab7ce6d760b78d12c.jpg saved to cache
2026-03-30 07:38:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94323638-e75a-5610-9408-d796c485f7cc
2026-03-30 07:38:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_9ee6c4067c80508e64734e63aaa9f253.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_9ee6c4067c80508e64734e63aaa9f253.jpg not downloaded yet
2026-03-30 07:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_d983df3af4548b42729df74c70b35da7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_ccc75cdbf8226594f7d34fecc38e3d52.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_ccc75cdbf8226594f7d34fecc38e3d52.jpg not downloaded yet
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: FH85509
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: GT95887
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: RY03254
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY03254%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for RY03254: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: HC65117
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_34ce4fa6a271d433d03bea9e4c6b9fd7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_34ce4fa6a271d433d03bea9e4c6b9fd7.jpg not downloaded yet
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e55750>
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_25b55ea07bc2f382b2b866252f0df1b5.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_25b55ea07bc2f382b2b866252f0df1b5.jpg saved to cache
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94323638-e75a-5610-9408-d796c485f7cc
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2249f10>
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_35a14b846e32f89d75d9303d52f8c3e6.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_35a14b846e32f89d75d9303d52f8c3e6.jpg saved to cache
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_847ec5647a86f908820fc3744ba282ac.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_847ec5647a86f908820fc3744ba282ac.jpg not downloaded yet
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: GB84908
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB84908%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for GB84908: 0
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: EK94658
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_d927f71163a71b04453e1144938d10db.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_d927f71163a71b04453e1144938d10db.jpg not downloaded yet
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_7ecdd5920bfcf1b8ab8f965b487bd2bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_7ecdd5920bfcf1b8ab8f965b487bd2bd.jpg not downloaded yet
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: ED11962
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22f6f10>
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_d983df3af4548b42729df74c70b35da7.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_d983df3af4548b42729df74c70b35da7.jpg saved to cache
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_0d3cfc89d469c9499b47a244e612aaf3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_0d3cfc89d469c9499b47a244e612aaf3.jpg not downloaded yet
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_b0ae0bbce386dd77db3df0e5b7d83fcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_b0ae0bbce386dd77db3df0e5b7d83fcd.jpg not downloaded yet
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: VN83925
2026-03-30 07:38:13 [auto1.de] INFO: Found listing with ID: XT16299
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT16299%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Scrape type for XT16299: 2
2026-03-30 07:38:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e787c28-09be-5ec2-b8bc-6a3eeb1a6da8 with identifier: XT16299
2026-03-30 07:38:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e787c28-09be-5ec2-b8bc-6a3eeb1a6da8 with scrape type 2
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e787c28-09be-5ec2-b8bc-6a3eeb1a6da8 with scrape type 2
2026-03-30 07:38:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e787c28-09be-5ec2-b8bc-6a3eeb1a6da8, identifier: XT16299
2026-03-30 07:38:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_9ee6c4067c80508e64734e63aaa9f253.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_27388774142fac6480c9f827883a1aa6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_27388774142fac6480c9f827883a1aa6.jpg not downloaded yet
2026-03-30 07:38:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e787c28-09be-5ec2-b8bc-6a3eeb1a6da8 with identifier: XT16299
2026-03-30 07:38:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e787c28-09be-5ec2-b8bc-6a3eeb1a6da8 with identifier: XT16299
2026-03-30 07:38:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e787c28-09be-5ec2-b8bc-6a3eeb1a6da8 with identifier: XT16299 to the API
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-31T15:57:41Z',
 'fuel_type': 'petrol',
 'id': '5e787c28-09be-5ec2-b8bc-6a3eeb1a6da8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT16299',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Stelvio',
 'odometer': 70303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-14',
 'seller_name': None,
 'title': 'Alfa Romeo Stelvio 2.9 V6 Quadrifoglio Q4',
 'transmission': 'automatic',
 'trim': 'Quadrifoglio Q4',
 'year': 2020}
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT16299%27 HTTP/1.1" 200 None
2026-03-30 07:38:13 [auto1.de] INFO: Saving data for XT16299: {'auction_closing_time': 1774972661.0, 'created_time': 1773688831.835172, 'last_price_update_time': 1774856293.893603}
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT16299') HTTP/1.1" 204 0
2026-03-30 07:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LE66161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_a77214b46a30dc512e5827ac295b3a4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_a77214b46a30dc512e5827ac295b3a4c.jpg not downloaded yet
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: UP75905
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: BK26573
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: MY33164
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: VF16052
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: XX48334
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX48334%27 HTTP/1.1" 200 None
2026-03-30 07:38:14 [auto1.de] INFO: Scrape type for XX48334: 2
2026-03-30 07:38:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60510614-7125-5e48-a9d2-81a584216381 with identifier: XX48334
2026-03-30 07:38:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60510614-7125-5e48-a9d2-81a584216381 with scrape type 2
2026-03-30 07:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60510614-7125-5e48-a9d2-81a584216381 with scrape type 2
2026-03-30 07:38:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60510614-7125-5e48-a9d2-81a584216381, identifier: XX48334
2026-03-30 07:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60510614-7125-5e48-a9d2-81a584216381 with identifier: XX48334
2026-03-30 07:38:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60510614-7125-5e48-a9d2-81a584216381 with identifier: XX48334
2026-03-30 07:38:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60510614-7125-5e48-a9d2-81a584216381 with identifier: XX48334 to the API
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:39:02Z',
 'fuel_type': 'diesel',
 'id': '60510614-7125-5e48-a9d2-81a584216381',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX48334',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 236004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-11',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Champions Edition',
 'transmission': 'manual',
 'trim': 'Champions Edition',
 'year': 2012}
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX48334%27 HTTP/1.1" 200 None
2026-03-30 07:38:14 [auto1.de] INFO: Saving data for XX48334: {'auction_closing_time': 1774971542.0, 'created_time': 1773741260.328742, 'last_price_update_time': 1774856294.84507}
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX48334') HTTP/1.1" 204 0
2026-03-30 07:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX02896> (referer: https://www.auto1.com/v1/car-details-view/UX02896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK11401/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS93141> (referer: https://www.auto1.com/v1/car-details-view/MS93141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_ab33d618d4f62d42bf65809727bd4ca7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_ab33d618d4f62d42bf65809727bd4ca7.jpg not downloaded yet
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: DB70642
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: BR21145
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: HR43739
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR43739%27 HTTP/1.1" 200 None
2026-03-30 07:38:14 [auto1.de] INFO: Scrape type for HR43739: 1
2026-03-30 07:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ85165> (referer: https://www.auto1.com/v1/car-details-view/NJ85165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MT16554> (referer: https://www.auto1.com/v1/car-details-view/MT16554/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD06486> (referer: https://www.auto1.com/v1/car-details-view/DD06486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d3f250>
2026-03-30 07:38:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_9ee6c4067c80508e64734e63aaa9f253.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_9ee6c4067c80508e64734e63aaa9f253.jpg saved to cache
2026-03-30 07:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292
2026-03-30 07:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_0d3cfc89d469c9499b47a244e612aaf3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_4f3200e3e92a5346734b2882cd9efc51.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_4f3200e3e92a5346734b2882cd9efc51.jpg not downloaded yet
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: EG30770
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: SK51252
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: HT21123
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT21123%27 HTTP/1.1" 200 None
2026-03-30 07:38:14 [auto1.de] INFO: Scrape type for HT21123: 1
2026-03-30 07:38:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_b0ae0bbce386dd77db3df0e5b7d83fcd.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:14 [auto1.de] INFO: Found listing with ID: DZ62505
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ62505%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [auto1.de] INFO: Scrape type for DZ62505: 1
2026-03-30 07:38:15 [auto1.de] INFO: Found listing with ID: GH55253
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH55253%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [auto1.de] INFO: Scrape type for GH55253: 1
2026-03-30 07:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a0fe642-e709-5b24-a645-6aa7f0ca008d with identifier: UX02896
2026-03-30 07:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a0fe642-e709-5b24-a645-6aa7f0ca008d with scrape type 1
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a0fe642-e709-5b24-a645-6aa7f0ca008d
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F1a%252F631a794a470d319d0a3b94b36d9c6cd9%252Fpa%252FUX02896_e5ad6de9ad7f6e43f245f3588c4ba03d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_e5ad6de9ad7f6e43f245f3588c4ba03d.jpg already downloaded
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F1a%252F631a794a470d319d0a3b94b36d9c6cd9%252Fpa%252FUX02896_aa48616a3f5520cb3a4b8beac7375db5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_aa48616a3f5520cb3a4b8beac7375db5.jpg already downloaded
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F1a%252F631a794a470d319d0a3b94b36d9c6cd9%252Fpa%252FUX02896_1856b7474c1d5dfcb8b4161a61f36ee5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_1856b7474c1d5dfcb8b4161a61f36ee5.jpg already downloaded
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F1a%252F631a794a470d319d0a3b94b36d9c6cd9%252Fpa%252FUX02896_7916729c7c1928e4ed739c9fd72f4af5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_7916729c7c1928e4ed739c9fd72f4af5.jpg already downloaded
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F1a%252F631a794a470d319d0a3b94b36d9c6cd9%252Fpa%252FUX02896_0c2512e4145320ae6afc23242f026e40.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_0c2512e4145320ae6afc23242f026e40.jpg already downloaded
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F1a%252F631a794a470d319d0a3b94b36d9c6cd9%252Fpa%252FUX02896_4168d238e4656423e7eaabfda80e9b20.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_4168d238e4656423e7eaabfda80e9b20.jpg already downloaded
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F1a%252F631a794a470d319d0a3b94b36d9c6cd9%252Fpa%252FUX02896_8db30d7cbcfe1b738c8109cb06185537.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_8db30d7cbcfe1b738c8109cb06185537.jpg already downloaded
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F1a%252F631a794a470d319d0a3b94b36d9c6cd9%252Fpa%252FUX02896_ea49d687cd085f024025a9febf023c86.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_ea49d687cd085f024025a9febf023c86.jpg already downloaded
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F1a%252F631a794a470d319d0a3b94b36d9c6cd9%252Fpa%252FUX02896_f84d5978de533f8d5be638285da92d67.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_f84d5978de533f8d5be638285da92d67.jpg already downloaded
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg63%252F1a%252F631a794a470d319d0a3b94b36d9c6cd9%252Fpa%252FUX02896_a3c42f21cb4fc3b65f959da3d46d6c83.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_a3c42f21cb4fc3b65f959da3d46d6c83.jpg already downloaded
2026-03-30 07:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a0fe642-e709-5b24-a645-6aa7f0ca008d, identifier: UX02896
2026-03-30 07:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c842d76-15e9-515c-b8a6-1e75a88c95ee with identifier: MS93141
2026-03-30 07:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee with scrape type 1
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_39441b2711117fb19ed951f02ff57361.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_39441b2711117fb19ed951f02ff57361.jpg not downloaded yet
2026-03-30 07:38:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a0fe642-e709-5b24-a645-6aa7f0ca008d with identifier: UX02896
2026-03-30 07:38:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a0fe642-e709-5b24-a645-6aa7f0ca008d with identifier: UX02896
2026-03-30 07:38:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a0fe642-e709-5b24-a645-6aa7f0ca008d with identifier: UX02896 to the API
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UX02896>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:32:48Z',
 'fuel_type': 'petrol',
 'id': '2a0fe642-e709-5b24-a645-6aa7f0ca008d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX02896',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 148552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_e5ad6de9ad7f6e43f245f3588c4ba03d.jpg',
                'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_aa48616a3f5520cb3a4b8beac7375db5.jpg',
                'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_1856b7474c1d5dfcb8b4161a61f36ee5.jpg',
                'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_7916729c7c1928e4ed739c9fd72f4af5.jpg',
                'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_0c2512e4145320ae6afc23242f026e40.jpg',
                'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_4168d238e4656423e7eaabfda80e9b20.jpg',
                'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_8db30d7cbcfe1b738c8109cb06185537.jpg',
                'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_ea49d687cd085f024025a9febf023c86.jpg',
                'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_f84d5978de533f8d5be638285da92d67.jpg',
                'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_a3c42f21cb4fc3b65f959da3d46d6c83.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0fe642-e709-5b24-a645-6aa7f0ca008d/2a0fe642-e709-5b24-a645-6aa7f0ca008d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96394,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_e5ad6de9ad7f6e43f245f3588c4ba03d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0fe642-e709-5b24-a645-6aa7f0ca008d/2a0fe642-e709-5b24-a645-6aa7f0ca008d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_aa48616a3f5520cb3a4b8beac7375db5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0fe642-e709-5b24-a645-6aa7f0ca008d/2a0fe642-e709-5b24-a645-6aa7f0ca008d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_1856b7474c1d5dfcb8b4161a61f36ee5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0fe642-e709-5b24-a645-6aa7f0ca008d/2a0fe642-e709-5b24-a645-6aa7f0ca008d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2991947,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_7916729c7c1928e4ed739c9fd72f4af5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0fe642-e709-5b24-a645-6aa7f0ca008d/2a0fe642-e709-5b24-a645-6aa7f0ca008d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2974562,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_0c2512e4145320ae6afc23242f026e40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0fe642-e709-5b24-a645-6aa7f0ca008d/2a0fe642-e709-5b24-a645-6aa7f0ca008d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3391377,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_4168d238e4656423e7eaabfda80e9b20.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0fe642-e709-5b24-a645-6aa7f0ca008d/2a0fe642-e709-5b24-a645-6aa7f0ca008d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3401396,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_8db30d7cbcfe1b738c8109cb06185537.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0fe642-e709-5b24-a645-6aa7f0ca008d/2a0fe642-e709-5b24-a645-6aa7f0ca008d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_ea49d687cd085f024025a9febf023c86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0fe642-e709-5b24-a645-6aa7f0ca008d/2a0fe642-e709-5b24-a645-6aa7f0ca008d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3290255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_f84d5978de533f8d5be638285da92d67.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a0fe642-e709-5b24-a645-6aa7f0ca008d/2a0fe642-e709-5b24-a645-6aa7f0ca008d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88930,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img63/1a/631a794a470d319d0a3b94b36d9c6cd9/pa/UX02896_a3c42f21cb4fc3b65f959da3d46d6c83.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX02896%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [auto1.de] INFO: Saving data for UX02896: {'created_time': 1774856295.694969, 'last_price_update_time': 1774856295.69498, 'auction_closing_time': 1774971168.0}
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UX02896') HTTP/1.1" 204 0
2026-03-30 07:38:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_34ce4fa6a271d433d03bea9e4c6b9fd7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:15 [auto1.de] INFO: Found listing with ID: WH88293
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH88293%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [auto1.de] INFO: Scrape type for WH88293: 2
2026-03-30 07:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ceb32ea-b42c-55eb-a867-da666307a2fe with identifier: WH88293
2026-03-30 07:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ceb32ea-b42c-55eb-a867-da666307a2fe with scrape type 2
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ceb32ea-b42c-55eb-a867-da666307a2fe with scrape type 2
2026-03-30 07:38:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ceb32ea-b42c-55eb-a867-da666307a2fe, identifier: WH88293
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_d466e4acb3ae7fb9ab22b706d649530c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_d466e4acb3ae7fb9ab22b706d649530c.jpg not downloaded yet
2026-03-30 07:38:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfc5ebc5-31d9-5228-add7-2ed70b819b49 with identifier: NJ85165
2026-03-30 07:38:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfc5ebc5-31d9-5228-add7-2ed70b819b49 with scrape type 1
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfc5ebc5-31d9-5228-add7-2ed70b819b49
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F57%252F0457c8b8df394d772de0c6f8b60ec78a%252Fpa%252FNJ85165_cd368da2f9a77cf7362ef28c336ea19e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_cd368da2f9a77cf7362ef28c336ea19e.jpg already downloaded
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F57%252F0457c8b8df394d772de0c6f8b60ec78a%252Fpa%252FNJ85165_bcbea847ab75e425f70d2e490e8d4676.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_bcbea847ab75e425f70d2e490e8d4676.jpg already downloaded
2026-03-30 07:38:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F57%252F0457c8b8df394d772de0c6f8b60ec78a%252Fpa%252FNJ85165_6917d6f41c4d6104d4dc86896c629773.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_6917d6f41c4d6104d4dc86896c629773.jpg already downloaded
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F57%252F0457c8b8df394d772de0c6f8b60ec78a%252Fpa%252FNJ85165_34739509c4f6d7f2b7666442b093a940.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_34739509c4f6d7f2b7666442b093a940.jpg already downloaded
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F57%252F0457c8b8df394d772de0c6f8b60ec78a%252Fpa%252FNJ85165_677a8ddd6c9915edf5d561be6941ac88.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_677a8ddd6c9915edf5d561be6941ac88.jpg already downloaded
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F57%252F0457c8b8df394d772de0c6f8b60ec78a%252Fpa%252FNJ85165_aea54ac22527e1188c75be8cdf08596a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_aea54ac22527e1188c75be8cdf08596a.jpg already downloaded
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F57%252F0457c8b8df394d772de0c6f8b60ec78a%252Fpa%252FNJ85165_7056617e057d8704043024d73297f3a1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_7056617e057d8704043024d73297f3a1.jpg already downloaded
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F57%252F0457c8b8df394d772de0c6f8b60ec78a%252Fpa%252FNJ85165_fd7f31c02df797538f19ee3c73b05eb0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_fd7f31c02df797538f19ee3c73b05eb0.jpg already downloaded
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F57%252F0457c8b8df394d772de0c6f8b60ec78a%252Fpa%252FNJ85165_1d887bcc0dcf31dc8c09c0c3c77ab9cd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_1d887bcc0dcf31dc8c09c0c3c77ab9cd.jpg already downloaded
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg04%252F57%252F0457c8b8df394d772de0c6f8b60ec78a%252Fpa%252FNJ85165_219d2f738ffa41b63d64613725ff7610.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_219d2f738ffa41b63d64613725ff7610.jpg already downloaded
2026-03-30 07:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfc5ebc5-31d9-5228-add7-2ed70b819b49, identifier: NJ85165
2026-03-30 07:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408f60a3-9819-5a01-af3d-3f8328017256 with identifier: MT16554
2026-03-30 07:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408f60a3-9819-5a01-af3d-3f8328017256 with scrape type 1
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 408f60a3-9819-5a01-af3d-3f8328017256
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F3e%252Fa33e6dc5eb277280997cabfa88443bcb%252Fpa%252FMT16554_6282445594230933265223125d8da954.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_6282445594230933265223125d8da954.jpg already downloaded
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F3e%252Fa33e6dc5eb277280997cabfa88443bcb%252Fpa%252FMT16554_7034c35d58b0a2b3b933bf4af392915f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_7034c35d58b0a2b3b933bf4af392915f.jpg already downloaded
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F3e%252Fa33e6dc5eb277280997cabfa88443bcb%252Fpa%252FMT16554_beea0777c2237344bc80518c51e4f0cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_beea0777c2237344bc80518c51e4f0cf.jpg already downloaded
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F3e%252Fa33e6dc5eb277280997cabfa88443bcb%252Fpa%252FMT16554_516bb0cf2fab891e4c4c30fa545aab9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_516bb0cf2fab891e4c4c30fa545aab9a.jpg already downloaded
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F3e%252Fa33e6dc5eb277280997cabfa88443bcb%252Fpa%252FMT16554_35e9a76a01b6e1d5ab274381c3d494d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_35e9a76a01b6e1d5ab274381c3d494d7.jpg already downloaded
2026-03-30 07:38:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 408f60a3-9819-5a01-af3d-3f8328017256, identifier: MT16554
2026-03-30 07:38:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36730f29-ae50-5233-9c5e-54171b280638 with identifier: DD06486
2026-03-30 07:38:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36730f29-ae50-5233-9c5e-54171b280638 with scrape type 1
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 36730f29-ae50-5233-9c5e-54171b280638
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_57a912a07754f3cde99bab46b8425c07.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_57a912a07754f3cde99bab46b8425c07.jpg not downloaded yet
2026-03-30 07:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_d927f71163a71b04453e1144938d10db.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_27388774142fac6480c9f827883a1aa6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_7ecdd5920bfcf1b8ab8f965b487bd2bd.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_a77214b46a30dc512e5827ac295b3a4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_847ec5647a86f908820fc3744ba282ac.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ceb32ea-b42c-55eb-a867-da666307a2fe with identifier: WH88293
2026-03-30 07:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ceb32ea-b42c-55eb-a867-da666307a2fe with identifier: WH88293
2026-03-30 07:38:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ceb32ea-b42c-55eb-a867-da666307a2fe with identifier: WH88293 to the API
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:58:12Z',
 'fuel_type': 'diesel',
 'id': '9ceb32ea-b42c-55eb-a867-da666307a2fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH88293',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 289898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-12',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH88293%27 HTTP/1.1" 200 None
2026-03-30 07:38:16 [auto1.de] INFO: Saving data for WH88293: {'auction_closing_time': 1774972692.0, 'created_time': 1774381400.401108, 'last_price_update_time': 1774856296.857909}
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH88293') HTTP/1.1" 204 0
2026-03-30 07:38:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZT52694> (referer: https://www.auto1.com/v1/car-details-view/ZT52694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfc5ebc5-31d9-5228-add7-2ed70b819b49 with identifier: NJ85165
2026-03-30 07:38:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfc5ebc5-31d9-5228-add7-2ed70b819b49 with identifier: NJ85165
2026-03-30 07:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfc5ebc5-31d9-5228-add7-2ed70b819b49 with identifier: NJ85165 to the API
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NJ85165>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.4L',
 'engine_horse_power': 215,
 'expiration_date': '2026-03-31T15:23:28Z',
 'fuel_type': 'diesel',
 'id': 'cfc5ebc5-31d9-5228-add7-2ed70b819b49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ85165',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 126708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_cd368da2f9a77cf7362ef28c336ea19e.jpg',
                'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_bcbea847ab75e425f70d2e490e8d4676.jpg',
                'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_6917d6f41c4d6104d4dc86896c629773.jpg',
                'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_34739509c4f6d7f2b7666442b093a940.jpg',
                'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_677a8ddd6c9915edf5d561be6941ac88.jpg',
                'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_aea54ac22527e1188c75be8cdf08596a.jpg',
                'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_7056617e057d8704043024d73297f3a1.jpg',
                'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_fd7f31c02df797538f19ee3c73b05eb0.jpg',
                'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_1d887bcc0dcf31dc8c09c0c3c77ab9cd.jpg',
                'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_219d2f738ffa41b63d64613725ff7610.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc5ebc5-31d9-5228-add7-2ed70b819b49/cfc5ebc5-31d9-5228-add7-2ed70b819b49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87618,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_cd368da2f9a77cf7362ef28c336ea19e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc5ebc5-31d9-5228-add7-2ed70b819b49/cfc5ebc5-31d9-5228-add7-2ed70b819b49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78832,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_bcbea847ab75e425f70d2e490e8d4676.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc5ebc5-31d9-5228-add7-2ed70b819b49/cfc5ebc5-31d9-5228-add7-2ed70b819b49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_6917d6f41c4d6104d4dc86896c629773.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc5ebc5-31d9-5228-add7-2ed70b819b49/cfc5ebc5-31d9-5228-add7-2ed70b819b49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_34739509c4f6d7f2b7666442b093a940.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc5ebc5-31d9-5228-add7-2ed70b819b49/cfc5ebc5-31d9-5228-add7-2ed70b819b49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_677a8ddd6c9915edf5d561be6941ac88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc5ebc5-31d9-5228-add7-2ed70b819b49/cfc5ebc5-31d9-5228-add7-2ed70b819b49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_aea54ac22527e1188c75be8cdf08596a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc5ebc5-31d9-5228-add7-2ed70b819b49/cfc5ebc5-31d9-5228-add7-2ed70b819b49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60326,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_7056617e057d8704043024d73297f3a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc5ebc5-31d9-5228-add7-2ed70b819b49/cfc5ebc5-31d9-5228-add7-2ed70b819b49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68428,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_fd7f31c02df797538f19ee3c73b05eb0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc5ebc5-31d9-5228-add7-2ed70b819b49/cfc5ebc5-31d9-5228-add7-2ed70b819b49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_1d887bcc0dcf31dc8c09c0c3c77ab9cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfc5ebc5-31d9-5228-add7-2ed70b819b49/cfc5ebc5-31d9-5228-add7-2ed70b819b49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66405,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img04/57/0457c8b8df394d772de0c6f8b60ec78a/pa/NJ85165_219d2f738ffa41b63d64613725ff7610.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2012}
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ85165%27 HTTP/1.1" 200 None
2026-03-30 07:38:17 [auto1.de] INFO: Saving data for NJ85165: {'created_time': 1774856297.859184, 'last_price_update_time': 1774856297.859197, 'auction_closing_time': 1774970608.0}
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NJ85165') HTTP/1.1" 204 0
2026-03-30 07:38:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 408f60a3-9819-5a01-af3d-3f8328017256 with identifier: MT16554
2026-03-30 07:38:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 408f60a3-9819-5a01-af3d-3f8328017256 with identifier: MT16554
2026-03-30 07:38:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 408f60a3-9819-5a01-af3d-3f8328017256 with identifier: MT16554 to the API
2026-03-30 07:38:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MT16554>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:02:28Z',
 'fuel_type': 'diesel',
 'id': '408f60a3-9819-5a01-af3d-3f8328017256',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT16554',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 316697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_6282445594230933265223125d8da954.jpg',
                'https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_7034c35d58b0a2b3b933bf4af392915f.jpg',
                'https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_beea0777c2237344bc80518c51e4f0cf.jpg',
                'https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_516bb0cf2fab891e4c4c30fa545aab9a.jpg',
                'https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_35e9a76a01b6e1d5ab274381c3d494d7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408f60a3-9819-5a01-af3d-3f8328017256/408f60a3-9819-5a01-af3d-3f8328017256_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_6282445594230933265223125d8da954.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408f60a3-9819-5a01-af3d-3f8328017256/408f60a3-9819-5a01-af3d-3f8328017256_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75774,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_7034c35d58b0a2b3b933bf4af392915f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408f60a3-9819-5a01-af3d-3f8328017256/408f60a3-9819-5a01-af3d-3f8328017256_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_beea0777c2237344bc80518c51e4f0cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408f60a3-9819-5a01-af3d-3f8328017256/408f60a3-9819-5a01-af3d-3f8328017256_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_516bb0cf2fab891e4c4c30fa545aab9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408f60a3-9819-5a01-af3d-3f8328017256/408f60a3-9819-5a01-af3d-3f8328017256_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110708,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/3e/a33e6dc5eb277280997cabfa88443bcb/pa/MT16554_35e9a76a01b6e1d5ab274381c3d494d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2011}
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT16554%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [auto1.de] INFO: Saving data for MT16554: {'created_time': 1774856298.225061, 'last_price_update_time': 1774856298.225075, 'auction_closing_time': 1774969348.0}
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT16554') HTTP/1.1" 204 0
2026-03-30 07:38:18 [auto1.de] INFO: Found listing with ID: RF59698
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF59698%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [auto1.de] INFO: Scrape type for RF59698: 1
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_f7f699bb7157565cb37e11a890a31bc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_f7f699bb7157565cb37e11a890a31bc4.jpg not downloaded yet
2026-03-30 07:38:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_0d42508b0b33955e6c6b480ed56aa547.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_0d42508b0b33955e6c6b480ed56aa547.jpg not downloaded yet
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2214790>
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_0d3cfc89d469c9499b47a244e612aaf3.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_0d3cfc89d469c9499b47a244e612aaf3.jpg saved to cache
2026-03-30 07:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2470c10>
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_b0ae0bbce386dd77db3df0e5b7d83fcd.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_b0ae0bbce386dd77db3df0e5b7d83fcd.jpg saved to cache
2026-03-30 07:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf3dec33-89d4-5221-9139-a5056fae806e
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d67950>
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_34ce4fa6a271d433d03bea9e4c6b9fd7.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_34ce4fa6a271d433d03bea9e4c6b9fd7.jpg saved to cache
2026-03-30 07:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292
2026-03-30 07:38:18 [auto1.de] INFO: Found listing with ID: XW26615
2026-03-30 07:38:18 [auto1.de] INFO: Found listing with ID: UM20037
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM20037%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [auto1.de] INFO: Scrape type for UM20037: 2
2026-03-30 07:38:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c52538e2-54ea-581b-a5ef-de8ba7d17d7c with identifier: UM20037
2026-03-30 07:38:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c52538e2-54ea-581b-a5ef-de8ba7d17d7c with scrape type 2
2026-03-30 07:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c52538e2-54ea-581b-a5ef-de8ba7d17d7c with scrape type 2
2026-03-30 07:38:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c52538e2-54ea-581b-a5ef-de8ba7d17d7c, identifier: UM20037
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_068378a17814507f29c85f15908e0150.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_068378a17814507f29c85f15908e0150.jpg not downloaded yet
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_20e17a51faea81345f944cdc59d1783d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_20e17a51faea81345f944cdc59d1783d.jpg not downloaded yet
2026-03-30 07:38:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c52538e2-54ea-581b-a5ef-de8ba7d17d7c with identifier: UM20037
2026-03-30 07:38:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c52538e2-54ea-581b-a5ef-de8ba7d17d7c with identifier: UM20037
2026-03-30 07:38:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c52538e2-54ea-581b-a5ef-de8ba7d17d7c with identifier: UM20037 to the API
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:46:48Z',
 'fuel_type': 'petrol',
 'id': 'c52538e2-54ea-581b-a5ef-de8ba7d17d7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM20037',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 212550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-30 07:38:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM20037%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [auto1.de] INFO: Saving data for UM20037: {'auction_closing_time': 1774972008.0, 'created_time': 1774380433.284586, 'last_price_update_time': 1774856299.002666}
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM20037') HTTP/1.1" 204 0
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2ff9bd0>
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_d927f71163a71b04453e1144938d10db.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_d927f71163a71b04453e1144938d10db.jpg saved to cache
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d249cc10>
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_27388774142fac6480c9f827883a1aa6.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_27388774142fac6480c9f827883a1aa6.jpg saved to cache
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d210d1d0>
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_7ecdd5920bfcf1b8ab8f965b487bd2bd.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_7ecdd5920bfcf1b8ab8f965b487bd2bd.jpg saved to cache
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf3dec33-89d4-5221-9139-a5056fae806e
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d8e19810>
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_a77214b46a30dc512e5827ac295b3a4c.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_a77214b46a30dc512e5827ac295b3a4c.jpg saved to cache
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf3dec33-89d4-5221-9139-a5056fae806e
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d210cf10>
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_847ec5647a86f908820fc3744ba282ac.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_847ec5647a86f908820fc3744ba282ac.jpg saved to cache
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf3dec33-89d4-5221-9139-a5056fae806e
2026-03-30 07:38:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87e9cc4c-d341-5845-aea4-9ec395ec3bed with identifier: ZT52694
2026-03-30 07:38:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87e9cc4c-d341-5845-aea4-9ec395ec3bed with scrape type 1
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87e9cc4c-d341-5845-aea4-9ec395ec3bed
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F8a%252F338a444c419711cec9b855aa2dfbf4d8%252Fpa%252FZT52694_2939b0c9f1179d1e2eef3a64a5a7f585.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_2939b0c9f1179d1e2eef3a64a5a7f585.jpg already downloaded
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F8a%252F338a444c419711cec9b855aa2dfbf4d8%252Fpa%252FZT52694_5a154c7192fb3543a8f6ab37186db3f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_5a154c7192fb3543a8f6ab37186db3f8.jpg already downloaded
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F8a%252F338a444c419711cec9b855aa2dfbf4d8%252Fpa%252FZT52694_fd746e620e2edb8afa0f022d8ce2db11.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_fd746e620e2edb8afa0f022d8ce2db11.jpg already downloaded
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F8a%252F338a444c419711cec9b855aa2dfbf4d8%252Fpa%252FZT52694_5411337ae3712723bbab1e25c9d848ff.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_5411337ae3712723bbab1e25c9d848ff.jpg already downloaded
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F8a%252F338a444c419711cec9b855aa2dfbf4d8%252Fpa%252FZT52694_f1f19edb5eb9872a76ed3006505cecbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_f1f19edb5eb9872a76ed3006505cecbc.jpg already downloaded
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F8a%252F338a444c419711cec9b855aa2dfbf4d8%252Fpa%252FZT52694_ba9c6cec9f6794a6d83310cb93cb46de.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_ba9c6cec9f6794a6d83310cb93cb46de.jpg already downloaded
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F8a%252F338a444c419711cec9b855aa2dfbf4d8%252Fpa%252FZT52694_54b1542d033cc99d5b7a3518be67d107.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_54b1542d033cc99d5b7a3518be67d107.jpg already downloaded
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F8a%252F338a444c419711cec9b855aa2dfbf4d8%252Fpa%252FZT52694_5afcc61485d8b9888655e1173fab73c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_5afcc61485d8b9888655e1173fab73c5.jpg already downloaded
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F8a%252F338a444c419711cec9b855aa2dfbf4d8%252Fpa%252FZT52694_35a3cdf0119e5db9cdb21968f4fb5611.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_35a3cdf0119e5db9cdb21968f4fb5611.jpg already downloaded
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg33%252F8a%252F338a444c419711cec9b855aa2dfbf4d8%252Fpa%252FZT52694_3e0499eb7bfd0595fe2e038403544f0e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_3e0499eb7bfd0595fe2e038403544f0e.jpg already downloaded
2026-03-30 07:38:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87e9cc4c-d341-5845-aea4-9ec395ec3bed, identifier: ZT52694
2026-03-30 07:38:19 [auto1.de] INFO: Found listing with ID: JB45196
2026-03-30 07:38:19 [auto1.de] INFO: Found listing with ID: CW07169
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW07169%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [auto1.de] INFO: Scrape type for CW07169: 1
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_1f9f97b63f1a3914c7e5f3f76de4e83a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_1f9f97b63f1a3914c7e5f3f76de4e83a.jpg not downloaded yet
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_f793547dcbfe2b307ae8808f48261f77.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_f793547dcbfe2b307ae8808f48261f77.jpg not downloaded yet
2026-03-30 07:38:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87e9cc4c-d341-5845-aea4-9ec395ec3bed with identifier: ZT52694
2026-03-30 07:38:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87e9cc4c-d341-5845-aea4-9ec395ec3bed with identifier: ZT52694
2026-03-30 07:38:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87e9cc4c-d341-5845-aea4-9ec395ec3bed with identifier: ZT52694 to the API
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZT52694>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:43:17Z',
 'fuel_type': 'petrol',
 'id': '87e9cc4c-d341-5845-aea4-9ec395ec3bed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT52694',
 'listing': 'auction',
 'location': 'DE, Hattingen',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 120481,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_2939b0c9f1179d1e2eef3a64a5a7f585.jpg',
                'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_5a154c7192fb3543a8f6ab37186db3f8.jpg',
                'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_fd746e620e2edb8afa0f022d8ce2db11.jpg',
                'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_5411337ae3712723bbab1e25c9d848ff.jpg',
                'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_f1f19edb5eb9872a76ed3006505cecbc.jpg',
                'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_ba9c6cec9f6794a6d83310cb93cb46de.jpg',
                'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_54b1542d033cc99d5b7a3518be67d107.jpg',
                'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_5afcc61485d8b9888655e1173fab73c5.jpg',
                'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_35a3cdf0119e5db9cdb21968f4fb5611.jpg',
                'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_3e0499eb7bfd0595fe2e038403544f0e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e9cc4c-d341-5845-aea4-9ec395ec3bed/87e9cc4c-d341-5845-aea4-9ec395ec3bed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58286,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_2939b0c9f1179d1e2eef3a64a5a7f585.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e9cc4c-d341-5845-aea4-9ec395ec3bed/87e9cc4c-d341-5845-aea4-9ec395ec3bed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_5a154c7192fb3543a8f6ab37186db3f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e9cc4c-d341-5845-aea4-9ec395ec3bed/87e9cc4c-d341-5845-aea4-9ec395ec3bed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_fd746e620e2edb8afa0f022d8ce2db11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e9cc4c-d341-5845-aea4-9ec395ec3bed/87e9cc4c-d341-5845-aea4-9ec395ec3bed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_5411337ae3712723bbab1e25c9d848ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e9cc4c-d341-5845-aea4-9ec395ec3bed/87e9cc4c-d341-5845-aea4-9ec395ec3bed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_f1f19edb5eb9872a76ed3006505cecbc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e9cc4c-d341-5845-aea4-9ec395ec3bed/87e9cc4c-d341-5845-aea4-9ec395ec3bed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51415,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_ba9c6cec9f6794a6d83310cb93cb46de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e9cc4c-d341-5845-aea4-9ec395ec3bed/87e9cc4c-d341-5845-aea4-9ec395ec3bed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49538,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_54b1542d033cc99d5b7a3518be67d107.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e9cc4c-d341-5845-aea4-9ec395ec3bed/87e9cc4c-d341-5845-aea4-9ec395ec3bed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_5afcc61485d8b9888655e1173fab73c5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e9cc4c-d341-5845-aea4-9ec395ec3bed/87e9cc4c-d341-5845-aea4-9ec395ec3bed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60281,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_35a3cdf0119e5db9cdb21968f4fb5611.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e9cc4c-d341-5845-aea4-9ec395ec3bed/87e9cc4c-d341-5845-aea4-9ec395ec3bed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56547,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img33/8a/338a444c419711cec9b855aa2dfbf4d8/pa/ZT52694_3e0499eb7bfd0595fe2e038403544f0e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT52694%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [auto1.de] INFO: Saving data for ZT52694: {'created_time': 1774856300.030963, 'last_price_update_time': 1774856300.030978, 'auction_closing_time': 1774971797.0}
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT52694') HTTP/1.1" 204 0
2026-03-30 07:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_4f3200e3e92a5346734b2882cd9efc51.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: CS17567
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS17567%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [auto1.de] INFO: Scrape type for CS17567: 2
2026-03-30 07:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4aa7488-0d2c-52f5-a52a-576179fa6ce5 with identifier: CS17567
2026-03-30 07:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4aa7488-0d2c-52f5-a52a-576179fa6ce5 with scrape type 2
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4aa7488-0d2c-52f5-a52a-576179fa6ce5 with scrape type 2
2026-03-30 07:38:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4aa7488-0d2c-52f5-a52a-576179fa6ce5, identifier: CS17567
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_e5686b02320c622ef31b157d95e534b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_e5686b02320c622ef31b157d95e534b4.jpg not downloaded yet
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_6e017aa215ac99272477e759ac18c7ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_6e017aa215ac99272477e759ac18c7ab.jpg not downloaded yet
2026-03-30 07:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NF89910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC65117/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4aa7488-0d2c-52f5-a52a-576179fa6ce5 with identifier: CS17567
2026-03-30 07:38:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4aa7488-0d2c-52f5-a52a-576179fa6ce5 with identifier: CS17567
2026-03-30 07:38:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4aa7488-0d2c-52f5-a52a-576179fa6ce5 with identifier: CS17567 to the API
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:10:30Z',
 'fuel_type': 'diesel',
 'id': 'e4aa7488-0d2c-52f5-a52a-576179fa6ce5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS17567',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 89998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-09',
 'seller_name': None,
 'title': 'Audi Q5 35 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2020}
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS17567%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [auto1.de] INFO: Saving data for CS17567: {'auction_closing_time': 1774969830.0, 'created_time': 1773429031.87251, 'last_price_update_time': 1774856300.779142}
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS17567') HTTP/1.1" 204 0
2026-03-30 07:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF72847> (referer: https://www.auto1.com/v1/car-details-view/BF72847/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW65340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: LY36951
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: CX43876
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX43876%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [auto1.de] INFO: Scrape type for CX43876: 1
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_227d5cbb805512b39aa71021cebe0c4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_227d5cbb805512b39aa71021cebe0c4c.jpg not downloaded yet
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_4c788789eb05915443b215ab7cb107c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_4c788789eb05915443b215ab7cb107c0.jpg not downloaded yet
2026-03-30 07:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d237d510>
2026-03-30 07:38:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_4f3200e3e92a5346734b2882cd9efc51.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_4f3200e3e92a5346734b2882cd9efc51.jpg saved to cache
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf3dec33-89d4-5221-9139-a5056fae806e
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: UX30776
2026-03-30 07:38:20 [auto1.de] INFO: Found listing with ID: SP41930
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_b3a9a0c6631c734cf35ac5ea21b4b2fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_b3a9a0c6631c734cf35ac5ea21b4b2fd.jpg not downloaded yet
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_83f7abd7d77a0930d87364cd156768b7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_83f7abd7d77a0930d87364cd156768b7.jpg not downloaded yet
2026-03-30 07:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_1f9f97b63f1a3914c7e5f3f76de4e83a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_1fd6bdf09a209677d9de3a851cafe78b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_1fd6bdf09a209677d9de3a851cafe78b.jpg not downloaded yet
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_d386d529d94ffb5764149dce01e6ef1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_d386d529d94ffb5764149dce01e6ef1b.jpg not downloaded yet
2026-03-30 07:38:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_f793547dcbfe2b307ae8808f48261f77.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c9dba65-c10a-5813-ac14-1303617890a6 with identifier: BF72847
2026-03-30 07:38:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c9dba65-c10a-5813-ac14-1303617890a6 with scrape type 1
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 9c9dba65-c10a-5813-ac14-1303617890a6
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F58%252F155898893bc774298a338cc867eb4351%252Fpa%252FBF72847_57214592a98f4be5e5dce28b7dbb0534.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_57214592a98f4be5e5dce28b7dbb0534.jpg already downloaded
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F58%252F155898893bc774298a338cc867eb4351%252Fpa%252FBF72847_717bab60e308c2f87ca2e46c52526555.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_717bab60e308c2f87ca2e46c52526555.jpg already downloaded
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F58%252F155898893bc774298a338cc867eb4351%252Fpa%252FBF72847_21d523e43f9bb125c083bef9c09472de.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_21d523e43f9bb125c083bef9c09472de.jpg already downloaded
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F58%252F155898893bc774298a338cc867eb4351%252Fpa%252FBF72847_fbaea6e2c8f460e2242026c3fd7af679.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_fbaea6e2c8f460e2242026c3fd7af679.jpg already downloaded
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F58%252F155898893bc774298a338cc867eb4351%252Fpa%252FBF72847_7153f4d2aba976171b6d23f2a004ad45.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_7153f4d2aba976171b6d23f2a004ad45.jpg already downloaded
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg15%252F58%252F155898893bc774298a338cc867eb4351%252Fpa%252FBF72847_34064e2e5c5ef0376ce52572fb9ed8b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_34064e2e5c5ef0376ce52572fb9ed8b2.jpg already downloaded
2026-03-30 07:38:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c9dba65-c10a-5813-ac14-1303617890a6, identifier: BF72847
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_84842057dddf30194ba085e3d3b919d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_84842057dddf30194ba085e3d3b919d1.jpg not downloaded yet
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_284187b06de17cf1e64ea2dfb03ae32a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_284187b06de17cf1e64ea2dfb03ae32a.jpg not downloaded yet
2026-03-30 07:38:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c9dba65-c10a-5813-ac14-1303617890a6 with identifier: BF72847
2026-03-30 07:38:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c9dba65-c10a-5813-ac14-1303617890a6 with identifier: BF72847
2026-03-30 07:38:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c9dba65-c10a-5813-ac14-1303617890a6 with identifier: BF72847 to the API
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BF72847>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:51:34Z',
 'fuel_type': 'petrol',
 'id': '9c9dba65-c10a-5813-ac14-1303617890a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF72847',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 124114,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_57214592a98f4be5e5dce28b7dbb0534.jpg',
                'https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_717bab60e308c2f87ca2e46c52526555.jpg',
                'https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_21d523e43f9bb125c083bef9c09472de.jpg',
                'https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_fbaea6e2c8f460e2242026c3fd7af679.jpg',
                'https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_7153f4d2aba976171b6d23f2a004ad45.jpg',
                'https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_34064e2e5c5ef0376ce52572fb9ed8b2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9dba65-c10a-5813-ac14-1303617890a6/9c9dba65-c10a-5813-ac14-1303617890a6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_57214592a98f4be5e5dce28b7dbb0534.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9dba65-c10a-5813-ac14-1303617890a6/9c9dba65-c10a-5813-ac14-1303617890a6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93268,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_717bab60e308c2f87ca2e46c52526555.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9dba65-c10a-5813-ac14-1303617890a6/9c9dba65-c10a-5813-ac14-1303617890a6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_21d523e43f9bb125c083bef9c09472de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9dba65-c10a-5813-ac14-1303617890a6/9c9dba65-c10a-5813-ac14-1303617890a6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_fbaea6e2c8f460e2242026c3fd7af679.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9dba65-c10a-5813-ac14-1303617890a6/9c9dba65-c10a-5813-ac14-1303617890a6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126083,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_7153f4d2aba976171b6d23f2a004ad45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9c9dba65-c10a-5813-ac14-1303617890a6/9c9dba65-c10a-5813-ac14-1303617890a6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81839,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img15/58/155898893bc774298a338cc867eb4351/pa/BF72847_34064e2e5c5ef0376ce52572fb9ed8b2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-17',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF72847%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [auto1.de] INFO: Saving data for BF72847: {'created_time': 1774856301.580233, 'last_price_update_time': 1774856301.580246, 'auction_closing_time': 1774972294.0}
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BF72847') HTTP/1.1" 204 0
2026-03-30 07:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_6e017aa215ac99272477e759ac18c7ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB26940> (referer: https://www.auto1.com/v1/car-details-view/GB26940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_83f7abd7d77a0930d87364cd156768b7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_b25e180af7e6247e88e6485f826b0227.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_b25e180af7e6247e88e6485f826b0227.jpg not downloaded yet
2026-03-30 07:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX31809> (referer: https://www.auto1.com/v1/car-details-view/CX31809/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR43739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22f7b10>
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_1f9f97b63f1a3914c7e5f3f76de4e83a.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_1f9f97b63f1a3914c7e5f3f76de4e83a.jpg saved to cache
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d06f50>
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_f793547dcbfe2b307ae8808f48261f77.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_f793547dcbfe2b307ae8808f48261f77.jpg saved to cache
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 36730f29-ae50-5233-9c5e-54171b280638
2026-03-30 07:38:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d91e6f90>
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_6e017aa215ac99272477e759ac18c7ab.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_6e017aa215ac99272477e759ac18c7ab.jpg saved to cache
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 36730f29-ae50-5233-9c5e-54171b280638
2026-03-30 07:38:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4269541-3a68-56c9-a7e6-2e81d1bb9b42 with identifier: GB26940
2026-03-30 07:38:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4269541-3a68-56c9-a7e6-2e81d1bb9b42 with scrape type 1
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4269541-3a68-56c9-a7e6-2e81d1bb9b42
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7e%252F877eceec7205a7272b6fb751fe5693af%252Fpa%252FGB26940_9a87ad19afe9d53c332ebaf9abd4d8fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_9a87ad19afe9d53c332ebaf9abd4d8fa.jpg already downloaded
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7e%252F877eceec7205a7272b6fb751fe5693af%252Fpa%252FGB26940_5ad2a407e077f2ead6adb2ac87dbd290.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_5ad2a407e077f2ead6adb2ac87dbd290.jpg already downloaded
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7e%252F877eceec7205a7272b6fb751fe5693af%252Fpa%252FGB26940_c332a1a8770b827e0b5c4112f646299e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_c332a1a8770b827e0b5c4112f646299e.jpg already downloaded
2026-03-30 07:38:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7e%252F877eceec7205a7272b6fb751fe5693af%252Fpa%252FGB26940_a0f2c8dcd672936d44bc3d7c4cf75459.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_a0f2c8dcd672936d44bc3d7c4cf75459.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7e%252F877eceec7205a7272b6fb751fe5693af%252Fpa%252FGB26940_a1df651935efae17895ce5d134eeb7c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_a1df651935efae17895ce5d134eeb7c9.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7e%252F877eceec7205a7272b6fb751fe5693af%252Fpa%252FGB26940_d1f8ac8a563be1e33e9e65531674795e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_d1f8ac8a563be1e33e9e65531674795e.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7e%252F877eceec7205a7272b6fb751fe5693af%252Fpa%252FGB26940_a19426679b3212ff9c1d154d14b3c67a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_a19426679b3212ff9c1d154d14b3c67a.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7e%252F877eceec7205a7272b6fb751fe5693af%252Fpa%252FGB26940_59b8bb3e5733aec86d9a9d409bca126d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_59b8bb3e5733aec86d9a9d409bca126d.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7e%252F877eceec7205a7272b6fb751fe5693af%252Fpa%252FGB26940_8d348c04bd5b66e044590d27be43c87f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_8d348c04bd5b66e044590d27be43c87f.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252F7e%252F877eceec7205a7272b6fb751fe5693af%252Fpa%252FGB26940_bc86af38c112054cd762cfc1459098b5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_bc86af38c112054cd762cfc1459098b5.jpg already downloaded
2026-03-30 07:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4269541-3a68-56c9-a7e6-2e81d1bb9b42, identifier: GB26940
2026-03-30 07:38:22 [auto1.de] INFO: Channel: 24h | Page: 20 | totalHits: 7794 | hits on page: 40
2026-03-30 07:38:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d211ca50>
2026-03-30 07:38:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_83f7abd7d77a0930d87364cd156768b7.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_83f7abd7d77a0930d87364cd156768b7.jpg saved to cache
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 36730f29-ae50-5233-9c5e-54171b280638
2026-03-30 07:38:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66 with identifier: CX31809
2026-03-30 07:38:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66 with scrape type 1
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F10%252F5010867f8dadd1510c3ececd783045bf%252Fpa%252FCX31809_076f5bb9f6df9d2e1c0656fa8e05f726.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_076f5bb9f6df9d2e1c0656fa8e05f726.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F10%252F5010867f8dadd1510c3ececd783045bf%252Fpa%252FCX31809_fe2d496fa7bb3a46cd052000a50b3fab.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_fe2d496fa7bb3a46cd052000a50b3fab.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F10%252F5010867f8dadd1510c3ececd783045bf%252Fpa%252FCX31809_d253bbe7fd8703b57892c33a33e42403.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_d253bbe7fd8703b57892c33a33e42403.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F10%252F5010867f8dadd1510c3ececd783045bf%252Fpa%252FCX31809_a7fca870f5c2a0fadf420fa7c1171f1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_a7fca870f5c2a0fadf420fa7c1171f1d.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F10%252F5010867f8dadd1510c3ececd783045bf%252Fpa%252FCX31809_d9ab2a7ee14c10a3499174506d30533c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_d9ab2a7ee14c10a3499174506d30533c.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F10%252F5010867f8dadd1510c3ececd783045bf%252Fpa%252FCX31809_a2f9c09364cb7e922490935dbc362130.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_a2f9c09364cb7e922490935dbc362130.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F10%252F5010867f8dadd1510c3ececd783045bf%252Fpa%252FCX31809_3f3e12255bd28696636a91e15db59d80.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_3f3e12255bd28696636a91e15db59d80.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F10%252F5010867f8dadd1510c3ececd783045bf%252Fpa%252FCX31809_37ef3bfc20a1d8bf7eb2a4a1ec3579aa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_37ef3bfc20a1d8bf7eb2a4a1ec3579aa.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F10%252F5010867f8dadd1510c3ececd783045bf%252Fpa%252FCX31809_c1388367df3890a40fa3b9e179bcacba.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_c1388367df3890a40fa3b9e179bcacba.jpg already downloaded
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252F10%252F5010867f8dadd1510c3ececd783045bf%252Fpa%252FCX31809_fbc7a689ec3f71aa15483005f04af956.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_fbc7a689ec3f71aa15483005f04af956.jpg already downloaded
2026-03-30 07:38:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66, identifier: CX31809
2026-03-30 07:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4269541-3a68-56c9-a7e6-2e81d1bb9b42 with identifier: GB26940
2026-03-30 07:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4269541-3a68-56c9-a7e6-2e81d1bb9b42 with identifier: GB26940
2026-03-30 07:38:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4269541-3a68-56c9-a7e6-2e81d1bb9b42 with identifier: GB26940 to the API
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GB26940>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:34:40Z',
 'fuel_type': 'diesel',
 'id': 'd4269541-3a68-56c9-a7e6-2e81d1bb9b42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB26940',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 228032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_9a87ad19afe9d53c332ebaf9abd4d8fa.jpg',
                'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_5ad2a407e077f2ead6adb2ac87dbd290.jpg',
                'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_c332a1a8770b827e0b5c4112f646299e.jpg',
                'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_a0f2c8dcd672936d44bc3d7c4cf75459.jpg',
                'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_a1df651935efae17895ce5d134eeb7c9.jpg',
                'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_d1f8ac8a563be1e33e9e65531674795e.jpg',
                'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_a19426679b3212ff9c1d154d14b3c67a.jpg',
                'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_59b8bb3e5733aec86d9a9d409bca126d.jpg',
                'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_8d348c04bd5b66e044590d27be43c87f.jpg',
                'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_bc86af38c112054cd762cfc1459098b5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269541-3a68-56c9-a7e6-2e81d1bb9b42/d4269541-3a68-56c9-a7e6-2e81d1bb9b42_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_9a87ad19afe9d53c332ebaf9abd4d8fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269541-3a68-56c9-a7e6-2e81d1bb9b42/d4269541-3a68-56c9-a7e6-2e81d1bb9b42_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_5ad2a407e077f2ead6adb2ac87dbd290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269541-3a68-56c9-a7e6-2e81d1bb9b42/d4269541-3a68-56c9-a7e6-2e81d1bb9b42_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_c332a1a8770b827e0b5c4112f646299e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269541-3a68-56c9-a7e6-2e81d1bb9b42/d4269541-3a68-56c9-a7e6-2e81d1bb9b42_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80329,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_a0f2c8dcd672936d44bc3d7c4cf75459.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269541-3a68-56c9-a7e6-2e81d1bb9b42/d4269541-3a68-56c9-a7e6-2e81d1bb9b42_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_a1df651935efae17895ce5d134eeb7c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269541-3a68-56c9-a7e6-2e81d1bb9b42/d4269541-3a68-56c9-a7e6-2e81d1bb9b42_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_d1f8ac8a563be1e33e9e65531674795e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269541-3a68-56c9-a7e6-2e81d1bb9b42/d4269541-3a68-56c9-a7e6-2e81d1bb9b42_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85067,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_a19426679b3212ff9c1d154d14b3c67a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269541-3a68-56c9-a7e6-2e81d1bb9b42/d4269541-3a68-56c9-a7e6-2e81d1bb9b42_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_59b8bb3e5733aec86d9a9d409bca126d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269541-3a68-56c9-a7e6-2e81d1bb9b42/d4269541-3a68-56c9-a7e6-2e81d1bb9b42_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_8d348c04bd5b66e044590d27be43c87f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d4269541-3a68-56c9-a7e6-2e81d1bb9b42/d4269541-3a68-56c9-a7e6-2e81d1bb9b42_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/7e/877eceec7205a7272b6fb751fe5693af/pa/GB26940_bc86af38c112054cd762cfc1459098b5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 220 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2018}
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB26940%27 HTTP/1.1" 200 None
2026-03-30 07:38:22 [auto1.de] INFO: Saving data for GB26940: {'created_time': 1774856302.910041, 'last_price_update_time': 1774856302.910054, 'auction_closing_time': 1774971280.0}
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GB26940') HTTP/1.1" 204 0
2026-03-30 07:38:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66 with identifier: CX31809
2026-03-30 07:38:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66 with identifier: CX31809
2026-03-30 07:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66 with identifier: CX31809 to the API
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CX31809>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:40:46Z',
 'fuel_type': 'petrol',
 'id': '6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX31809',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 125717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_076f5bb9f6df9d2e1c0656fa8e05f726.jpg',
                'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_fe2d496fa7bb3a46cd052000a50b3fab.jpg',
                'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_d253bbe7fd8703b57892c33a33e42403.jpg',
                'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_a7fca870f5c2a0fadf420fa7c1171f1d.jpg',
                'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_d9ab2a7ee14c10a3499174506d30533c.jpg',
                'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_a2f9c09364cb7e922490935dbc362130.jpg',
                'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_3f3e12255bd28696636a91e15db59d80.jpg',
                'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_37ef3bfc20a1d8bf7eb2a4a1ec3579aa.jpg',
                'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_c1388367df3890a40fa3b9e179bcacba.jpg',
                'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_fbc7a689ec3f71aa15483005f04af956.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66/6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78824,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_076f5bb9f6df9d2e1c0656fa8e05f726.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66/6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2752578,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_fe2d496fa7bb3a46cd052000a50b3fab.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66/6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_d253bbe7fd8703b57892c33a33e42403.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66/6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2315606,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_a7fca870f5c2a0fadf420fa7c1171f1d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66/6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3062009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_d9ab2a7ee14c10a3499174506d30533c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66/6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2780952,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_a2f9c09364cb7e922490935dbc362130.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66/6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2739836,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_3f3e12255bd28696636a91e15db59d80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66/6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2753521,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_37ef3bfc20a1d8bf7eb2a4a1ec3579aa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66/6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2699978,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_c1388367df3890a40fa3b9e179bcacba.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66/6ca0fb10-c52a-5f83-a7b9-5acd5dad6b66_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3009694,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/10/5010867f8dadd1510c3ececd783045bf/pa/CX31809_fbc7a689ec3f71aa15483005f04af956.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX31809%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Saving data for CX31809: {'created_time': 1774856303.333449, 'last_price_update_time': 1774856303.333461, 'auction_closing_time': 1774971646.0}
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX31809') HTTP/1.1" 204 0
2026-03-30 07:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_d386d529d94ffb5764149dce01e6ef1b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_b25e180af7e6247e88e6485f826b0227.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: HR43739
2026-03-30 07:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_84842057dddf30194ba085e3d3b919d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_1fd6bdf09a209677d9de3a851cafe78b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ62505/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HT21123/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK11401> (referer: https://www.auto1.com/v1/car-details-view/YK11401/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: EG30770
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: SK51252
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: HT21123
2026-03-30 07:38:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: DZ62505
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: GH55253
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: WH88293
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH88293%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for WH88293: 0
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: RF59698
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: XW26615
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: UM20037
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM20037%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for UM20037: 0
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: JB45196
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: CW07169
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: CS17567
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS17567%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for CS17567: 0
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: LY36951
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: CX43876
2026-03-30 07:38:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_b3a9a0c6631c734cf35ac5ea21b4b2fd.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: UX30776
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: SP41930
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: MF04152
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: GJ50570
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: VR14324
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: PA10623
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: YF78149
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: ZB29861
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: RM92330
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: KU93017
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: AD78216
2026-03-30 07:38:23 [auto1.de] INFO: Found listing with ID: JH04930
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH04930%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Scrape type for JH04930: 2
2026-03-30 07:38:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 808a652f-8143-5f3e-a62c-221baeef1fee with identifier: JH04930
2026-03-30 07:38:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 808a652f-8143-5f3e-a62c-221baeef1fee with scrape type 2
2026-03-30 07:38:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 808a652f-8143-5f3e-a62c-221baeef1fee with scrape type 2
2026-03-30 07:38:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 808a652f-8143-5f3e-a62c-221baeef1fee, identifier: JH04930
2026-03-30 07:38:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 808a652f-8143-5f3e-a62c-221baeef1fee with identifier: JH04930
2026-03-30 07:38:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 808a652f-8143-5f3e-a62c-221baeef1fee with identifier: JH04930
2026-03-30 07:38:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 808a652f-8143-5f3e-a62c-221baeef1fee with identifier: JH04930 to the API
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:57:22Z',
 'fuel_type': 'petrol',
 'id': '808a652f-8143-5f3e-a62c-221baeef1fee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH04930',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 27072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-06',
 'seller_name': None,
 'title': 'Ford Transit 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2022}
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH04930%27 HTTP/1.1" 200 None
2026-03-30 07:38:23 [auto1.de] INFO: Saving data for JH04930: {'auction_closing_time': 1774972642.0, 'created_time': 1773305483.992158, 'last_price_update_time': 1774856303.949872}
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH04930') HTTP/1.1" 204 0
2026-03-30 07:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_227d5cbb805512b39aa71021cebe0c4c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: VK94539
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94539%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Scrape type for VK94539: 1
2026-03-30 07:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_4c788789eb05915443b215ab7cb107c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f669d0>
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_d386d529d94ffb5764149dce01e6ef1b.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_d386d529d94ffb5764149dce01e6ef1b.jpg saved to cache
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 36730f29-ae50-5233-9c5e-54171b280638
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22ae590>
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_b25e180af7e6247e88e6485f826b0227.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_b25e180af7e6247e88e6485f826b0227.jpg saved to cache
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 36730f29-ae50-5233-9c5e-54171b280638
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22e1710>
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_84842057dddf30194ba085e3d3b919d1.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_84842057dddf30194ba085e3d3b919d1.jpg saved to cache
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24f7a50>
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_1fd6bdf09a209677d9de3a851cafe78b.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_1fd6bdf09a209677d9de3a851cafe78b.jpg saved to cache
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee
2026-03-30 07:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9b6d152-7e12-577a-a40b-bdcfca6e0865 with identifier: YK11401
2026-03-30 07:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9b6d152-7e12-577a-a40b-bdcfca6e0865 with scrape type 1
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f9b6d152-7e12-577a-a40b-bdcfca6e0865
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_7f6518a2088b11615afa7249fd7b4e5d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_7f6518a2088b11615afa7249fd7b4e5d.jpg not downloaded yet
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22e3510>
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_b3a9a0c6631c734cf35ac5ea21b4b2fd.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_b3a9a0c6631c734cf35ac5ea21b4b2fd.jpg saved to cache
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: SZ33813
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: EL52621
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: DV12193
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV12193%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Scrape type for DV12193: 1
2026-03-30 07:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GH55253/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_6642adef47250f96bdb09690bbc4052e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_6642adef47250f96bdb09690bbc4052e.jpg not downloaded yet
2026-03-30 07:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_20e17a51faea81345f944cdc59d1783d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:24 [auto1.de] INFO: Found listing with ID: GK03673
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK03673%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Scrape type for GK03673: 2
2026-03-30 07:38:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e6d87b8-f560-5a70-916c-e413b8ceeaad with identifier: GK03673
2026-03-30 07:38:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e6d87b8-f560-5a70-916c-e413b8ceeaad with scrape type 2
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e6d87b8-f560-5a70-916c-e413b8ceeaad with scrape type 2
2026-03-30 07:38:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e6d87b8-f560-5a70-916c-e413b8ceeaad, identifier: GK03673
2026-03-30 07:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW07169/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23bbe90>
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_227d5cbb805512b39aa71021cebe0c4c.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_227d5cbb805512b39aa71021cebe0c4c.jpg saved to cache
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2384dd0>
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_4c788789eb05915443b215ab7cb107c0.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_4c788789eb05915443b215ab7cb107c0.jpg saved to cache
2026-03-30 07:38:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 36730f29-ae50-5233-9c5e-54171b280638
2026-03-30 07:38:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_57a912a07754f3cde99bab46b8425c07.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e6d87b8-f560-5a70-916c-e413b8ceeaad with identifier: GK03673
2026-03-30 07:38:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e6d87b8-f560-5a70-916c-e413b8ceeaad with identifier: GK03673
2026-03-30 07:38:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e6d87b8-f560-5a70-916c-e413b8ceeaad with identifier: GK03673 to the API
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:56:46Z',
 'fuel_type': 'diesel',
 'id': '0e6d87b8-f560-5a70-916c-e413b8ceeaad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GK03673',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 207205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-13',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 d T BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'T BlueTEC AMG Line',
 'year': 2018}
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK03673%27 HTTP/1.1" 200 None
2026-03-30 07:38:24 [auto1.de] INFO: Saving data for GK03673: {'auction_closing_time': 1774972606.0, 'created_time': 1773689146.734721, 'last_price_update_time': 1774856304.998968}
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GK03673') HTTP/1.1" 204 0
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_c6ff705f101a31f1223905155d7477e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_c6ff705f101a31f1223905155d7477e1.jpg not downloaded yet
2026-03-30 07:38:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_0d42508b0b33955e6c6b480ed56aa547.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_068378a17814507f29c85f15908e0150.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: RY37161
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY37161%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for RY37161: 2
2026-03-30 07:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16019946-1a14-5af4-b8fc-c4a5ff7d95b9 with identifier: RY37161
2026-03-30 07:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16019946-1a14-5af4-b8fc-c4a5ff7d95b9 with scrape type 2
2026-03-30 07:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16019946-1a14-5af4-b8fc-c4a5ff7d95b9 with scrape type 2
2026-03-30 07:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16019946-1a14-5af4-b8fc-c4a5ff7d95b9, identifier: RY37161
2026-03-30 07:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16019946-1a14-5af4-b8fc-c4a5ff7d95b9 with identifier: RY37161
2026-03-30 07:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16019946-1a14-5af4-b8fc-c4a5ff7d95b9 with identifier: RY37161
2026-03-30 07:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16019946-1a14-5af4-b8fc-c4a5ff7d95b9 with identifier: RY37161 to the API
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:44:07Z',
 'fuel_type': 'diesel',
 'id': '16019946-1a14-5af4-b8fc-c4a5ff7d95b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY37161',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 190478,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY37161%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Saving data for RY37161: {'auction_closing_time': 1774971847.0, 'created_time': 1773775522.033919, 'last_price_update_time': 1774856305.550419}
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY37161') HTTP/1.1" 204 0
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_b1c9c443ee2c7531ca7ae9e6c8021a75.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_b1c9c443ee2c7531ca7ae9e6c8021a75.jpg not downloaded yet
2026-03-30 07:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC65117> (referer: https://www.auto1.com/v1/car-details-view/HC65117/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2edcd10>
2026-03-30 07:38:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_20e17a51faea81345f944cdc59d1783d.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_20e17a51faea81345f944cdc59d1783d.jpg saved to cache
2026-03-30 07:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 36730f29-ae50-5233-9c5e-54171b280638
2026-03-30 07:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_39441b2711117fb19ed951f02ff57361.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:25 [auto1.de] INFO: Found listing with ID: UU64568
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU64568%27 HTTP/1.1" 200 None
2026-03-30 07:38:25 [auto1.de] INFO: Scrape type for UU64568: 2
2026-03-30 07:38:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12127610-6607-542a-88c2-a300c27b42a2 with identifier: UU64568
2026-03-30 07:38:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12127610-6607-542a-88c2-a300c27b42a2 with scrape type 2
2026-03-30 07:38:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12127610-6607-542a-88c2-a300c27b42a2 with scrape type 2
2026-03-30 07:38:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12127610-6607-542a-88c2-a300c27b42a2, identifier: UU64568
2026-03-30 07:38:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LE66161> (referer: https://www.auto1.com/v1/car-details-view/LE66161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW65340> (referer: https://www.auto1.com/v1/car-details-view/DW65340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_7f6518a2088b11615afa7249fd7b4e5d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12127610-6607-542a-88c2-a300c27b42a2 with identifier: UU64568
2026-03-30 07:38:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12127610-6607-542a-88c2-a300c27b42a2 with identifier: UU64568
2026-03-30 07:38:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12127610-6607-542a-88c2-a300c27b42a2 with identifier: UU64568 to the API
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:25:38Z',
 'fuel_type': 'diesel',
 'id': '12127610-6607-542a-88c2-a300c27b42a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU64568',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 323041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-19',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU64568%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [auto1.de] INFO: Saving data for UU64568: {'auction_closing_time': 1774970738.0, 'created_time': 1774294427.261191, 'last_price_update_time': 1774856306.115761}
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU64568') HTTP/1.1" 204 0
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_465a6b887b83d0ec3010c2e69a8f46cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_465a6b887b83d0ec3010c2e69a8f46cb.jpg not downloaded yet
2026-03-30 07:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d8e84610>
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_57a912a07754f3cde99bab46b8425c07.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_57a912a07754f3cde99bab46b8425c07.jpg saved to cache
2026-03-30 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 36730f29-ae50-5233-9c5e-54171b280638
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2293550>
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_0d42508b0b33955e6c6b480ed56aa547.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_0d42508b0b33955e6c6b480ed56aa547.jpg saved to cache
2026-03-30 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 36730f29-ae50-5233-9c5e-54171b280638
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f84350>
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_068378a17814507f29c85f15908e0150.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_068378a17814507f29c85f15908e0150.jpg saved to cache
2026-03-30 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee
2026-03-30 07:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_6642adef47250f96bdb09690bbc4052e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: AN57238
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN57238%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [auto1.de] INFO: Scrape type for AN57238: 2
2026-03-30 07:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08dd0276-a830-5444-aae2-fca97589bc12 with identifier: AN57238
2026-03-30 07:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08dd0276-a830-5444-aae2-fca97589bc12 with scrape type 2
2026-03-30 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08dd0276-a830-5444-aae2-fca97589bc12 with scrape type 2
2026-03-30 07:38:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08dd0276-a830-5444-aae2-fca97589bc12, identifier: AN57238
2026-03-30 07:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR43739> (referer: https://www.auto1.com/v1/car-details-view/HR43739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NF89910> (referer: https://www.auto1.com/v1/car-details-view/NF89910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08dd0276-a830-5444-aae2-fca97589bc12 with identifier: AN57238
2026-03-30 07:38:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08dd0276-a830-5444-aae2-fca97589bc12 with identifier: AN57238
2026-03-30 07:38:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08dd0276-a830-5444-aae2-fca97589bc12 with identifier: AN57238 to the API
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:11:37Z',
 'fuel_type': 'petrol',
 'id': '08dd0276-a830-5444-aae2-fca97589bc12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN57238',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 118634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-24',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Special',
 'transmission': 'manual',
 'trim': 'Special',
 'year': 2011}
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN57238%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [auto1.de] INFO: Saving data for AN57238: {'auction_closing_time': 1774969897.0, 'created_time': 1774349326.757104, 'last_price_update_time': 1774856306.853567}
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN57238') HTTP/1.1" 204 0
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_d98590180cf3dd1ce29d403c350a96cb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_d98590180cf3dd1ce29d403c350a96cb.jpg not downloaded yet
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: FY49050
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: EA94412
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: KD88298
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: HD75815
2026-03-30 07:38:26 [auto1.de] INFO: Found listing with ID: AL25278
2026-03-30 07:38:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad4bff36-fd0e-5406-a37a-b0e80eff02f8 with identifier: HC65117
2026-03-30 07:38:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8 with scrape type 1
2026-03-30 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_4f670e83dd7aa0ebd759456b62e35b94.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_4f670e83dd7aa0ebd759456b62e35b94.jpg not downloaded yet
2026-03-30 07:38:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23a5190>
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_39441b2711117fb19ed951f02ff57361.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_39441b2711117fb19ed951f02ff57361.jpg saved to cache
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee
2026-03-30 07:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e7652fc-dd5e-5bfc-ba39-44cc1311093e with identifier: LE66161
2026-03-30 07:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e7652fc-dd5e-5bfc-ba39-44cc1311093e with scrape type 1
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5e7652fc-dd5e-5bfc-ba39-44cc1311093e
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe3%252F87e3531c568fc0d8428dfb0addc14e3b%252Fpa%252FLE66161_ed92e4b9aa8c1eee023ed48c5934ac5b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_ed92e4b9aa8c1eee023ed48c5934ac5b.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe3%252F87e3531c568fc0d8428dfb0addc14e3b%252Fpa%252FLE66161_051071cb5077c559101d953e9caa5772.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_051071cb5077c559101d953e9caa5772.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe3%252F87e3531c568fc0d8428dfb0addc14e3b%252Fpa%252FLE66161_6a783e74116ba95f0b08613605cd61e5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_6a783e74116ba95f0b08613605cd61e5.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe3%252F87e3531c568fc0d8428dfb0addc14e3b%252Fpa%252FLE66161_a0bb61a0bc4c7dc978bfefeaa6f1e57e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_a0bb61a0bc4c7dc978bfefeaa6f1e57e.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe3%252F87e3531c568fc0d8428dfb0addc14e3b%252Fpa%252FLE66161_f389760d7810af202fb8a7feeb0a8dd3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_f389760d7810af202fb8a7feeb0a8dd3.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe3%252F87e3531c568fc0d8428dfb0addc14e3b%252Fpa%252FLE66161_e68bc056b26201a6b1a89175e3e7031e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_e68bc056b26201a6b1a89175e3e7031e.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe3%252F87e3531c568fc0d8428dfb0addc14e3b%252Fpa%252FLE66161_4e1fab5ddb65a6c8083569a166a1b424.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_4e1fab5ddb65a6c8083569a166a1b424.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe3%252F87e3531c568fc0d8428dfb0addc14e3b%252Fpa%252FLE66161_8f6fa4df5deeca851373d2da66bf19ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_8f6fa4df5deeca851373d2da66bf19ef.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe3%252F87e3531c568fc0d8428dfb0addc14e3b%252Fpa%252FLE66161_d392953e15fac47ff1fca4d77a3d173f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_d392953e15fac47ff1fca4d77a3d173f.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg87%252Fe3%252F87e3531c568fc0d8428dfb0addc14e3b%252Fpa%252FLE66161_0e2f764a52f2255077efba0fb3cd8c07.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_0e2f764a52f2255077efba0fb3cd8c07.jpg already downloaded
2026-03-30 07:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e7652fc-dd5e-5bfc-ba39-44cc1311093e, identifier: LE66161
2026-03-30 07:38:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79dfc965-3c68-5299-af9b-bdc06df3c4b8 with identifier: DW65340
2026-03-30 07:38:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79dfc965-3c68-5299-af9b-bdc06df3c4b8 with scrape type 1
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79dfc965-3c68-5299-af9b-bdc06df3c4b8
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F88231caacb8e5ad92bd9aca87b558776%252Fpa%252FDW65340_4472365f42c4d662f8bd751173ebc07c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_4472365f42c4d662f8bd751173ebc07c.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F88231caacb8e5ad92bd9aca87b558776%252Fpa%252FDW65340_a0d1b05899426fe5dc47c2dadf88d4a9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_a0d1b05899426fe5dc47c2dadf88d4a9.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F88231caacb8e5ad92bd9aca87b558776%252Fpa%252FDW65340_61a716a8a460ed997eb51ad5e165df39.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_61a716a8a460ed997eb51ad5e165df39.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F88231caacb8e5ad92bd9aca87b558776%252Fpa%252FDW65340_23bafb99413f2156cc1218d5a9f83a47.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_23bafb99413f2156cc1218d5a9f83a47.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F88231caacb8e5ad92bd9aca87b558776%252Fpa%252FDW65340_81606d6a0aed6aad046a17a8ff8abada.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_81606d6a0aed6aad046a17a8ff8abada.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F88231caacb8e5ad92bd9aca87b558776%252Fpa%252FDW65340_4820d217bcd267f2694e150bf4e39db2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_4820d217bcd267f2694e150bf4e39db2.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F88231caacb8e5ad92bd9aca87b558776%252Fpa%252FDW65340_c7a55cf147c4a5d25b7b0d7a6e425641.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_c7a55cf147c4a5d25b7b0d7a6e425641.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F88231caacb8e5ad92bd9aca87b558776%252Fpa%252FDW65340_7e327d08b66191abd11bbae00ab2524e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_7e327d08b66191abd11bbae00ab2524e.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F88231caacb8e5ad92bd9aca87b558776%252Fpa%252FDW65340_53f34e73506fbf97684f773fabd3d985.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_53f34e73506fbf97684f773fabd3d985.jpg already downloaded
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252F23%252F88231caacb8e5ad92bd9aca87b558776%252Fpa%252FDW65340_f80a4f838d127d77e7324c70507a8351.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_f80a4f838d127d77e7324c70507a8351.jpg already downloaded
2026-03-30 07:38:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79dfc965-3c68-5299-af9b-bdc06df3c4b8, identifier: DW65340
2026-03-30 07:38:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22a9210>
2026-03-30 07:38:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_7f6518a2088b11615afa7249fd7b4e5d.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_7f6518a2088b11615afa7249fd7b4e5d.jpg saved to cache
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f9b6d152-7e12-577a-a40b-bdcfca6e0865
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_4e1680aa93f673b2a3f5e53eb1781967.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_4e1680aa93f673b2a3f5e53eb1781967.jpg not downloaded yet
2026-03-30 07:38:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e7652fc-dd5e-5bfc-ba39-44cc1311093e with identifier: LE66161
2026-03-30 07:38:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e7652fc-dd5e-5bfc-ba39-44cc1311093e with identifier: LE66161
2026-03-30 07:38:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e7652fc-dd5e-5bfc-ba39-44cc1311093e with identifier: LE66161 to the API
2026-03-30 07:38:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/LE66161>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:52:37Z',
 'fuel_type': 'petrol',
 'id': '5e7652fc-dd5e-5bfc-ba39-44cc1311093e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE66161',
 'listing': 'auction',
 'location': 'DE, Helvesiek',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 88995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_ed92e4b9aa8c1eee023ed48c5934ac5b.jpg',
                'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_051071cb5077c559101d953e9caa5772.jpg',
                'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_6a783e74116ba95f0b08613605cd61e5.jpg',
                'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_a0bb61a0bc4c7dc978bfefeaa6f1e57e.jpg',
                'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_f389760d7810af202fb8a7feeb0a8dd3.jpg',
                'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_e68bc056b26201a6b1a89175e3e7031e.jpg',
                'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_4e1fab5ddb65a6c8083569a166a1b424.jpg',
                'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_8f6fa4df5deeca851373d2da66bf19ef.jpg',
                'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_d392953e15fac47ff1fca4d77a3d173f.jpg',
                'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_0e2f764a52f2255077efba0fb3cd8c07.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7652fc-dd5e-5bfc-ba39-44cc1311093e/5e7652fc-dd5e-5bfc-ba39-44cc1311093e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_ed92e4b9aa8c1eee023ed48c5934ac5b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7652fc-dd5e-5bfc-ba39-44cc1311093e/5e7652fc-dd5e-5bfc-ba39-44cc1311093e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_051071cb5077c559101d953e9caa5772.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7652fc-dd5e-5bfc-ba39-44cc1311093e/5e7652fc-dd5e-5bfc-ba39-44cc1311093e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74387,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_6a783e74116ba95f0b08613605cd61e5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7652fc-dd5e-5bfc-ba39-44cc1311093e/5e7652fc-dd5e-5bfc-ba39-44cc1311093e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63910,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_a0bb61a0bc4c7dc978bfefeaa6f1e57e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7652fc-dd5e-5bfc-ba39-44cc1311093e/5e7652fc-dd5e-5bfc-ba39-44cc1311093e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66078,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_f389760d7810af202fb8a7feeb0a8dd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7652fc-dd5e-5bfc-ba39-44cc1311093e/5e7652fc-dd5e-5bfc-ba39-44cc1311093e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2979883,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_e68bc056b26201a6b1a89175e3e7031e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7652fc-dd5e-5bfc-ba39-44cc1311093e/5e7652fc-dd5e-5bfc-ba39-44cc1311093e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_4e1fab5ddb65a6c8083569a166a1b424.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7652fc-dd5e-5bfc-ba39-44cc1311093e/5e7652fc-dd5e-5bfc-ba39-44cc1311093e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_8f6fa4df5deeca851373d2da66bf19ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7652fc-dd5e-5bfc-ba39-44cc1311093e/5e7652fc-dd5e-5bfc-ba39-44cc1311093e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2910390,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_d392953e15fac47ff1fca4d77a3d173f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5e7652fc-dd5e-5bfc-ba39-44cc1311093e/5e7652fc-dd5e-5bfc-ba39-44cc1311093e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98328,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img87/e3/87e3531c568fc0d8428dfb0addc14e3b/pa/LE66161_0e2f764a52f2255077efba0fb3cd8c07.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE66161%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Saving data for LE66161: {'created_time': 1774856308.232694, 'last_price_update_time': 1774856308.232706, 'auction_closing_time': 1774972357.0}
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LE66161') HTTP/1.1" 204 0
2026-03-30 07:38:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79dfc965-3c68-5299-af9b-bdc06df3c4b8 with identifier: DW65340
2026-03-30 07:38:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79dfc965-3c68-5299-af9b-bdc06df3c4b8 with identifier: DW65340
2026-03-30 07:38:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79dfc965-3c68-5299-af9b-bdc06df3c4b8 with identifier: DW65340 to the API
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DW65340>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:42:20Z',
 'fuel_type': 'petrol',
 'id': '79dfc965-3c68-5299-af9b-bdc06df3c4b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW65340',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 46168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_4472365f42c4d662f8bd751173ebc07c.jpg',
                'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_a0d1b05899426fe5dc47c2dadf88d4a9.jpg',
                'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_61a716a8a460ed997eb51ad5e165df39.jpg',
                'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_23bafb99413f2156cc1218d5a9f83a47.jpg',
                'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_81606d6a0aed6aad046a17a8ff8abada.jpg',
                'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_4820d217bcd267f2694e150bf4e39db2.jpg',
                'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_c7a55cf147c4a5d25b7b0d7a6e425641.jpg',
                'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_7e327d08b66191abd11bbae00ab2524e.jpg',
                'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_53f34e73506fbf97684f773fabd3d985.jpg',
                'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_f80a4f838d127d77e7324c70507a8351.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79dfc965-3c68-5299-af9b-bdc06df3c4b8/79dfc965-3c68-5299-af9b-bdc06df3c4b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2408358,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_4472365f42c4d662f8bd751173ebc07c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79dfc965-3c68-5299-af9b-bdc06df3c4b8/79dfc965-3c68-5299-af9b-bdc06df3c4b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_a0d1b05899426fe5dc47c2dadf88d4a9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79dfc965-3c68-5299-af9b-bdc06df3c4b8/79dfc965-3c68-5299-af9b-bdc06df3c4b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_61a716a8a460ed997eb51ad5e165df39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79dfc965-3c68-5299-af9b-bdc06df3c4b8/79dfc965-3c68-5299-af9b-bdc06df3c4b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2071199,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_23bafb99413f2156cc1218d5a9f83a47.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79dfc965-3c68-5299-af9b-bdc06df3c4b8/79dfc965-3c68-5299-af9b-bdc06df3c4b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2332746,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_81606d6a0aed6aad046a17a8ff8abada.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79dfc965-3c68-5299-af9b-bdc06df3c4b8/79dfc965-3c68-5299-af9b-bdc06df3c4b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1935900,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_4820d217bcd267f2694e150bf4e39db2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79dfc965-3c68-5299-af9b-bdc06df3c4b8/79dfc965-3c68-5299-af9b-bdc06df3c4b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_c7a55cf147c4a5d25b7b0d7a6e425641.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79dfc965-3c68-5299-af9b-bdc06df3c4b8/79dfc965-3c68-5299-af9b-bdc06df3c4b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59698,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_7e327d08b66191abd11bbae00ab2524e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79dfc965-3c68-5299-af9b-bdc06df3c4b8/79dfc965-3c68-5299-af9b-bdc06df3c4b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2357467,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_53f34e73506fbf97684f773fabd3d985.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79dfc965-3c68-5299-af9b-bdc06df3c4b8/79dfc965-3c68-5299-af9b-bdc06df3c4b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2333509,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img88/23/88231caacb8e5ad92bd9aca87b558776/pa/DW65340_f80a4f838d127d77e7324c70507a8351.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-17',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2016}
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW65340%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [auto1.de] INFO: Saving data for DW65340: {'created_time': 1774856308.701389, 'last_price_update_time': 1774856308.701403, 'auction_closing_time': 1774971740.0}
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW65340') HTTP/1.1" 204 0
2026-03-30 07:38:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_6c9b8aa208c897933bdd467688369118.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_6c9b8aa208c897933bdd467688369118.jpg not downloaded yet
2026-03-30 07:38:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d237d810>
2026-03-30 07:38:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_6642adef47250f96bdb09690bbc4052e.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_6642adef47250f96bdb09690bbc4052e.jpg saved to cache
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f9b6d152-7e12-577a-a40b-bdcfca6e0865
2026-03-30 07:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f103f9aa-3a1b-54da-b742-501754532528 with identifier: HR43739
2026-03-30 07:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f103f9aa-3a1b-54da-b742-501754532528 with scrape type 1
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f103f9aa-3a1b-54da-b742-501754532528
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_ebe0eaa188bf85b71c53152f461c293d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_ebe0eaa188bf85b71c53152f461c293d.jpg not downloaded yet
2026-03-30 07:38:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6926f52a-e1bc-59d8-a052-6dc7cdde7565 with identifier: NF89910
2026-03-30 07:38:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6926f52a-e1bc-59d8-a052-6dc7cdde7565 with scrape type 1
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6926f52a-e1bc-59d8-a052-6dc7cdde7565
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5f%252F225f05d11c1b7a86b1067af33dff0e3d%252Fpa%252FNF89910_46a91df09245facae362a2837f2d818c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_46a91df09245facae362a2837f2d818c.jpg already downloaded
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5f%252F225f05d11c1b7a86b1067af33dff0e3d%252Fpa%252FNF89910_0408fbc391220a2d9c9161fd9d2daae0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_0408fbc391220a2d9c9161fd9d2daae0.jpg already downloaded
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5f%252F225f05d11c1b7a86b1067af33dff0e3d%252Fpa%252FNF89910_575c650c266e15d6599af8e5d8583037.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_575c650c266e15d6599af8e5d8583037.jpg already downloaded
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5f%252F225f05d11c1b7a86b1067af33dff0e3d%252Fpa%252FNF89910_c95cf648bdba59dac869bb6688034de8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_c95cf648bdba59dac869bb6688034de8.jpg already downloaded
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5f%252F225f05d11c1b7a86b1067af33dff0e3d%252Fpa%252FNF89910_455ea2f3b4747a964730a2a97c432836.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_455ea2f3b4747a964730a2a97c432836.jpg already downloaded
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5f%252F225f05d11c1b7a86b1067af33dff0e3d%252Fpa%252FNF89910_ac1b66868542591b65f73071ae484e4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_ac1b66868542591b65f73071ae484e4f.jpg already downloaded
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5f%252F225f05d11c1b7a86b1067af33dff0e3d%252Fpa%252FNF89910_f68561fbf1f1f96d9913dcf7d29bb1f8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_f68561fbf1f1f96d9913dcf7d29bb1f8.jpg already downloaded
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5f%252F225f05d11c1b7a86b1067af33dff0e3d%252Fpa%252FNF89910_911e63ecde2925a17f1f9f4920bb941a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_911e63ecde2925a17f1f9f4920bb941a.jpg already downloaded
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5f%252F225f05d11c1b7a86b1067af33dff0e3d%252Fpa%252FNF89910_9de49edf207bfcff0585c10c279e67f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_9de49edf207bfcff0585c10c279e67f6.jpg already downloaded
2026-03-30 07:38:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg22%252F5f%252F225f05d11c1b7a86b1067af33dff0e3d%252Fpa%252FNF89910_c24c8197287876932479dc4f5713b472.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_c24c8197287876932479dc4f5713b472.jpg already downloaded
2026-03-30 07:38:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6926f52a-e1bc-59d8-a052-6dc7cdde7565, identifier: NF89910
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_367d5049e14b01b5781a2b7011a05dbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_367d5049e14b01b5781a2b7011a05dbd.jpg not downloaded yet
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CX43876/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6926f52a-e1bc-59d8-a052-6dc7cdde7565 with identifier: NF89910
2026-03-30 07:38:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6926f52a-e1bc-59d8-a052-6dc7cdde7565 with identifier: NF89910
2026-03-30 07:38:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6926f52a-e1bc-59d8-a052-6dc7cdde7565 with identifier: NF89910 to the API
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NF89910>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 182,
 'expiration_date': '2026-03-31T15:00:14Z',
 'fuel_type': 'petrol',
 'id': '6926f52a-e1bc-59d8-a052-6dc7cdde7565',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF89910',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 187191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_46a91df09245facae362a2837f2d818c.jpg',
                'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_0408fbc391220a2d9c9161fd9d2daae0.jpg',
                'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_575c650c266e15d6599af8e5d8583037.jpg',
                'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_c95cf648bdba59dac869bb6688034de8.jpg',
                'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_455ea2f3b4747a964730a2a97c432836.jpg',
                'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_ac1b66868542591b65f73071ae484e4f.jpg',
                'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_f68561fbf1f1f96d9913dcf7d29bb1f8.jpg',
                'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_911e63ecde2925a17f1f9f4920bb941a.jpg',
                'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_9de49edf207bfcff0585c10c279e67f6.jpg',
                'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_c24c8197287876932479dc4f5713b472.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6926f52a-e1bc-59d8-a052-6dc7cdde7565/6926f52a-e1bc-59d8-a052-6dc7cdde7565_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_46a91df09245facae362a2837f2d818c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6926f52a-e1bc-59d8-a052-6dc7cdde7565/6926f52a-e1bc-59d8-a052-6dc7cdde7565_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81391,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_0408fbc391220a2d9c9161fd9d2daae0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6926f52a-e1bc-59d8-a052-6dc7cdde7565/6926f52a-e1bc-59d8-a052-6dc7cdde7565_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73196,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_575c650c266e15d6599af8e5d8583037.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6926f52a-e1bc-59d8-a052-6dc7cdde7565/6926f52a-e1bc-59d8-a052-6dc7cdde7565_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_c95cf648bdba59dac869bb6688034de8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6926f52a-e1bc-59d8-a052-6dc7cdde7565/6926f52a-e1bc-59d8-a052-6dc7cdde7565_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_455ea2f3b4747a964730a2a97c432836.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6926f52a-e1bc-59d8-a052-6dc7cdde7565/6926f52a-e1bc-59d8-a052-6dc7cdde7565_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65215,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_ac1b66868542591b65f73071ae484e4f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6926f52a-e1bc-59d8-a052-6dc7cdde7565/6926f52a-e1bc-59d8-a052-6dc7cdde7565_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64916,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_f68561fbf1f1f96d9913dcf7d29bb1f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6926f52a-e1bc-59d8-a052-6dc7cdde7565/6926f52a-e1bc-59d8-a052-6dc7cdde7565_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_911e63ecde2925a17f1f9f4920bb941a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6926f52a-e1bc-59d8-a052-6dc7cdde7565/6926f52a-e1bc-59d8-a052-6dc7cdde7565_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_9de49edf207bfcff0585c10c279e67f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6926f52a-e1bc-59d8-a052-6dc7cdde7565/6926f52a-e1bc-59d8-a052-6dc7cdde7565_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68473,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img22/5f/225f05d11c1b7a86b1067af33dff0e3d/pa/NF89910_c24c8197287876932479dc4f5713b472.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2016}
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF89910%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [auto1.de] INFO: Saving data for NF89910: {'created_time': 1774856309.455051, 'last_price_update_time': 1774856309.455066, 'auction_closing_time': 1774969214.0}
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF89910') HTTP/1.1" 204 0
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_854db71d2198ba51e133e46e42cc4d18.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_854db71d2198ba51e133e46e42cc4d18.jpg not downloaded yet
2026-03-30 07:38:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_4f73ce5157c9e9c50cd85ffdd2c11610.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_4f73ce5157c9e9c50cd85ffdd2c11610.jpg not downloaded yet
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_c6ff705f101a31f1223905155d7477e1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_b1c9c443ee2c7531ca7ae9e6c8021a75.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_465a6b887b83d0ec3010c2e69a8f46cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_d98590180cf3dd1ce29d403c350a96cb.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_b6993bf8fad2451be609f9b22c7c2eb2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_b6993bf8fad2451be609f9b22c7c2eb2.jpg not downloaded yet
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_e5686b02320c622ef31b157d95e534b4.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_6e7f619a39854fd280e83d2c84859886.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_6e7f619a39854fd280e83d2c84859886.jpg not downloaded yet
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_20f4cf68bb461eacde58ed32530aec35.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_20f4cf68bb461eacde58ed32530aec35.jpg not downloaded yet
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_eb058bc5abef40e3dfa101841b0c0075.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_eb058bc5abef40e3dfa101841b0c0075.jpg not downloaded yet
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_dbfe46521edbce17181f12b2922b4588.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_dbfe46521edbce17181f12b2922b4588.jpg not downloaded yet
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_59f479972cea8d27e8395889b262ea1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_59f479972cea8d27e8395889b262ea1c.jpg not downloaded yet
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_284187b06de17cf1e64ea2dfb03ae32a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_afab259ff48fa65f78ae9d37d4f180e4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_afab259ff48fa65f78ae9d37d4f180e4.jpg not downloaded yet
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_f1a680ac261d53aae9e38b36b16a2c83.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_f1a680ac261d53aae9e38b36b16a2c83.jpg not downloaded yet
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_4f670e83dd7aa0ebd759456b62e35b94.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_ebe0eaa188bf85b71c53152f461c293d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_367d5049e14b01b5781a2b7011a05dbd.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2389e50>
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_c6ff705f101a31f1223905155d7477e1.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_c6ff705f101a31f1223905155d7477e1.jpg saved to cache
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f9b6d152-7e12-577a-a40b-bdcfca6e0865
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d249c910>
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_b1c9c443ee2c7531ca7ae9e6c8021a75.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_b1c9c443ee2c7531ca7ae9e6c8021a75.jpg saved to cache
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f9b6d152-7e12-577a-a40b-bdcfca6e0865
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2de46d0>
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_465a6b887b83d0ec3010c2e69a8f46cb.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_465a6b887b83d0ec3010c2e69a8f46cb.jpg saved to cache
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f9b6d152-7e12-577a-a40b-bdcfca6e0865
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2304490>
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_d98590180cf3dd1ce29d403c350a96cb.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_d98590180cf3dd1ce29d403c350a96cb.jpg saved to cache
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f9b6d152-7e12-577a-a40b-bdcfca6e0865
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_d821182e7e39444201ee1fcdcb510a58.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_d821182e7e39444201ee1fcdcb510a58.jpg not downloaded yet
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_3d73a94c51f4f5f32e9cd3626379fdc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3d73a94c51f4f5f32e9cd3626379fdc0.jpg not downloaded yet
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_4f73ce5157c9e9c50cd85ffdd2c11610.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_4e1680aa93f673b2a3f5e53eb1781967.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_6c9b8aa208c897933bdd467688369118.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_5b1657add44122d1003b8e0c282468da.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_5b1657add44122d1003b8e0c282468da.jpg not downloaded yet
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_3345b998495622d30cb7a1375ccc56d2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3345b998495622d30cb7a1375ccc56d2.jpg not downloaded yet
2026-03-30 07:38:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d6fb10>
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_e5686b02320c622ef31b157d95e534b4.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_e5686b02320c622ef31b157d95e534b4.jpg saved to cache
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee
2026-03-30 07:38:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2354f90>
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252F90%252Fa59007bb10f9c3c8ae3a4ef35ecf9fe4%252Fpa%252FDD06486_284187b06de17cf1e64ea2dfb03ae32a.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_284187b06de17cf1e64ea2dfb03ae32a.jpg saved to cache
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 36730f29-ae50-5233-9c5e-54171b280638
2026-03-30 07:38:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 36730f29-ae50-5233-9c5e-54171b280638, skipping ID generation
2026-03-30 07:38:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36730f29-ae50-5233-9c5e-54171b280638 with scrape type 1
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 36730f29-ae50-5233-9c5e-54171b280638 sending to next pipeline
2026-03-30 07:38:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36730f29-ae50-5233-9c5e-54171b280638, identifier: DD06486
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d0e810>
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_4f670e83dd7aa0ebd759456b62e35b94.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_4f670e83dd7aa0ebd759456b62e35b94.jpg saved to cache
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2350610>
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_ebe0eaa188bf85b71c53152f461c293d.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_ebe0eaa188bf85b71c53152f461c293d.jpg saved to cache
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f103f9aa-3a1b-54da-b742-501754532528
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22e1ed0>
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_367d5049e14b01b5781a2b7011a05dbd.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_367d5049e14b01b5781a2b7011a05dbd.jpg saved to cache
2026-03-30 07:38:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f9b6d152-7e12-577a-a40b-bdcfca6e0865
2026-03-30 07:38:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36730f29-ae50-5233-9c5e-54171b280638 with identifier: DD06486
2026-03-30 07:38:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36730f29-ae50-5233-9c5e-54171b280638 with identifier: DD06486
2026-03-30 07:38:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36730f29-ae50-5233-9c5e-54171b280638 with identifier: DD06486 to the API
2026-03-30 07:38:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_284187b06de17cf1e64ea2dfb03ae32a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:30:14Z',
 'fuel_type': 'diesel',
 'id': '36730f29-ae50-5233-9c5e-54171b280638',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD06486',
 'listing': 'auction',
 'location': 'DE, Hanau',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 127625,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2577447,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_57a912a07754f3cde99bab46b8425c07.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62619,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_0d42508b0b33955e6c6b480ed56aa547.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_20e17a51faea81345f944cdc59d1783d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57596,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_f793547dcbfe2b307ae8808f48261f77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_6e017aa215ac99272477e759ac18c7ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65826,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_4c788789eb05915443b215ab7cb107c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_83f7abd7d77a0930d87364cd156768b7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_d386d529d94ffb5764149dce01e6ef1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2472438,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_284187b06de17cf1e64ea2dfb03ae32a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_36730f29-ae50-5233-9c5e-54171b280638/36730f29-ae50-5233-9c5e-54171b280638_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63044,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/90/a59007bb10f9c3c8ae3a4ef35ecf9fe4/pa/DD06486_b25e180af7e6247e88e6485f826b0227.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-04-20',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T BlueTEC AMG Line',
 'transmission': 'automatic',
 'trim': 'T BlueTEC AMG Line',
 'year': 2016}
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD06486%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [auto1.de] INFO: Saving data for DD06486: {'created_time': 1774856311.586149, 'last_price_update_time': 1774856311.586159, 'auction_closing_time': 1774971014.0}
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD06486') HTTP/1.1" 204 0
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_5c7b96ce6a170cc7e3d890c69760c95c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_5c7b96ce6a170cc7e3d890c69760c95c.jpg not downloaded yet
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_3448c2f7dcdff4948d0129c035e4e49d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3448c2f7dcdff4948d0129c035e4e49d.jpg not downloaded yet
2026-03-30 07:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK94539/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ62505> (referer: https://www.auto1.com/v1/car-details-view/DZ62505/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GH55253> (referer: https://www.auto1.com/v1/car-details-view/GH55253/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW07169> (referer: https://www.auto1.com/v1/car-details-view/CW07169/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF59698/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HT21123> (referer: https://www.auto1.com/v1/car-details-view/HT21123/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_e8dbcac78ba534cd0111c5f35182d249.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_e8dbcac78ba534cd0111c5f35182d249.jpg not downloaded yet
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_d5f658af48458d743d5cc522a07a4a98.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_d5f658af48458d743d5cc522a07a4a98.jpg not downloaded yet
2026-03-30 07:38:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DV12193/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23d1ad0>
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_4f73ce5157c9e9c50cd85ffdd2c11610.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_4f73ce5157c9e9c50cd85ffdd2c11610.jpg saved to cache
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f103f9aa-3a1b-54da-b742-501754532528
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d232a4d0>
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_4e1680aa93f673b2a3f5e53eb1781967.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_4e1680aa93f673b2a3f5e53eb1781967.jpg saved to cache
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f9b6d152-7e12-577a-a40b-bdcfca6e0865
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24b9fd0>
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_6c9b8aa208c897933bdd467688369118.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_6c9b8aa208c897933bdd467688369118.jpg saved to cache
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_a26308d5a9eff9a3911a8b565110ae53.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_a26308d5a9eff9a3911a8b565110ae53.jpg not downloaded yet
2026-03-30 07:38:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d9afda5-bd56-5c36-8f17-a460b1d6781b with identifier: DZ62505
2026-03-30 07:38:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d9afda5-bd56-5c36-8f17-a460b1d6781b with scrape type 1
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3d9afda5-bd56-5c36-8f17-a460b1d6781b
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F3f%252F443fbb00f523d7aee9886baf90825e2f%252Fpa%252FDZ62505_ba9605d0e772b0dc6b6c5a322636c6fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_ba9605d0e772b0dc6b6c5a322636c6fb.jpg already downloaded
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F3f%252F443fbb00f523d7aee9886baf90825e2f%252Fpa%252FDZ62505_c9c1ad6e3c27357af0e16ffba9fcff07.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_c9c1ad6e3c27357af0e16ffba9fcff07.jpg already downloaded
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F3f%252F443fbb00f523d7aee9886baf90825e2f%252Fpa%252FDZ62505_10bb46922d4edfbf534b20d7435f26fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_10bb46922d4edfbf534b20d7435f26fd.jpg already downloaded
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F3f%252F443fbb00f523d7aee9886baf90825e2f%252Fpa%252FDZ62505_8da5ff4872db6271b192e2dc490a3dcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_8da5ff4872db6271b192e2dc490a3dcc.jpg already downloaded
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F3f%252F443fbb00f523d7aee9886baf90825e2f%252Fpa%252FDZ62505_38b7dc938f8580b21a51b4f780793c4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_38b7dc938f8580b21a51b4f780793c4a.jpg already downloaded
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F3f%252F443fbb00f523d7aee9886baf90825e2f%252Fpa%252FDZ62505_2527fa6fb741bb3bf40804da0eaaefd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_2527fa6fb741bb3bf40804da0eaaefd8.jpg already downloaded
2026-03-30 07:38:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F3f%252F443fbb00f523d7aee9886baf90825e2f%252Fpa%252FDZ62505_5ed85251ff69de508805e801a89ddc4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_5ed85251ff69de508805e801a89ddc4b.jpg already downloaded
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F3f%252F443fbb00f523d7aee9886baf90825e2f%252Fpa%252FDZ62505_8fd034e8e877456ecc75c5a8ba3cddb1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_8fd034e8e877456ecc75c5a8ba3cddb1.jpg already downloaded
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F3f%252F443fbb00f523d7aee9886baf90825e2f%252Fpa%252FDZ62505_d136bb55eab0ad45ee2f2a77eb48dcb4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_d136bb55eab0ad45ee2f2a77eb48dcb4.jpg already downloaded
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252F3f%252F443fbb00f523d7aee9886baf90825e2f%252Fpa%252FDZ62505_7c851e1ea78522f2a577d9264ec26ced.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_7c851e1ea78522f2a577d9264ec26ced.jpg already downloaded
2026-03-30 07:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d9afda5-bd56-5c36-8f17-a460b1d6781b, identifier: DZ62505
2026-03-30 07:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 026a1a5f-0042-5c2d-a41b-395d71fade6c with identifier: GH55253
2026-03-30 07:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 026a1a5f-0042-5c2d-a41b-395d71fade6c with scrape type 1
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 026a1a5f-0042-5c2d-a41b-395d71fade6c
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_c8686444ea0d9f7f055dd1a700e1268a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_c8686444ea0d9f7f055dd1a700e1268a.jpg not downloaded yet
2026-03-30 07:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77805436-5cc2-5a3d-8ce5-47d302cad335 with identifier: CW07169
2026-03-30 07:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77805436-5cc2-5a3d-8ce5-47d302cad335 with scrape type 1
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 77805436-5cc2-5a3d-8ce5-47d302cad335
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd2%252F32d24560e6f8d3f444bdcdee6334cef9%252Fpa%252FCW07169_991c79673d5179b34c40c8753e135814.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_991c79673d5179b34c40c8753e135814.jpg already downloaded
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd2%252F32d24560e6f8d3f444bdcdee6334cef9%252Fpa%252FCW07169_dd2f2e84c7dd0c74b3fe67793017cafd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_dd2f2e84c7dd0c74b3fe67793017cafd.jpg already downloaded
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd2%252F32d24560e6f8d3f444bdcdee6334cef9%252Fpa%252FCW07169_7ebfaa57f59d1e8712e92f4d4806bd25.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_7ebfaa57f59d1e8712e92f4d4806bd25.jpg already downloaded
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd2%252F32d24560e6f8d3f444bdcdee6334cef9%252Fpa%252FCW07169_1c63569acc7ac0355a63aa0a4c0d0ffe.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_1c63569acc7ac0355a63aa0a4c0d0ffe.jpg already downloaded
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252Fd2%252F32d24560e6f8d3f444bdcdee6334cef9%252Fpa%252FCW07169_16909d009c0ef6e582fcd6cfcb666243.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_16909d009c0ef6e582fcd6cfcb666243.jpg already downloaded
2026-03-30 07:38:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77805436-5cc2-5a3d-8ce5-47d302cad335, identifier: CW07169
2026-03-30 07:38:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3225a1a-aea7-5af5-ae47-4421d244b32f with identifier: HT21123
2026-03-30 07:38:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3225a1a-aea7-5af5-ae47-4421d244b32f with scrape type 1
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c3225a1a-aea7-5af5-ae47-4421d244b32f
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_99717fa3a742e76af56aca91f7098b28.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_99717fa3a742e76af56aca91f7098b28.jpg not downloaded yet
2026-03-30 07:38:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3d73a94c51f4f5f32e9cd3626379fdc0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d9afda5-bd56-5c36-8f17-a460b1d6781b with identifier: DZ62505
2026-03-30 07:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d9afda5-bd56-5c36-8f17-a460b1d6781b with identifier: DZ62505
2026-03-30 07:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d9afda5-bd56-5c36-8f17-a460b1d6781b with identifier: DZ62505 to the API
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DZ62505>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:48:57Z',
 'fuel_type': 'petrol',
 'id': '3d9afda5-bd56-5c36-8f17-a460b1d6781b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ62505',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 51965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_ba9605d0e772b0dc6b6c5a322636c6fb.jpg',
                'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_c9c1ad6e3c27357af0e16ffba9fcff07.jpg',
                'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_10bb46922d4edfbf534b20d7435f26fd.jpg',
                'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_8da5ff4872db6271b192e2dc490a3dcc.jpg',
                'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_38b7dc938f8580b21a51b4f780793c4a.jpg',
                'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_2527fa6fb741bb3bf40804da0eaaefd8.jpg',
                'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_5ed85251ff69de508805e801a89ddc4b.jpg',
                'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_8fd034e8e877456ecc75c5a8ba3cddb1.jpg',
                'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_d136bb55eab0ad45ee2f2a77eb48dcb4.jpg',
                'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_7c851e1ea78522f2a577d9264ec26ced.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9afda5-bd56-5c36-8f17-a460b1d6781b/3d9afda5-bd56-5c36-8f17-a460b1d6781b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_ba9605d0e772b0dc6b6c5a322636c6fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9afda5-bd56-5c36-8f17-a460b1d6781b/3d9afda5-bd56-5c36-8f17-a460b1d6781b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3393366,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_c9c1ad6e3c27357af0e16ffba9fcff07.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9afda5-bd56-5c36-8f17-a460b1d6781b/3d9afda5-bd56-5c36-8f17-a460b1d6781b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3068766,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_10bb46922d4edfbf534b20d7435f26fd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9afda5-bd56-5c36-8f17-a460b1d6781b/3d9afda5-bd56-5c36-8f17-a460b1d6781b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3011797,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_8da5ff4872db6271b192e2dc490a3dcc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9afda5-bd56-5c36-8f17-a460b1d6781b/3d9afda5-bd56-5c36-8f17-a460b1d6781b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91572,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_38b7dc938f8580b21a51b4f780793c4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9afda5-bd56-5c36-8f17-a460b1d6781b/3d9afda5-bd56-5c36-8f17-a460b1d6781b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88971,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_2527fa6fb741bb3bf40804da0eaaefd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9afda5-bd56-5c36-8f17-a460b1d6781b/3d9afda5-bd56-5c36-8f17-a460b1d6781b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_5ed85251ff69de508805e801a89ddc4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9afda5-bd56-5c36-8f17-a460b1d6781b/3d9afda5-bd56-5c36-8f17-a460b1d6781b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_8fd034e8e877456ecc75c5a8ba3cddb1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9afda5-bd56-5c36-8f17-a460b1d6781b/3d9afda5-bd56-5c36-8f17-a460b1d6781b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_d136bb55eab0ad45ee2f2a77eb48dcb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3d9afda5-bd56-5c36-8f17-a460b1d6781b/3d9afda5-bd56-5c36-8f17-a460b1d6781b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2899809,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img44/3f/443fbb00f523d7aee9886baf90825e2f/pa/DZ62505_7c851e1ea78522f2a577d9264ec26ced.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-07-22',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2021}
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ62505%27 HTTP/1.1" 200 None
2026-03-30 07:38:32 [auto1.de] INFO: Saving data for DZ62505: {'created_time': 1774856312.753987, 'last_price_update_time': 1774856312.754, 'auction_closing_time': 1774972137.0}
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ62505') HTTP/1.1" 204 0
2026-03-30 07:38:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77805436-5cc2-5a3d-8ce5-47d302cad335 with identifier: CW07169
2026-03-30 07:38:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77805436-5cc2-5a3d-8ce5-47d302cad335 with identifier: CW07169
2026-03-30 07:38:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77805436-5cc2-5a3d-8ce5-47d302cad335 with identifier: CW07169 to the API
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CW07169>
{'auction_title': '',
 'c_o_2_emission_value': 195,
 'category': None,
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:23:49Z',
 'fuel_type': 'petrol',
 'id': '77805436-5cc2-5a3d-8ce5-47d302cad335',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW07169',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 153764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_991c79673d5179b34c40c8753e135814.jpg',
                'https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_dd2f2e84c7dd0c74b3fe67793017cafd.jpg',
                'https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_7ebfaa57f59d1e8712e92f4d4806bd25.jpg',
                'https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_1c63569acc7ac0355a63aa0a4c0d0ffe.jpg',
                'https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_16909d009c0ef6e582fcd6cfcb666243.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77805436-5cc2-5a3d-8ce5-47d302cad335/77805436-5cc2-5a3d-8ce5-47d302cad335_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_991c79673d5179b34c40c8753e135814.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77805436-5cc2-5a3d-8ce5-47d302cad335/77805436-5cc2-5a3d-8ce5-47d302cad335_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_dd2f2e84c7dd0c74b3fe67793017cafd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77805436-5cc2-5a3d-8ce5-47d302cad335/77805436-5cc2-5a3d-8ce5-47d302cad335_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_7ebfaa57f59d1e8712e92f4d4806bd25.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77805436-5cc2-5a3d-8ce5-47d302cad335/77805436-5cc2-5a3d-8ce5-47d302cad335_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_1c63569acc7ac0355a63aa0a4c0d0ffe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77805436-5cc2-5a3d-8ce5-47d302cad335/77805436-5cc2-5a3d-8ce5-47d302cad335_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93685,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/d2/32d24560e6f8d3f444bdcdee6334cef9/pa/CW07169_16909d009c0ef6e582fcd6cfcb666243.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-30',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Peugeot Partner 1.6 L1 Komfort',
 'transmission': 'manual',
 'trim': 'L1 Komfort',
 'year': 2009}
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW07169%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [auto1.de] INFO: Saving data for CW07169: {'created_time': 1774856313.104441, 'last_price_update_time': 1774856313.104455, 'auction_closing_time': 1774970629.0}
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW07169') HTTP/1.1" 204 0
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3345b998495622d30cb7a1375ccc56d2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_f1a680ac261d53aae9e38b36b16a2c83.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_59f479972cea8d27e8395889b262ea1c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_d821182e7e39444201ee1fcdcb510a58.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_f13dcb97be6fadf13c21945ca1dad8b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_f13dcb97be6fadf13c21945ca1dad8b6.jpg not downloaded yet
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_3b78de2a34f1b89f47dcf43f39307618.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_3b78de2a34f1b89f47dcf43f39307618.jpg not downloaded yet
2026-03-30 07:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_afab259ff48fa65f78ae9d37d4f180e4.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_5b1657add44122d1003b8e0c282468da.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_3c6d99667753cce0ee30f2ecb017b50c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_3c6d99667753cce0ee30f2ecb017b50c.jpg not downloaded yet
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_3a3366c3691e5078951383c9ec07bfec.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_3a3366c3691e5078951383c9ec07bfec.jpg not downloaded yet
2026-03-30 07:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2339750>
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_3d73a94c51f4f5f32e9cd3626379fdc0.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3d73a94c51f4f5f32e9cd3626379fdc0.jpg saved to cache
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f103f9aa-3a1b-54da-b742-501754532528
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_dbfe46521edbce17181f12b2922b4588.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_eb058bc5abef40e3dfa101841b0c0075.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_7e2a3a10be0d73eb19768a1682aa2b3d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_7e2a3a10be0d73eb19768a1682aa2b3d.jpg not downloaded yet
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_a52b7bd429d2fd2bf66f556251e393f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_a52b7bd429d2fd2bf66f556251e393f7.jpg not downloaded yet
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3448c2f7dcdff4948d0129c035e4e49d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_5c7b96ce6a170cc7e3d890c69760c95c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d238f450>
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_3345b998495622d30cb7a1375ccc56d2.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3345b998495622d30cb7a1375ccc56d2.jpg saved to cache
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f103f9aa-3a1b-54da-b742-501754532528
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22f0310>
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_f1a680ac261d53aae9e38b36b16a2c83.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_f1a680ac261d53aae9e38b36b16a2c83.jpg saved to cache
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f103f9aa-3a1b-54da-b742-501754532528
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2fe3bd0>
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_59f479972cea8d27e8395889b262ea1c.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_59f479972cea8d27e8395889b262ea1c.jpg saved to cache
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f103f9aa-3a1b-54da-b742-501754532528
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23c9c10>
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_d821182e7e39444201ee1fcdcb510a58.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_d821182e7e39444201ee1fcdcb510a58.jpg saved to cache
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_a26308d5a9eff9a3911a8b565110ae53.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_a7b96bf897c00d85432a8a058352b3fc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_a7b96bf897c00d85432a8a058352b3fc.jpg not downloaded yet
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_100c69e758ee4e7ee94fa147d31f7b4b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_100c69e758ee4e7ee94fa147d31f7b4b.jpg not downloaded yet
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_20f4cf68bb461eacde58ed32530aec35.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_6e7f619a39854fd280e83d2c84859886.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_99717fa3a742e76af56aca91f7098b28.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_f13dcb97be6fadf13c21945ca1dad8b6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_4b2af5595a9cf841d38d16333b3a6e9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_4b2af5595a9cf841d38d16333b3a6e9d.jpg not downloaded yet
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_81359fa06dcdbd3b91a94bf5567fe4e9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_81359fa06dcdbd3b91a94bf5567fe4e9.jpg not downloaded yet
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22e7b90>
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_afab259ff48fa65f78ae9d37d4f180e4.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_afab259ff48fa65f78ae9d37d4f180e4.jpg saved to cache
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2eaf410>
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_5b1657add44122d1003b8e0c282468da.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_5b1657add44122d1003b8e0c282468da.jpg saved to cache
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8
2026-03-30 07:38:33 [auto1.de] INFO: Channel: 24h | Page: 21 | totalHits: 7807 | hits on page: 40
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2de4390>
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_dbfe46521edbce17181f12b2922b4588.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_dbfe46521edbce17181f12b2922b4588.jpg saved to cache
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2386c10>
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_eb058bc5abef40e3dfa101841b0c0075.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_eb058bc5abef40e3dfa101841b0c0075.jpg saved to cache
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f9b6d152-7e12-577a-a40b-bdcfca6e0865
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d34d10>
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_3448c2f7dcdff4948d0129c035e4e49d.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3448c2f7dcdff4948d0129c035e4e49d.jpg saved to cache
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f103f9aa-3a1b-54da-b742-501754532528
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2483490>
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_5c7b96ce6a170cc7e3d890c69760c95c.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_5c7b96ce6a170cc7e3d890c69760c95c.jpg saved to cache
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_3b78de2a34f1b89f47dcf43f39307618.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_c8686444ea0d9f7f055dd1a700e1268a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_b2cdab90922f2d319b33c1ebf45c072b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b2cdab90922f2d319b33c1ebf45c072b.jpg not downloaded yet
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_04d51bed6715061293ff008188dc5642.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_04d51bed6715061293ff008188dc5642.jpg not downloaded yet
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: VK94539
2026-03-30 07:38:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_d5f658af48458d743d5cc522a07a4a98.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_a52b7bd429d2fd2bf66f556251e393f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_b345ab36acec2cddfd2a7c9dc803b3e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b345ab36acec2cddfd2a7c9dc803b3e6.jpg not downloaded yet
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_19c20be39835888bc7aedc8df4dd5364.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_19c20be39835888bc7aedc8df4dd5364.jpg not downloaded yet
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: SZ33813
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: EL52621
2026-03-30 07:38:33 [auto1.de] INFO: Found listing with ID: DV12193
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d351d0>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_a26308d5a9eff9a3911a8b565110ae53.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_a26308d5a9eff9a3911a8b565110ae53.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f103f9aa-3a1b-54da-b742-501754532528
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d239bb50>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_20f4cf68bb461eacde58ed32530aec35.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_20f4cf68bb461eacde58ed32530aec35.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f103f9aa-3a1b-54da-b742-501754532528
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23aad90>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_6e7f619a39854fd280e83d2c84859886.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_6e7f619a39854fd280e83d2c84859886.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f84350>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_99717fa3a742e76af56aca91f7098b28.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_99717fa3a742e76af56aca91f7098b28.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c3225a1a-aea7-5af5-ae47-4421d244b32f
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d8e71550>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_f13dcb97be6fadf13c21945ca1dad8b6.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_f13dcb97be6fadf13c21945ca1dad8b6.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 026a1a5f-0042-5c2d-a41b-395d71fade6c
2026-03-30 07:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_3a3366c3691e5078951383c9ec07bfec.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_7e2a3a10be0d73eb19768a1682aa2b3d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_e8dbcac78ba534cd0111c5f35182d249.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_3c6d99667753cce0ee30f2ecb017b50c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_b89923113394ee9f0adfdf3e5ee3b2c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b89923113394ee9f0adfdf3e5ee3b2c0.jpg not downloaded yet
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_cbd6ca9f447be1e89505124eac022368.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_cbd6ca9f447be1e89505124eac022368.jpg not downloaded yet
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: GK03673
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK03673%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [auto1.de] INFO: Scrape type for GK03673: 0
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: RY37161
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY37161%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [auto1.de] INFO: Scrape type for RY37161: 0
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: UU64568
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU64568%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [auto1.de] INFO: Scrape type for UU64568: 0
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: AN57238
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN57238%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [auto1.de] INFO: Scrape type for AN57238: 0
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: FY49050
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: EA94412
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: KD88298
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: HD75815
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: AL25278
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: VW31483
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW31483%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [auto1.de] INFO: Scrape type for VW31483: 1
2026-03-30 07:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_100c69e758ee4e7ee94fa147d31f7b4b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_a7b96bf897c00d85432a8a058352b3fc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_509991d717f864ac2d83e838d9c56d71.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_509991d717f864ac2d83e838d9c56d71.jpg not downloaded yet
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_afd85d8ebb0e7233417ecb70d0ee7c70.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_afd85d8ebb0e7233417ecb70d0ee7c70.jpg not downloaded yet
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: UN85261
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: DE44108
2026-03-30 07:38:34 [auto1.de] INFO: Found listing with ID: PS73688
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS73688%27 HTTP/1.1" 200 None
2026-03-30 07:38:34 [auto1.de] INFO: Scrape type for PS73688: 1
2026-03-30 07:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX43876> (referer: https://www.auto1.com/v1/car-details-view/CX43876/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e40b90>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_3b78de2a34f1b89f47dcf43f39307618.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_3b78de2a34f1b89f47dcf43f39307618.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c3225a1a-aea7-5af5-ae47-4421d244b32f
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f986d0>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_c8686444ea0d9f7f055dd1a700e1268a.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_c8686444ea0d9f7f055dd1a700e1268a.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 026a1a5f-0042-5c2d-a41b-395d71fade6c
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d2f310>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F0d%252Fa30d5fd6171b2840b4b0e050521f20d3%252Fpa%252FHR43739_d5f658af48458d743d5cc522a07a4a98.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_d5f658af48458d743d5cc522a07a4a98.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f103f9aa-3a1b-54da-b742-501754532528
2026-03-30 07:38:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f103f9aa-3a1b-54da-b742-501754532528, skipping ID generation
2026-03-30 07:38:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f103f9aa-3a1b-54da-b742-501754532528 with scrape type 1
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f103f9aa-3a1b-54da-b742-501754532528 sending to next pipeline
2026-03-30 07:38:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f103f9aa-3a1b-54da-b742-501754532528, identifier: HR43739
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23a6c10>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_a52b7bd429d2fd2bf66f556251e393f7.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_a52b7bd429d2fd2bf66f556251e393f7.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c3225a1a-aea7-5af5-ae47-4421d244b32f
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d91d5fd0>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_3a3366c3691e5078951383c9ec07bfec.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_3a3366c3691e5078951383c9ec07bfec.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c3225a1a-aea7-5af5-ae47-4421d244b32f
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d210e790>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_7e2a3a10be0d73eb19768a1682aa2b3d.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_7e2a3a10be0d73eb19768a1682aa2b3d.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 026a1a5f-0042-5c2d-a41b-395d71fade6c
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2483650>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_e8dbcac78ba534cd0111c5f35182d249.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_e8dbcac78ba534cd0111c5f35182d249.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d225ce50>
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_3c6d99667753cce0ee30f2ecb017b50c.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_3c6d99667753cce0ee30f2ecb017b50c.jpg saved to cache
2026-03-30 07:38:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 026a1a5f-0042-5c2d-a41b-395d71fade6c
2026-03-30 07:38:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_4b2af5595a9cf841d38d16333b3a6e9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: HK59987
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK59987%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for HK59987: 1
2026-03-30 07:38:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f103f9aa-3a1b-54da-b742-501754532528 with identifier: HR43739
2026-03-30 07:38:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f103f9aa-3a1b-54da-b742-501754532528 with identifier: HR43739
2026-03-30 07:38:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f103f9aa-3a1b-54da-b742-501754532528 with identifier: HR43739 to the API
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_d5f658af48458d743d5cc522a07a4a98.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:06:53Z',
 'fuel_type': 'petrol',
 'id': 'f103f9aa-3a1b-54da-b742-501754532528',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR43739',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'BMW',
 'model': '1er',
 'odometer': 100409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69172,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_ebe0eaa188bf85b71c53152f461c293d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_4f73ce5157c9e9c50cd85ffdd2c11610.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_20f4cf68bb461eacde58ed32530aec35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_59f479972cea8d27e8395889b262ea1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_f1a680ac261d53aae9e38b36b16a2c83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3d73a94c51f4f5f32e9cd3626379fdc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3345b998495622d30cb7a1375ccc56d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71628,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_3448c2f7dcdff4948d0129c035e4e49d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_d5f658af48458d743d5cc522a07a4a98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f103f9aa-3a1b-54da-b742-501754532528/f103f9aa-3a1b-54da-b742-501754532528_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56092,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/0d/a30d5fd6171b2840b4b0e050521f20d3/pa/HR43739_a26308d5a9eff9a3911a8b565110ae53.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR43739%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Saving data for HR43739: {'created_time': 1774856315.448817, 'last_price_update_time': 1774856315.448829, 'auction_closing_time': 1774969613.0}
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR43739') HTTP/1.1" 204 0
2026-03-30 07:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b2cdab90922f2d319b33c1ebf45c072b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_81359fa06dcdbd3b91a94bf5567fe4e9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_19c20be39835888bc7aedc8df4dd5364.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b345ab36acec2cddfd2a7c9dc803b3e6.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_b6993bf8fad2451be609f9b22c7c2eb2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: KU46528
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: GG93073
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93073%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for GG93073: 1
2026-03-30 07:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF59698> (referer: https://www.auto1.com/v1/car-details-view/RF59698/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK94539> (referer: https://www.auto1.com/v1/car-details-view/VK94539/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DV12193> (referer: https://www.auto1.com/v1/car-details-view/DV12193/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24a83d0>
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_100c69e758ee4e7ee94fa147d31f7b4b.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_100c69e758ee4e7ee94fa147d31f7b4b.jpg saved to cache
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c3225a1a-aea7-5af5-ae47-4421d244b32f
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2dae210>
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_a7b96bf897c00d85432a8a058352b3fc.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_a7b96bf897c00d85432a8a058352b3fc.jpg saved to cache
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 026a1a5f-0042-5c2d-a41b-395d71fade6c
2026-03-30 07:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87d6b570-8a31-5485-870e-b7d69d3230b1 with identifier: CX43876
2026-03-30 07:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87d6b570-8a31-5485-870e-b7d69d3230b1 with scrape type 1
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 87d6b570-8a31-5485-870e-b7d69d3230b1
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F62%252Fdf62356c94d79676910819163b1a78ef%252Fpa%252FCX43876_aa1e0320370321c68187621fd3eb6b73.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_aa1e0320370321c68187621fd3eb6b73.jpg already downloaded
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F62%252Fdf62356c94d79676910819163b1a78ef%252Fpa%252FCX43876_2234310b604e396c59c1e6c3412beafd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_2234310b604e396c59c1e6c3412beafd.jpg already downloaded
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F62%252Fdf62356c94d79676910819163b1a78ef%252Fpa%252FCX43876_93b7f3fb387f1f9c64e9f261998c6752.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_93b7f3fb387f1f9c64e9f261998c6752.jpg already downloaded
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F62%252Fdf62356c94d79676910819163b1a78ef%252Fpa%252FCX43876_60d2c46a6d4d83a39cb2e17a8c2eb9ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_60d2c46a6d4d83a39cb2e17a8c2eb9ab.jpg already downloaded
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F62%252Fdf62356c94d79676910819163b1a78ef%252Fpa%252FCX43876_95d7167aa56fc2122dd0d9d9af8c85e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_95d7167aa56fc2122dd0d9d9af8c85e0.jpg already downloaded
2026-03-30 07:38:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87d6b570-8a31-5485-870e-b7d69d3230b1, identifier: CX43876
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d8514e90>
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_4b2af5595a9cf841d38d16333b3a6e9d.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_4b2af5595a9cf841d38d16333b3a6e9d.jpg saved to cache
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 026a1a5f-0042-5c2d-a41b-395d71fade6c
2026-03-30 07:38:35 [auto1.de] INFO: Found listing with ID: JV37184
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37184%27 HTTP/1.1" 200 None
2026-03-30 07:38:35 [auto1.de] INFO: Scrape type for JV37184: 2
2026-03-30 07:38:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4a76c31-74c7-57ec-95d7-4b510cc0d3e0 with identifier: JV37184
2026-03-30 07:38:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4a76c31-74c7-57ec-95d7-4b510cc0d3e0 with scrape type 2
2026-03-30 07:38:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4a76c31-74c7-57ec-95d7-4b510cc0d3e0 with scrape type 2
2026-03-30 07:38:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4a76c31-74c7-57ec-95d7-4b510cc0d3e0, identifier: JV37184
2026-03-30 07:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87d6b570-8a31-5485-870e-b7d69d3230b1 with identifier: CX43876
2026-03-30 07:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87d6b570-8a31-5485-870e-b7d69d3230b1 with identifier: CX43876
2026-03-30 07:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87d6b570-8a31-5485-870e-b7d69d3230b1 with identifier: CX43876 to the API
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CX43876>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.4L',
 'engine_horse_power': 97,
 'expiration_date': '2026-03-31T15:46:09Z',
 'fuel_type': 'petrol',
 'id': '87d6b570-8a31-5485-870e-b7d69d3230b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX43876',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 113638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_aa1e0320370321c68187621fd3eb6b73.jpg',
                'https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_2234310b604e396c59c1e6c3412beafd.jpg',
                'https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_93b7f3fb387f1f9c64e9f261998c6752.jpg',
                'https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_60d2c46a6d4d83a39cb2e17a8c2eb9ab.jpg',
                'https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_95d7167aa56fc2122dd0d9d9af8c85e0.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d6b570-8a31-5485-870e-b7d69d3230b1/87d6b570-8a31-5485-870e-b7d69d3230b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_aa1e0320370321c68187621fd3eb6b73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d6b570-8a31-5485-870e-b7d69d3230b1/87d6b570-8a31-5485-870e-b7d69d3230b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69139,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_2234310b604e396c59c1e6c3412beafd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d6b570-8a31-5485-870e-b7d69d3230b1/87d6b570-8a31-5485-870e-b7d69d3230b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_93b7f3fb387f1f9c64e9f261998c6752.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d6b570-8a31-5485-870e-b7d69d3230b1/87d6b570-8a31-5485-870e-b7d69d3230b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57575,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_60d2c46a6d4d83a39cb2e17a8c2eb9ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87d6b570-8a31-5485-870e-b7d69d3230b1/87d6b570-8a31-5485-870e-b7d69d3230b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 137036,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/62/df62356c94d79676910819163b1a78ef/pa/CX43876_95d7167aa56fc2122dd0d9d9af8c85e0.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-06-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Auris 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX43876%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Saving data for CX43876: {'created_time': 1774856316.40614, 'last_price_update_time': 1774856316.406152, 'auction_closing_time': 1774971969.0}
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX43876') HTTP/1.1" 204 0
2026-03-30 07:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_854db71d2198ba51e133e46e42cc4d18.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4a76c31-74c7-57ec-95d7-4b510cc0d3e0 with identifier: JV37184
2026-03-30 07:38:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4a76c31-74c7-57ec-95d7-4b510cc0d3e0 with identifier: JV37184
2026-03-30 07:38:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4a76c31-74c7-57ec-95d7-4b510cc0d3e0 with identifier: JV37184 to the API
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:44:47Z',
 'fuel_type': 'diesel',
 'id': 'c4a76c31-74c7-57ec-95d7-4b510cc0d3e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV37184',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 234285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-02',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 2.5 TDI 4Motion',
 'transmission': 'manual',
 'trim': '4Motion',
 'year': 2009}
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV37184%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Saving data for JV37184: {'auction_closing_time': 1774971887.0, 'created_time': 1774291334.84776, 'last_price_update_time': 1774856316.755777}
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JV37184') HTTP/1.1" 204 0
2026-03-30 07:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_d466e4acb3ae7fb9ab22b706d649530c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_afd85d8ebb0e7233417ecb70d0ee7c70.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_cbd6ca9f447be1e89505124eac022368.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_509991d717f864ac2d83e838d9c56d71.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_ab33d618d4f62d42bf65809727bd4ca7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:36 [auto1.de] INFO: Found listing with ID: CS96512
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS96512%27 HTTP/1.1" 200 None
2026-03-30 07:38:36 [auto1.de] INFO: Scrape type for CS96512: 1
2026-03-30 07:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2396990>
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_b2cdab90922f2d319b33c1ebf45c072b.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b2cdab90922f2d319b33c1ebf45c072b.jpg saved to cache
2026-03-30 07:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 026a1a5f-0042-5c2d-a41b-395d71fade6c
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d47010>
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_81359fa06dcdbd3b91a94bf5567fe4e9.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_81359fa06dcdbd3b91a94bf5567fe4e9.jpg saved to cache
2026-03-30 07:38:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c3225a1a-aea7-5af5-ae47-4421d244b32f
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d234f790>
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_19c20be39835888bc7aedc8df4dd5364.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_19c20be39835888bc7aedc8df4dd5364.jpg saved to cache
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c3225a1a-aea7-5af5-ae47-4421d244b32f
2026-03-30 07:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23bced0>
2026-03-30 07:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_b345ab36acec2cddfd2a7c9dc803b3e6.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b345ab36acec2cddfd2a7c9dc803b3e6.jpg saved to cache
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 026a1a5f-0042-5c2d-a41b-395d71fade6c
2026-03-30 07:38:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d37990>
2026-03-30 07:38:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg8a%252F1a%252F8a1a2d55b4551c501516c9c553189f9b%252Fpa%252FYK11401_b6993bf8fad2451be609f9b22c7c2eb2.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_b6993bf8fad2451be609f9b22c7c2eb2.jpg saved to cache
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f9b6d152-7e12-577a-a40b-bdcfca6e0865
2026-03-30 07:38:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f9b6d152-7e12-577a-a40b-bdcfca6e0865, skipping ID generation
2026-03-30 07:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9b6d152-7e12-577a-a40b-bdcfca6e0865 with scrape type 1
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f9b6d152-7e12-577a-a40b-bdcfca6e0865 sending to next pipeline
2026-03-30 07:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9b6d152-7e12-577a-a40b-bdcfca6e0865, identifier: YK11401
2026-03-30 07:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f20d4992-6c5f-587f-8acf-4f2b4fce5f3d with identifier: RF59698
2026-03-30 07:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f20d4992-6c5f-587f-8acf-4f2b4fce5f3d with scrape type 1
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f20d4992-6c5f-587f-8acf-4f2b4fce5f3d
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff5%252F6df536c1e0ad449e2c352407ba9db5a1%252Fpa%252FRF59698_72e5cff012f348134bc4c25bc9cff397.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_72e5cff012f348134bc4c25bc9cff397.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff5%252F6df536c1e0ad449e2c352407ba9db5a1%252Fpa%252FRF59698_8cf5800190ae92c91027a196f69c86c8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_8cf5800190ae92c91027a196f69c86c8.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff5%252F6df536c1e0ad449e2c352407ba9db5a1%252Fpa%252FRF59698_7ca8e3dd586df2b8e9f946c30ebe0281.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_7ca8e3dd586df2b8e9f946c30ebe0281.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff5%252F6df536c1e0ad449e2c352407ba9db5a1%252Fpa%252FRF59698_0d76586567bfeb3ce514b85b1de17055.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_0d76586567bfeb3ce514b85b1de17055.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff5%252F6df536c1e0ad449e2c352407ba9db5a1%252Fpa%252FRF59698_5f1946c426a92609edea4d6ba71c5c35.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_5f1946c426a92609edea4d6ba71c5c35.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff5%252F6df536c1e0ad449e2c352407ba9db5a1%252Fpa%252FRF59698_bd2f989e92671becb911a1289249b002.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_bd2f989e92671becb911a1289249b002.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff5%252F6df536c1e0ad449e2c352407ba9db5a1%252Fpa%252FRF59698_a079842f7307dee58bd96b6037027bff.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_a079842f7307dee58bd96b6037027bff.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff5%252F6df536c1e0ad449e2c352407ba9db5a1%252Fpa%252FRF59698_dcbf6f98c739d90a4ffcc375746cdcce.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_dcbf6f98c739d90a4ffcc375746cdcce.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff5%252F6df536c1e0ad449e2c352407ba9db5a1%252Fpa%252FRF59698_3e120a6724164378ad6fb0d9f7f21b52.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_3e120a6724164378ad6fb0d9f7f21b52.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ff5%252F6df536c1e0ad449e2c352407ba9db5a1%252Fpa%252FRF59698_a312124e3125ee174475411417cb12fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_a312124e3125ee174475411417cb12fd.jpg already downloaded
2026-03-30 07:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f20d4992-6c5f-587f-8acf-4f2b4fce5f3d, identifier: RF59698
2026-03-30 07:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7f61a2a-98df-5080-99bc-604dfe367906 with identifier: VK94539
2026-03-30 07:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7f61a2a-98df-5080-99bc-604dfe367906 with scrape type 1
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7f61a2a-98df-5080-99bc-604dfe367906
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff86227d87e8ca0eb294f1c592372b248%252Fpa%252FVK94539_94cbedf0809ac43f6f6f59af321db753.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_94cbedf0809ac43f6f6f59af321db753.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff86227d87e8ca0eb294f1c592372b248%252Fpa%252FVK94539_e934cca9c512ba3e371d610af3f72570.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_e934cca9c512ba3e371d610af3f72570.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff86227d87e8ca0eb294f1c592372b248%252Fpa%252FVK94539_8010aac1c59b87d9988404c5d693ec49.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_8010aac1c59b87d9988404c5d693ec49.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff86227d87e8ca0eb294f1c592372b248%252Fpa%252FVK94539_018976550ed6a8e159c013dade9f0f80.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_018976550ed6a8e159c013dade9f0f80.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff86227d87e8ca0eb294f1c592372b248%252Fpa%252FVK94539_fe39cb8eabab61e30f924d88404f7ec7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_fe39cb8eabab61e30f924d88404f7ec7.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff86227d87e8ca0eb294f1c592372b248%252Fpa%252FVK94539_de3cf340e08e85f3ad9067333e6fa198.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_de3cf340e08e85f3ad9067333e6fa198.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff86227d87e8ca0eb294f1c592372b248%252Fpa%252FVK94539_2644391696c362d37d84234b787bc6eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_2644391696c362d37d84234b787bc6eb.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff86227d87e8ca0eb294f1c592372b248%252Fpa%252FVK94539_5d04f7cc639ec9689d4274ce172c2ed6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_5d04f7cc639ec9689d4274ce172c2ed6.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff86227d87e8ca0eb294f1c592372b248%252Fpa%252FVK94539_c920c3dda1c2cd591828b63c83a09557.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_c920c3dda1c2cd591828b63c83a09557.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf8%252F62%252Ff86227d87e8ca0eb294f1c592372b248%252Fpa%252FVK94539_abf7ed585ce966d6ecb9c9a65cbe7e6e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_abf7ed585ce966d6ecb9c9a65cbe7e6e.jpg already downloaded
2026-03-30 07:38:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d7f61a2a-98df-5080-99bc-604dfe367906, identifier: VK94539
2026-03-30 07:38:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68fb96a6-3ad8-5275-8da9-7e97edc3bca9 with identifier: DV12193
2026-03-30 07:38:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68fb96a6-3ad8-5275-8da9-7e97edc3bca9 with scrape type 1
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 68fb96a6-3ad8-5275-8da9-7e97edc3bca9
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fd8%252F89d80cb43c4d59ff0d8431bc36aa732e%252Fpa%252FDV12193_920a7fb109e13fadabf417f339293614.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_920a7fb109e13fadabf417f339293614.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fd8%252F89d80cb43c4d59ff0d8431bc36aa732e%252Fpa%252FDV12193_e81e82cfc36b93da00ac0c678e14c1b2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_e81e82cfc36b93da00ac0c678e14c1b2.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fd8%252F89d80cb43c4d59ff0d8431bc36aa732e%252Fpa%252FDV12193_33ecf370e734b7e3e4e91b13e4ad18a3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_33ecf370e734b7e3e4e91b13e4ad18a3.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fd8%252F89d80cb43c4d59ff0d8431bc36aa732e%252Fpa%252FDV12193_f1483974096240f066942cddcfc77d90.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_f1483974096240f066942cddcfc77d90.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fd8%252F89d80cb43c4d59ff0d8431bc36aa732e%252Fpa%252FDV12193_ce333c702ffc2027706bc1c6a7942096.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_ce333c702ffc2027706bc1c6a7942096.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fd8%252F89d80cb43c4d59ff0d8431bc36aa732e%252Fpa%252FDV12193_719ff72cd304eacfb0c93fb906178d44.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_719ff72cd304eacfb0c93fb906178d44.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fd8%252F89d80cb43c4d59ff0d8431bc36aa732e%252Fpa%252FDV12193_8cc9dbdabff63b40654e59ca38471492.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_8cc9dbdabff63b40654e59ca38471492.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fd8%252F89d80cb43c4d59ff0d8431bc36aa732e%252Fpa%252FDV12193_01d8ecdd87dc115b9d7da221773f6bc5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_01d8ecdd87dc115b9d7da221773f6bc5.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fd8%252F89d80cb43c4d59ff0d8431bc36aa732e%252Fpa%252FDV12193_f5627f3a570a1f4d41894dc35c25b3bd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_f5627f3a570a1f4d41894dc35c25b3bd.jpg already downloaded
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg89%252Fd8%252F89d80cb43c4d59ff0d8431bc36aa732e%252Fpa%252FDV12193_092ce381b3226892ae3f9032ed71c482.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_092ce381b3226892ae3f9032ed71c482.jpg already downloaded
2026-03-30 07:38:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 68fb96a6-3ad8-5275-8da9-7e97edc3bca9, identifier: DV12193
2026-03-30 07:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9b6d152-7e12-577a-a40b-bdcfca6e0865 with identifier: YK11401
2026-03-30 07:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9b6d152-7e12-577a-a40b-bdcfca6e0865 with identifier: YK11401
2026-03-30 07:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9b6d152-7e12-577a-a40b-bdcfca6e0865 with identifier: YK11401 to the API
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_b6993bf8fad2451be609f9b22c7c2eb2.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:54:41Z',
 'fuel_type': 'petrol',
 'id': 'f9b6d152-7e12-577a-a40b-bdcfca6e0865',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK11401',
 'listing': 'auction',
 'location': 'DE, Kamen',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 86235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_7f6518a2088b11615afa7249fd7b4e5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_6642adef47250f96bdb09690bbc4052e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58760,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_c6ff705f101a31f1223905155d7477e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_b1c9c443ee2c7531ca7ae9e6c8021a75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52637,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_465a6b887b83d0ec3010c2e69a8f46cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61807,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_d98590180cf3dd1ce29d403c350a96cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_4e1680aa93f673b2a3f5e53eb1781967.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_367d5049e14b01b5781a2b7011a05dbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_b6993bf8fad2451be609f9b22c7c2eb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f9b6d152-7e12-577a-a40b-bdcfca6e0865/f9b6d152-7e12-577a-a40b-bdcfca6e0865_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63233,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img8a/1a/8a1a2d55b4551c501516c9c553189f9b/pa/YK11401_eb058bc5abef40e3dfa101841b0c0075.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-02-18',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Premium',
 'transmission': 'manual',
 'trim': 'Premium',
 'year': 2010}
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK11401%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Saving data for YK11401: {'created_time': 1774856318.481737, 'last_price_update_time': 1774856318.481754, 'auction_closing_time': 1774972481.0}
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK11401') HTTP/1.1" 204 0
2026-03-30 07:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f20d4992-6c5f-587f-8acf-4f2b4fce5f3d with identifier: RF59698
2026-03-30 07:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f20d4992-6c5f-587f-8acf-4f2b4fce5f3d with identifier: RF59698
2026-03-30 07:38:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f20d4992-6c5f-587f-8acf-4f2b4fce5f3d with identifier: RF59698 to the API
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RF59698>
{'auction_title': '',
 'c_o_2_emission_value': 198,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 390,
 'expiration_date': '2026-03-31T15:29:00Z',
 'fuel_type': 'petrol',
 'id': 'f20d4992-6c5f-587f-8acf-4f2b4fce5f3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF59698',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Mercedes-Benz',
 'model': 'SLC-Klasse',
 'odometer': 84227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_72e5cff012f348134bc4c25bc9cff397.jpg',
                'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_8cf5800190ae92c91027a196f69c86c8.jpg',
                'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_7ca8e3dd586df2b8e9f946c30ebe0281.jpg',
                'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_0d76586567bfeb3ce514b85b1de17055.jpg',
                'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_5f1946c426a92609edea4d6ba71c5c35.jpg',
                'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_bd2f989e92671becb911a1289249b002.jpg',
                'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_a079842f7307dee58bd96b6037027bff.jpg',
                'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_dcbf6f98c739d90a4ffcc375746cdcce.jpg',
                'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_3e120a6724164378ad6fb0d9f7f21b52.jpg',
                'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_a312124e3125ee174475411417cb12fd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20d4992-6c5f-587f-8acf-4f2b4fce5f3d/f20d4992-6c5f-587f-8acf-4f2b4fce5f3d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2743443,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_72e5cff012f348134bc4c25bc9cff397.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20d4992-6c5f-587f-8acf-4f2b4fce5f3d/f20d4992-6c5f-587f-8acf-4f2b4fce5f3d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74987,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_8cf5800190ae92c91027a196f69c86c8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20d4992-6c5f-587f-8acf-4f2b4fce5f3d/f20d4992-6c5f-587f-8acf-4f2b4fce5f3d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2729774,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_7ca8e3dd586df2b8e9f946c30ebe0281.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20d4992-6c5f-587f-8acf-4f2b4fce5f3d/f20d4992-6c5f-587f-8acf-4f2b4fce5f3d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68243,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_0d76586567bfeb3ce514b85b1de17055.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20d4992-6c5f-587f-8acf-4f2b4fce5f3d/f20d4992-6c5f-587f-8acf-4f2b4fce5f3d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_5f1946c426a92609edea4d6ba71c5c35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20d4992-6c5f-587f-8acf-4f2b4fce5f3d/f20d4992-6c5f-587f-8acf-4f2b4fce5f3d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2940052,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_bd2f989e92671becb911a1289249b002.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20d4992-6c5f-587f-8acf-4f2b4fce5f3d/f20d4992-6c5f-587f-8acf-4f2b4fce5f3d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_a079842f7307dee58bd96b6037027bff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20d4992-6c5f-587f-8acf-4f2b4fce5f3d/f20d4992-6c5f-587f-8acf-4f2b4fce5f3d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90149,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_dcbf6f98c739d90a4ffcc375746cdcce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20d4992-6c5f-587f-8acf-4f2b4fce5f3d/f20d4992-6c5f-587f-8acf-4f2b4fce5f3d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_3e120a6724164378ad6fb0d9f7f21b52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f20d4992-6c5f-587f-8acf-4f2b4fce5f3d/f20d4992-6c5f-587f-8acf-4f2b4fce5f3d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/f5/6df536c1e0ad449e2c352407ba9db5a1/pa/RF59698_a312124e3125ee174475411417cb12fd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-01-15',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Mercedes-Benz SLC-Klasse SLC 43 AMG',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF59698%27 HTTP/1.1" 200 None
2026-03-30 07:38:38 [auto1.de] INFO: Saving data for RF59698: {'created_time': 1774856318.817749, 'last_price_update_time': 1774856318.81776, 'auction_closing_time': 1774970940.0}
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF59698') HTTP/1.1" 204 0
2026-03-30 07:38:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d7f61a2a-98df-5080-99bc-604dfe367906 with identifier: VK94539
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-30 07:38:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:38:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:38:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d7f61a2a-98df-5080-99bc-604dfe367906 with identifier: VK94539
2026-03-30 07:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d7f61a2a-98df-5080-99bc-604dfe367906 with identifier: VK94539 to the API
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VK94539>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:35:50Z',
 'fuel_type': 'diesel',
 'id': 'd7f61a2a-98df-5080-99bc-604dfe367906',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK94539',
 'listing': 'auction',
 'location': 'DE, Bad Camberg',
 'make': 'Jeep',
 'model': 'Renegade',
 'odometer': 119381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_94cbedf0809ac43f6f6f59af321db753.jpg',
                'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_e934cca9c512ba3e371d610af3f72570.jpg',
                'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_8010aac1c59b87d9988404c5d693ec49.jpg',
                'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_018976550ed6a8e159c013dade9f0f80.jpg',
                'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_fe39cb8eabab61e30f924d88404f7ec7.jpg',
                'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_de3cf340e08e85f3ad9067333e6fa198.jpg',
                'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_2644391696c362d37d84234b787bc6eb.jpg',
                'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_5d04f7cc639ec9689d4274ce172c2ed6.jpg',
                'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_c920c3dda1c2cd591828b63c83a09557.jpg',
                'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_abf7ed585ce966d6ecb9c9a65cbe7e6e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f61a2a-98df-5080-99bc-604dfe367906/d7f61a2a-98df-5080-99bc-604dfe367906_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_94cbedf0809ac43f6f6f59af321db753.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f61a2a-98df-5080-99bc-604dfe367906/d7f61a2a-98df-5080-99bc-604dfe367906_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80857,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_e934cca9c512ba3e371d610af3f72570.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f61a2a-98df-5080-99bc-604dfe367906/d7f61a2a-98df-5080-99bc-604dfe367906_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74522,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_8010aac1c59b87d9988404c5d693ec49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f61a2a-98df-5080-99bc-604dfe367906/d7f61a2a-98df-5080-99bc-604dfe367906_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2176726,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_018976550ed6a8e159c013dade9f0f80.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f61a2a-98df-5080-99bc-604dfe367906/d7f61a2a-98df-5080-99bc-604dfe367906_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2374063,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_fe39cb8eabab61e30f924d88404f7ec7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f61a2a-98df-5080-99bc-604dfe367906/d7f61a2a-98df-5080-99bc-604dfe367906_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2290484,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_de3cf340e08e85f3ad9067333e6fa198.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f61a2a-98df-5080-99bc-604dfe367906/d7f61a2a-98df-5080-99bc-604dfe367906_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2189770,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_2644391696c362d37d84234b787bc6eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f61a2a-98df-5080-99bc-604dfe367906/d7f61a2a-98df-5080-99bc-604dfe367906_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75201,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_5d04f7cc639ec9689d4274ce172c2ed6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f61a2a-98df-5080-99bc-604dfe367906/d7f61a2a-98df-5080-99bc-604dfe367906_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_c920c3dda1c2cd591828b63c83a09557.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7f61a2a-98df-5080-99bc-604dfe367906/d7f61a2a-98df-5080-99bc-604dfe367906_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72101,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf8/62/f86227d87e8ca0eb294f1c592372b248/pa/VK94539_abf7ed585ce966d6ecb9c9a65cbe7e6e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-12-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Jeep Renegade 2.0 M-Jet Limited Adventure Edition 4WD',
 'transmission': 'manual',
 'trim': 'Limited Adventure Edition 4WD',
 'year': 2015}
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK94539%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Saving data for VK94539: {'created_time': 1774856319.29555, 'last_price_update_time': 1774856319.29556, 'auction_closing_time': 1774971350.0}
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK94539') HTTP/1.1" 204 0
2026-03-30 07:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 68fb96a6-3ad8-5275-8da9-7e97edc3bca9 with identifier: DV12193
2026-03-30 07:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 68fb96a6-3ad8-5275-8da9-7e97edc3bca9 with identifier: DV12193
2026-03-30 07:38:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 68fb96a6-3ad8-5275-8da9-7e97edc3bca9 with identifier: DV12193 to the API
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DV12193>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:44:51Z',
 'fuel_type': 'petrol',
 'id': '68fb96a6-3ad8-5275-8da9-7e97edc3bca9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV12193',
 'listing': 'auction',
 'location': 'DE, Lahr',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 110431,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_920a7fb109e13fadabf417f339293614.jpg',
                'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_e81e82cfc36b93da00ac0c678e14c1b2.jpg',
                'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_33ecf370e734b7e3e4e91b13e4ad18a3.jpg',
                'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_f1483974096240f066942cddcfc77d90.jpg',
                'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_ce333c702ffc2027706bc1c6a7942096.jpg',
                'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_719ff72cd304eacfb0c93fb906178d44.jpg',
                'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_8cc9dbdabff63b40654e59ca38471492.jpg',
                'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_01d8ecdd87dc115b9d7da221773f6bc5.jpg',
                'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_f5627f3a570a1f4d41894dc35c25b3bd.jpg',
                'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_092ce381b3226892ae3f9032ed71c482.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68fb96a6-3ad8-5275-8da9-7e97edc3bca9/68fb96a6-3ad8-5275-8da9-7e97edc3bca9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3041966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_920a7fb109e13fadabf417f339293614.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68fb96a6-3ad8-5275-8da9-7e97edc3bca9/68fb96a6-3ad8-5275-8da9-7e97edc3bca9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2916162,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_e81e82cfc36b93da00ac0c678e14c1b2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68fb96a6-3ad8-5275-8da9-7e97edc3bca9/68fb96a6-3ad8-5275-8da9-7e97edc3bca9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2883713,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_33ecf370e734b7e3e4e91b13e4ad18a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68fb96a6-3ad8-5275-8da9-7e97edc3bca9/68fb96a6-3ad8-5275-8da9-7e97edc3bca9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_f1483974096240f066942cddcfc77d90.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68fb96a6-3ad8-5275-8da9-7e97edc3bca9/68fb96a6-3ad8-5275-8da9-7e97edc3bca9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_ce333c702ffc2027706bc1c6a7942096.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68fb96a6-3ad8-5275-8da9-7e97edc3bca9/68fb96a6-3ad8-5275-8da9-7e97edc3bca9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2710167,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_719ff72cd304eacfb0c93fb906178d44.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68fb96a6-3ad8-5275-8da9-7e97edc3bca9/68fb96a6-3ad8-5275-8da9-7e97edc3bca9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54835,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_8cc9dbdabff63b40654e59ca38471492.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68fb96a6-3ad8-5275-8da9-7e97edc3bca9/68fb96a6-3ad8-5275-8da9-7e97edc3bca9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_01d8ecdd87dc115b9d7da221773f6bc5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68fb96a6-3ad8-5275-8da9-7e97edc3bca9/68fb96a6-3ad8-5275-8da9-7e97edc3bca9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67788,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_f5627f3a570a1f4d41894dc35c25b3bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_68fb96a6-3ad8-5275-8da9-7e97edc3bca9/68fb96a6-3ad8-5275-8da9-7e97edc3bca9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3101831,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img89/d8/89d80cb43c4d59ff0d8431bc36aa732e/pa/DV12193_092ce381b3226892ae3f9032ed71c482.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-03-11',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV12193%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Saving data for DV12193: {'created_time': 1774856319.661874, 'last_price_update_time': 1774856319.661887, 'auction_closing_time': 1774971891.0}
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV12193') HTTP/1.1" 204 0
2026-03-30 07:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_f7f699bb7157565cb37e11a890a31bc4.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:39 [auto1.de] INFO: Found listing with ID: AV64350
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64350%27 HTTP/1.1" 200 None
2026-03-30 07:38:39 [auto1.de] INFO: Scrape type for AV64350: 2
2026-03-30 07:38:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36ad612e-c898-5743-9cf5-6d4d3e436509 with identifier: AV64350
2026-03-30 07:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36ad612e-c898-5743-9cf5-6d4d3e436509 with scrape type 2
2026-03-30 07:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36ad612e-c898-5743-9cf5-6d4d3e436509 with scrape type 2
2026-03-30 07:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36ad612e-c898-5743-9cf5-6d4d3e436509, identifier: AV64350
2026-03-30 07:38:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VW31483/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24592d0>
2026-03-30 07:38:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Fa3%252Fb9a3dc7a42bc804641e07c0658ce4d38%252Fpa%252FHC65117_854db71d2198ba51e133e46e42cc4d18.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_854db71d2198ba51e133e46e42cc4d18.jpg saved to cache
2026-03-30 07:38:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8
2026-03-30 07:38:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad4bff36-fd0e-5406-a37a-b0e80eff02f8, skipping ID generation
2026-03-30 07:38:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8 with scrape type 1
2026-03-30 07:38:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad4bff36-fd0e-5406-a37a-b0e80eff02f8 sending to next pipeline
2026-03-30 07:38:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad4bff36-fd0e-5406-a37a-b0e80eff02f8, identifier: HC65117
2026-03-30 07:38:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36ad612e-c898-5743-9cf5-6d4d3e436509 with identifier: AV64350
2026-03-30 07:38:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36ad612e-c898-5743-9cf5-6d4d3e436509 with identifier: AV64350
2026-03-30 07:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36ad612e-c898-5743-9cf5-6d4d3e436509 with identifier: AV64350 to the API
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:49:02Z',
 'fuel_type': 'petrol',
 'id': '36ad612e-c898-5743-9cf5-6d4d3e436509',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV64350',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 49227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-12',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2011}
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64350%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Saving data for AV64350: {'auction_closing_time': 1774972142.0, 'created_time': 1773302237.611289, 'last_price_update_time': 1774856320.290207}
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV64350') HTTP/1.1" 204 0
2026-03-30 07:38:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad4bff36-fd0e-5406-a37a-b0e80eff02f8 with identifier: HC65117
2026-03-30 07:38:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad4bff36-fd0e-5406-a37a-b0e80eff02f8 with identifier: HC65117
2026-03-30 07:38:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad4bff36-fd0e-5406-a37a-b0e80eff02f8 with identifier: HC65117 to the API
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_854db71d2198ba51e133e46e42cc4d18.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:46:27Z',
 'fuel_type': 'diesel',
 'id': 'ad4bff36-fd0e-5406-a37a-b0e80eff02f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC65117',
 'listing': 'auction',
 'location': 'DE, Friedrichshafen',
 'make': 'Citroen',
 'model': 'C3 Aircross',
 'odometer': 99375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_4f670e83dd7aa0ebd759456b62e35b94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_6c9b8aa208c897933bdd467688369118.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66895,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_854db71d2198ba51e133e46e42cc4d18.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_6e7f619a39854fd280e83d2c84859886.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_dbfe46521edbce17181f12b2922b4588.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67258,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_afab259ff48fa65f78ae9d37d4f180e4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_d821182e7e39444201ee1fcdcb510a58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_5b1657add44122d1003b8e0c282468da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_5c7b96ce6a170cc7e3d890c69760c95c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ad4bff36-fd0e-5406-a37a-b0e80eff02f8/ad4bff36-fd0e-5406-a37a-b0e80eff02f8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61060,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/a3/b9a3dc7a42bc804641e07c0658ce4d38/pa/HC65117_e8dbcac78ba534cd0111c5f35182d249.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-12-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 Aircross 1.5 Blue-HDi Origins',
 'transmission': 'automatic',
 'trim': 'Origins',
 'year': 2019}
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC65117%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Saving data for HC65117: {'created_time': 1774856320.728415, 'last_price_update_time': 1774856320.728428, 'auction_closing_time': 1774971987.0}
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC65117') HTTP/1.1" 204 0
2026-03-30 07:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2464d10>
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_d466e4acb3ae7fb9ab22b706d649530c.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_d466e4acb3ae7fb9ab22b706d649530c.jpg saved to cache
2026-03-30 07:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2473450>
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_afd85d8ebb0e7233417ecb70d0ee7c70.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_afd85d8ebb0e7233417ecb70d0ee7c70.jpg saved to cache
2026-03-30 07:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c3225a1a-aea7-5af5-ae47-4421d244b32f
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23bc7d0>
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_cbd6ca9f447be1e89505124eac022368.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_cbd6ca9f447be1e89505124eac022368.jpg saved to cache
2026-03-30 07:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c3225a1a-aea7-5af5-ae47-4421d244b32f
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d8e5c550>
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_509991d717f864ac2d83e838d9c56d71.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_509991d717f864ac2d83e838d9c56d71.jpg saved to cache
2026-03-30 07:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 026a1a5f-0042-5c2d-a41b-395d71fade6c
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d911b490>
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_ab33d618d4f62d42bf65809727bd4ca7.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_ab33d618d4f62d42bf65809727bd4ca7.jpg saved to cache
2026-03-30 07:38:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf3dec33-89d4-5221-9139-a5056fae806e
2026-03-30 07:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_20b51317848deea02f04482c789bf450.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b89923113394ee9f0adfdf3e5ee3b2c0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_4d57e7fe3e235860cd35bad3b5f59c36.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_ccc75cdbf8226594f7d34fecc38e3d52.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_3d13501b7e3a9f473f4e3512e824e14f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: FN76281
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: TT64948
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: YM08945
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: KB35641
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: AC60710
2026-03-30 07:38:40 [auto1.de] INFO: Found listing with ID: HB23810
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB23810%27 HTTP/1.1" 200 None
2026-03-30 07:38:40 [auto1.de] INFO: Scrape type for HB23810: 1
2026-03-30 07:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_73aa26a489bc79308a3e6f12b929a5ab.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d9717450>
2026-03-30 07:38:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252Fc9%252F3dc997b5586468fc180b9c7b0cb10db9%252Fpa%252FMS93141_f7f699bb7157565cb37e11a890a31bc4.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_f7f699bb7157565cb37e11a890a31bc4.jpg saved to cache
2026-03-30 07:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee
2026-03-30 07:38:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c842d76-15e9-515c-b8a6-1e75a88c95ee, skipping ID generation
2026-03-30 07:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee with scrape type 1
2026-03-30 07:38:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c842d76-15e9-515c-b8a6-1e75a88c95ee sending to next pipeline
2026-03-30 07:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c842d76-15e9-515c-b8a6-1e75a88c95ee, identifier: MS93141
2026-03-30 07:38:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_fdfd24fb55d317157dffdc12db794920.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:41 [auto1.de] INFO: Found listing with ID: PJ19730
2026-03-30 07:38:41 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-30 07:38:41 [auto1.de] INFO: Found listing with ID: BF77211
2026-03-30 07:38:41 [auto1.de] INFO: Found listing with ID: PN21197
2026-03-30 07:38:41 [auto1.de] INFO: Found listing with ID: MJ18001
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ18001%27 HTTP/1.1" 200 None
2026-03-30 07:38:41 [auto1.de] INFO: Scrape type for MJ18001: 2
2026-03-30 07:38:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 294efa26-0243-5c7d-a323-db3baf15a567 with identifier: MJ18001
2026-03-30 07:38:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 294efa26-0243-5c7d-a323-db3baf15a567 with scrape type 2
2026-03-30 07:38:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 294efa26-0243-5c7d-a323-db3baf15a567 with scrape type 2
2026-03-30 07:38:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 294efa26-0243-5c7d-a323-db3baf15a567, identifier: MJ18001
2026-03-30 07:38:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c842d76-15e9-515c-b8a6-1e75a88c95ee with identifier: MS93141
2026-03-30 07:38:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c842d76-15e9-515c-b8a6-1e75a88c95ee with identifier: MS93141
2026-03-30 07:38:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c842d76-15e9-515c-b8a6-1e75a88c95ee with identifier: MS93141 to the API
2026-03-30 07:38:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_f7f699bb7157565cb37e11a890a31bc4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:16:09Z',
 'fuel_type': 'diesel',
 'id': '4c842d76-15e9-515c-b8a6-1e75a88c95ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS93141',
 'listing': 'auction',
 'location': 'DE, Wilhelmshaven',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 138308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2940564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_39441b2711117fb19ed951f02ff57361.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88361,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_d466e4acb3ae7fb9ab22b706d649530c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2899270,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_f7f699bb7157565cb37e11a890a31bc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_068378a17814507f29c85f15908e0150.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_1f9f97b63f1a3914c7e5f3f76de4e83a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2859549,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_e5686b02320c622ef31b157d95e534b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73576,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_227d5cbb805512b39aa71021cebe0c4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88110,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_b3a9a0c6631c734cf35ac5ea21b4b2fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_1fd6bdf09a209677d9de3a851cafe78b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c842d76-15e9-515c-b8a6-1e75a88c95ee/4c842d76-15e9-515c-b8a6-1e75a88c95ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/c9/3dc997b5586468fc180b9c7b0cb10db9/pa/MS93141_84842057dddf30194ba085e3d3b919d1.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Lounge Sport & Style BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge Sport & Style BlueMotion Tech',
 'year': 2015}
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS93141%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Saving data for MS93141: {'created_time': 1774856322.272171, 'last_price_update_time': 1774856322.272186, 'auction_closing_time': 1774970169.0}
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS93141') HTTP/1.1" 204 0
2026-03-30 07:38:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 294efa26-0243-5c7d-a323-db3baf15a567 with identifier: MJ18001
2026-03-30 07:38:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 294efa26-0243-5c7d-a323-db3baf15a567 with identifier: MJ18001
2026-03-30 07:38:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 294efa26-0243-5c7d-a323-db3baf15a567 with identifier: MJ18001 to the API
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-31T15:43:44Z',
 'fuel_type': 'diesel',
 'id': '294efa26-0243-5c7d-a323-db3baf15a567',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ18001',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 78904,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-26',
 'seller_name': None,
 'title': 'Renault Megane 1.5 BLUE dCi Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2020}
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ18001%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Saving data for MJ18001: {'auction_closing_time': 1774971824.0, 'created_time': 1774293642.018251, 'last_price_update_time': 1774856322.767047}
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ18001') HTTP/1.1" 204 0
2026-03-30 07:38:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_bad7046399b448964cabbb908bebfc9c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: AE43577
2026-03-30 07:38:42 [auto1.de] INFO: Found listing with ID: YG65441
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65441%27 HTTP/1.1" 200 None
2026-03-30 07:38:42 [auto1.de] INFO: Scrape type for YG65441: 2
2026-03-30 07:38:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4fcb259-1ebe-529c-9dd8-4c2dbbe49c09 with identifier: YG65441
2026-03-30 07:38:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4fcb259-1ebe-529c-9dd8-4c2dbbe49c09 with scrape type 2
2026-03-30 07:38:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4fcb259-1ebe-529c-9dd8-4c2dbbe49c09 with scrape type 2
2026-03-30 07:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4fcb259-1ebe-529c-9dd8-4c2dbbe49c09, identifier: YG65441
2026-03-30 07:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CX99229> (referer: https://www.auto1.com/v1/car-details-view/CX99229/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS73688/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d90e9710>
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_20b51317848deea02f04482c789bf450.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_20b51317848deea02f04482c789bf450.jpg saved to cache
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2fa30d0>
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F1c%252Ff31c1631b55c318feb8ecdeb0c62ec87%252Fpa%252FGH55253_b89923113394ee9f0adfdf3e5ee3b2c0.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b89923113394ee9f0adfdf3e5ee3b2c0.jpg saved to cache
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 026a1a5f-0042-5c2d-a41b-395d71fade6c
2026-03-30 07:38:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 026a1a5f-0042-5c2d-a41b-395d71fade6c, skipping ID generation
2026-03-30 07:38:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 026a1a5f-0042-5c2d-a41b-395d71fade6c with scrape type 1
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 026a1a5f-0042-5c2d-a41b-395d71fade6c sending to next pipeline
2026-03-30 07:38:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 026a1a5f-0042-5c2d-a41b-395d71fade6c, identifier: GH55253
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23ea710>
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_4d57e7fe3e235860cd35bad3b5f59c36.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_4d57e7fe3e235860cd35bad3b5f59c36.jpg saved to cache
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2ed2650>
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_ccc75cdbf8226594f7d34fecc38e3d52.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_ccc75cdbf8226594f7d34fecc38e3d52.jpg saved to cache
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf3dec33-89d4-5221-9139-a5056fae806e
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2457ed0>
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_3d13501b7e3a9f473f4e3512e824e14f.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_3d13501b7e3a9f473f4e3512e824e14f.jpg saved to cache
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf3dec33-89d4-5221-9139-a5056fae806e
2026-03-30 07:38:43 [auto1.de] INFO: Channel: 24h | Page: 22 | totalHits: 7818 | hits on page: 40
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23d78d0>
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_73aa26a489bc79308a3e6f12b929a5ab.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_73aa26a489bc79308a3e6f12b929a5ab.jpg saved to cache
2026-03-30 07:38:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf3dec33-89d4-5221-9139-a5056fae806e
2026-03-30 07:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_db28aaa9ca23ddb982b102c255591084.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4fcb259-1ebe-529c-9dd8-4c2dbbe49c09 with identifier: YG65441
2026-03-30 07:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4fcb259-1ebe-529c-9dd8-4c2dbbe49c09 with identifier: YG65441
2026-03-30 07:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4fcb259-1ebe-529c-9dd8-4c2dbbe49c09 with identifier: YG65441 to the API
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:16:39Z',
 'fuel_type': 'diesel',
 'id': 'a4fcb259-1ebe-529c-9dd8-4c2dbbe49c09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG65441',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 203266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2013}
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65441%27 HTTP/1.1" 200 None
2026-03-30 07:38:43 [auto1.de] INFO: Saving data for YG65441: {'auction_closing_time': 1774970199.0, 'created_time': 1774293275.327704, 'last_price_update_time': 1774856323.700153}
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG65441') HTTP/1.1" 204 0
2026-03-30 07:38:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HK59987/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 026a1a5f-0042-5c2d-a41b-395d71fade6c with identifier: GH55253
2026-03-30 07:38:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 026a1a5f-0042-5c2d-a41b-395d71fade6c with identifier: GH55253
2026-03-30 07:38:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 026a1a5f-0042-5c2d-a41b-395d71fade6c with identifier: GH55253 to the API
2026-03-30 07:38:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b89923113394ee9f0adfdf3e5ee3b2c0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:53:09Z',
 'fuel_type': 'diesel',
 'id': '026a1a5f-0042-5c2d-a41b-395d71fade6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH55253',
 'listing': 'auction',
 'location': 'DE, Arnsberg',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 275143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_c8686444ea0d9f7f055dd1a700e1268a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_f13dcb97be6fadf13c21945ca1dad8b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_3c6d99667753cce0ee30f2ecb017b50c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_7e2a3a10be0d73eb19768a1682aa2b3d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_a7b96bf897c00d85432a8a058352b3fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_4b2af5595a9cf841d38d16333b3a6e9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49551,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b2cdab90922f2d319b33c1ebf45c072b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72193,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b345ab36acec2cddfd2a7c9dc803b3e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_b89923113394ee9f0adfdf3e5ee3b2c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_026a1a5f-0042-5c2d-a41b-395d71fade6c/026a1a5f-0042-5c2d-a41b-395d71fade6c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/1c/f31c1631b55c318feb8ecdeb0c62ec87/pa/GH55253_509991d717f864ac2d83e838d9c56d71.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-08-04',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Maxi Kasten BlueMotion',
 'transmission': 'manual',
 'trim': 'Maxi Kasten BlueMotion',
 'year': 2015}
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH55253%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Saving data for GH55253: {'created_time': 1774856324.149153, 'last_price_update_time': 1774856324.149168, 'auction_closing_time': 1774972389.0}
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH55253') HTTP/1.1" 204 0
2026-03-30 07:38:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e7ea10>
2026-03-30 07:38:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252Ff0%252Fa3f0a3c72effaa2cb20c78f5d074f68a%252Fpa%252FFA98768_fdfd24fb55d317157dffdc12db794920.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_fdfd24fb55d317157dffdc12db794920.jpg saved to cache
2026-03-30 07:38:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf3dec33-89d4-5221-9139-a5056fae806e
2026-03-30 07:38:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf3dec33-89d4-5221-9139-a5056fae806e, skipping ID generation
2026-03-30 07:38:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3dec33-89d4-5221-9139-a5056fae806e with scrape type 1
2026-03-30 07:38:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf3dec33-89d4-5221-9139-a5056fae806e sending to next pipeline
2026-03-30 07:38:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf3dec33-89d4-5221-9139-a5056fae806e, identifier: FA98768
2026-03-30 07:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_309dcb9792c5f56d918abe9bb664337a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_dee499afdcb123067b8d03a8775e53ce.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_2f211ff404607a700cf24aadd50e1d19.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: AG29353
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: TZ85703
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: UR86054
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: TY20529
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20529%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for TY20529: 1
2026-03-30 07:38:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: PJ19730
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: TD77753
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: BF77211
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: PN21197
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: MJ18001
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ18001%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for MJ18001: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: AE43577
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: YG65441
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG65441%27 HTTP/1.1" 200 None
2026-03-30 07:38:44 [auto1.de] INFO: Scrape type for YG65441: 0
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: AG29353
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: TZ85703
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: UR86054
2026-03-30 07:38:44 [auto1.de] INFO: Found listing with ID: TY20529
2026-03-30 07:38:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf3dec33-89d4-5221-9139-a5056fae806e with identifier: FA98768
2026-03-30 07:38:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf3dec33-89d4-5221-9139-a5056fae806e with identifier: FA98768
2026-03-30 07:38:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf3dec33-89d4-5221-9139-a5056fae806e with identifier: FA98768 to the API
2026-03-30 07:38:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_fdfd24fb55d317157dffdc12db794920.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:04:46Z',
 'fuel_type': 'diesel',
 'id': 'cf3dec33-89d4-5221-9139-a5056fae806e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA98768',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 82259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100687,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_fdfd24fb55d317157dffdc12db794920.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_73aa26a489bc79308a3e6f12b929a5ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_3d13501b7e3a9f473f4e3512e824e14f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_ccc75cdbf8226594f7d34fecc38e3d52.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_847ec5647a86f908820fc3744ba282ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72614,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_7ecdd5920bfcf1b8ab8f965b487bd2bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_b0ae0bbce386dd77db3df0e5b7d83fcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_a77214b46a30dc512e5827ac295b3a4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_ab33d618d4f62d42bf65809727bd4ca7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf3dec33-89d4-5221-9139-a5056fae806e/cf3dec33-89d4-5221-9139-a5056fae806e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/f0/a3f0a3c72effaa2cb20c78f5d074f68a/pa/FA98768_4f3200e3e92a5346734b2882cd9efc51.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-06-18',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Energy Rapid Extra',
 'transmission': 'manual',
 'trim': 'Rapid Extra',
 'year': 2019}
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA98768%27 HTTP/1.1" 200 None
2026-03-30 07:38:45 [auto1.de] INFO: Saving data for FA98768: {'created_time': 1774856325.388999, 'last_price_update_time': 1774856325.38901, 'auction_closing_time': 1774969486.0}
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FA98768') HTTP/1.1" 204 0
2026-03-30 07:38:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23c5250>
2026-03-30 07:38:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgb3%252F29%252Fb329d2a8d82f54ed682376ae54231554%252Fpa%252FLS48573_bad7046399b448964cabbb908bebfc9c.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_bad7046399b448964cabbb908bebfc9c.jpg saved to cache
2026-03-30 07:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292
2026-03-30 07:38:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292, skipping ID generation
2026-03-30 07:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292 with scrape type 1
2026-03-30 07:38:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292 sending to next pipeline
2026-03-30 07:38:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292, identifier: LS48573
2026-03-30 07:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c6abda-2131-5867-8744-0db2324fd61f with identifier: CX99229
2026-03-30 07:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c6abda-2131-5867-8744-0db2324fd61f with scrape type 1
2026-03-30 07:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 41c6abda-2131-5867-8744-0db2324fd61f
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_eb9baa0857ce258f443d4acba4ed5b98.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_eb9baa0857ce258f443d4acba4ed5b98.jpg not downloaded yet
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: RX59443
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: UB75058
2026-03-30 07:38:45 [auto1.de] INFO: Found listing with ID: TE16173
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE16173%27 HTTP/1.1" 200 None
2026-03-30 07:38:45 [auto1.de] INFO: Scrape type for TE16173: 2
2026-03-30 07:38:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: def9e98c-ada2-5acc-8edc-1568903faec3 with identifier: TE16173
2026-03-30 07:38:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item def9e98c-ada2-5acc-8edc-1568903faec3 with scrape type 2
2026-03-30 07:38:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item def9e98c-ada2-5acc-8edc-1568903faec3 with scrape type 2
2026-03-30 07:38:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: def9e98c-ada2-5acc-8edc-1568903faec3, identifier: TE16173
2026-03-30 07:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292 with identifier: LS48573
2026-03-30 07:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292 with identifier: LS48573
2026-03-30 07:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bd2da00-685e-5e0c-bec5-b1e6fc5ca292 with identifier: LS48573 to the API
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_bad7046399b448964cabbb908bebfc9c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:57:15Z',
 'fuel_type': 'petrol',
 'id': '5bd2da00-685e-5e0c-bec5-b1e6fc5ca292',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS48573',
 'listing': 'auction',
 'location': 'DE, Duisburg',
 'make': 'Volkswagen',
 'model': 'Tiguan Allspace',
 'odometer': 113499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67369,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_35a14b846e32f89d75d9303d52f8c3e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_d983df3af4548b42729df74c70b35da7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64364,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_bad7046399b448964cabbb908bebfc9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_20b51317848deea02f04482c789bf450.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67975,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_4d57e7fe3e235860cd35bad3b5f59c36.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_9ee6c4067c80508e64734e63aaa9f253.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_34ce4fa6a271d433d03bea9e4c6b9fd7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_d927f71163a71b04453e1144938d10db.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68068,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_0d3cfc89d469c9499b47a244e612aaf3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bd2da00-685e-5e0c-bec5-b1e6fc5ca292/5bd2da00-685e-5e0c-bec5-b1e6fc5ca292_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69239,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb3/29/b329d2a8d82f54ed682376ae54231554/pa/LS48573_27388774142fac6480c9f827883a1aa6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Volkswagen Tiguan Allspace 2.0 TSI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2018}
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS48573%27 HTTP/1.1" 200 None
2026-03-30 07:38:46 [auto1.de] INFO: Saving data for LS48573: {'created_time': 1774856326.433545, 'last_price_update_time': 1774856326.433556, 'auction_closing_time': 1774972635.0}
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS48573') HTTP/1.1" 204 0
2026-03-30 07:38:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: def9e98c-ada2-5acc-8edc-1568903faec3 with identifier: TE16173
2026-03-30 07:38:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: def9e98c-ada2-5acc-8edc-1568903faec3 with identifier: TE16173
2026-03-30 07:38:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: def9e98c-ada2-5acc-8edc-1568903faec3 with identifier: TE16173 to the API
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:43:57Z',
 'fuel_type': 'diesel',
 'id': 'def9e98c-ada2-5acc-8edc-1568903faec3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE16173',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 121175,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-14',
 'seller_name': None,
 'title': 'BMW X6 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE16173%27 HTTP/1.1" 200 None
2026-03-30 07:38:46 [auto1.de] INFO: Saving data for TE16173: {'auction_closing_time': 1774971837.0, 'created_time': 1774294013.18514, 'last_price_update_time': 1774856326.795679}
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE16173') HTTP/1.1" 204 0
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_89b10ad3ec6d66d14d3a414a75698a55.png%27 HTTP/1.1" 200 None
2026-03-30 07:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_89b10ad3ec6d66d14d3a414a75698a55.png not downloaded yet
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22a2910>
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_db28aaa9ca23ddb982b102c255591084.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_db28aaa9ca23ddb982b102c255591084.jpg saved to cache
2026-03-30 07:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22cc750>
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_309dcb9792c5f56d918abe9bb664337a.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_309dcb9792c5f56d918abe9bb664337a.jpg saved to cache
2026-03-30 07:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d238a050>
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc7%252Ff7%252Fc7f77c96058787080609924577ad1069%252Fpa%252FSB15541_dee499afdcb123067b8d03a8775e53ce.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_dee499afdcb123067b8d03a8775e53ce.jpg saved to cache
2026-03-30 07:38:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5
2026-03-30 07:38:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7574d6ac-1d68-5fb4-98c6-10ab125974d5, skipping ID generation
2026-03-30 07:38:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5 with scrape type 1
2026-03-30 07:38:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7574d6ac-1d68-5fb4-98c6-10ab125974d5 sending to next pipeline
2026-03-30 07:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7574d6ac-1d68-5fb4-98c6-10ab125974d5, identifier: SB15541
2026-03-30 07:38:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23bb0d0>
2026-03-30 07:38:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_2f211ff404607a700cf24aadd50e1d19.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_2f211ff404607a700cf24aadd50e1d19.jpg saved to cache
2026-03-30 07:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94323638-e75a-5610-9408-d796c485f7cc
2026-03-30 07:38:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_e16cefc82cd51ae9259d710c24f70207.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:47 [auto1.de] INFO: Found listing with ID: SC19124
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19124%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Scrape type for SC19124: 2
2026-03-30 07:38:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea7a3b16-5f39-5df0-bef4-b85461dcc233 with identifier: SC19124
2026-03-30 07:38:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea7a3b16-5f39-5df0-bef4-b85461dcc233 with scrape type 2
2026-03-30 07:38:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea7a3b16-5f39-5df0-bef4-b85461dcc233 with scrape type 2
2026-03-30 07:38:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea7a3b16-5f39-5df0-bef4-b85461dcc233, identifier: SC19124
2026-03-30 07:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7574d6ac-1d68-5fb4-98c6-10ab125974d5 with identifier: SB15541
2026-03-30 07:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7574d6ac-1d68-5fb4-98c6-10ab125974d5 with identifier: SB15541
2026-03-30 07:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7574d6ac-1d68-5fb4-98c6-10ab125974d5 with identifier: SB15541 to the API
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_dee499afdcb123067b8d03a8775e53ce.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 255,
 'expiration_date': '2026-03-31T15:51:34Z',
 'fuel_type': 'petrol',
 'id': '7574d6ac-1d68-5fb4-98c6-10ab125974d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB15541',
 'listing': 'auction',
 'location': 'DE, Northeim',
 'make': 'Volvo',
 'model': 'V90',
 'odometer': 119397,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 17,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_309dcb9792c5f56d918abe9bb664337a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68735,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_0734c66a128fb1ba1b3b6aa274597b11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62200,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_db28aaa9ca23ddb982b102c255591084.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54164,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_87d885e61cd757fcc2574db87146a3f2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_6c9d04290e9e73d517a3524a3ef1727e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_12b00b7bafd2bf6cdad52f91304005bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_325722c75ad52dc24bdfa921d8318253.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69176,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_dee499afdcb123067b8d03a8775e53ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69419,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_588ea5973d7ffc69e34944f69a8779ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7574d6ac-1d68-5fb4-98c6-10ab125974d5/7574d6ac-1d68-5fb4-98c6-10ab125974d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc7/f7/c7f77c96058787080609924577ad1069/pa/SB15541_c16d31ffaf29e6939d9bfc2a02ce6f78.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-12',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V90 2.0 T5 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2018}
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB15541%27 HTTP/1.1" 200 None
2026-03-30 07:38:47 [auto1.de] INFO: Saving data for SB15541: {'created_time': 1774856327.653401, 'last_price_update_time': 1774856327.653414, 'auction_closing_time': 1774972294.0}
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB15541') HTTP/1.1" 204 0
2026-03-30 07:38:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea7a3b16-5f39-5df0-bef4-b85461dcc233 with identifier: SC19124
2026-03-30 07:38:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea7a3b16-5f39-5df0-bef4-b85461dcc233 with identifier: SC19124
2026-03-30 07:38:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea7a3b16-5f39-5df0-bef4-b85461dcc233 with identifier: SC19124 to the API
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:58:29Z',
 'fuel_type': 'petrol',
 'id': 'ea7a3b16-5f39-5df0-bef4-b85461dcc233',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SC19124',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 151239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-18',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19124%27 HTTP/1.1" 200 None
2026-03-30 07:38:48 [auto1.de] INFO: Saving data for SC19124: {'auction_closing_time': 1774972709.0, 'created_time': 1774293590.788839, 'last_price_update_time': 1774856328.019681}
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SC19124') HTTP/1.1" 204 0
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_261feee8fd716325eb3977a9da185006.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_261feee8fd716325eb3977a9da185006.jpg not downloaded yet
2026-03-30 07:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK94658/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:48 [auto1.de] INFO: Found listing with ID: YT41914
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT41914%27 HTTP/1.1" 200 None
2026-03-30 07:38:48 [auto1.de] INFO: Scrape type for YT41914: 1
2026-03-30 07:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZB59914> (referer: https://www.auto1.com/v1/car-details-view/ZB59914/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_eb9baa0857ce258f443d4acba4ed5b98.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_1917c7e3127b18eaed418e05e54406a8.png%27 HTTP/1.1" 200 None
2026-03-30 07:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_1917c7e3127b18eaed418e05e54406a8.png not downloaded yet
2026-03-30 07:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CS96512/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:48 [auto1.de] INFO: Found listing with ID: SV96004
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV96004%27 HTTP/1.1" 200 None
2026-03-30 07:38:48 [auto1.de] INFO: Scrape type for SV96004: 2
2026-03-30 07:38:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ca3fdb5-7d8e-579a-b76f-4e8c1ba05d57 with identifier: SV96004
2026-03-30 07:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ca3fdb5-7d8e-579a-b76f-4e8c1ba05d57 with scrape type 2
2026-03-30 07:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ca3fdb5-7d8e-579a-b76f-4e8c1ba05d57 with scrape type 2
2026-03-30 07:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ca3fdb5-7d8e-579a-b76f-4e8c1ba05d57, identifier: SV96004
2026-03-30 07:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ED11962/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24fb010>
2026-03-30 07:38:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgff%252Ff8%252Ffff80523a2beff1bd48325cd4f6d1d4a%252Fpa%252FNH50671_e16cefc82cd51ae9259d710c24f70207.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_e16cefc82cd51ae9259d710c24f70207.jpg saved to cache
2026-03-30 07:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 474f0d8c-6d4c-535a-9518-9133a31b6b20
2026-03-30 07:38:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 474f0d8c-6d4c-535a-9518-9133a31b6b20, skipping ID generation
2026-03-30 07:38:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 474f0d8c-6d4c-535a-9518-9133a31b6b20 with scrape type 1
2026-03-30 07:38:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 474f0d8c-6d4c-535a-9518-9133a31b6b20 sending to next pipeline
2026-03-30 07:38:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 474f0d8c-6d4c-535a-9518-9133a31b6b20, identifier: NH50671
2026-03-30 07:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ca3fdb5-7d8e-579a-b76f-4e8c1ba05d57 with identifier: SV96004
2026-03-30 07:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ca3fdb5-7d8e-579a-b76f-4e8c1ba05d57 with identifier: SV96004
2026-03-30 07:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ca3fdb5-7d8e-579a-b76f-4e8c1ba05d57 with identifier: SV96004 to the API
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-31T15:25:33Z',
 'fuel_type': 'diesel',
 'id': '7ca3fdb5-7d8e-579a-b76f-4e8c1ba05d57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV96004',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 65808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Feel XL',
 'transmission': 'manual',
 'trim': 'Feel XL',
 'year': 2021}
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV96004%27 HTTP/1.1" 200 None
2026-03-30 07:38:48 [auto1.de] INFO: Saving data for SV96004: {'auction_closing_time': 1774970733.0, 'created_time': 1773687608.355621, 'last_price_update_time': 1774856328.676165}
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV96004') HTTP/1.1" 204 0
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_73c6499e1b7f0ffa334a72cda338e005.png%27 HTTP/1.1" 200 None
2026-03-30 07:38:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_73c6499e1b7f0ffa334a72cda338e005.png not downloaded yet
2026-03-30 07:38:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 474f0d8c-6d4c-535a-9518-9133a31b6b20 with identifier: NH50671
2026-03-30 07:38:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 474f0d8c-6d4c-535a-9518-9133a31b6b20 with identifier: NH50671
2026-03-30 07:38:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 474f0d8c-6d4c-535a-9518-9133a31b6b20 with identifier: NH50671 to the API
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_e16cefc82cd51ae9259d710c24f70207.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.1L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-31T15:07:11Z',
 'fuel_type': 'petrol',
 'id': '474f0d8c-6d4c-535a-9518-9133a31b6b20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH50671',
 'listing': 'auction',
 'location': 'DE, Lahnstein',
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 90754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75711,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_202bdc9bf0f3c73d9f336868792db458.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81625,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_32ef90e416c068c151a53da8e34519ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77947,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_1dfe24adf8444c24ed93ad43d01501c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_f117064ab5d46c8e1301f6bafe78a43c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 132640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_f87b99d1ba30bc8a1bf61a2024c9b30c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_474f0d8c-6d4c-535a-9518-9133a31b6b20/474f0d8c-6d4c-535a-9518-9133a31b6b20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69533,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgff/f8/fff80523a2beff1bd48325cd4f6d1d4a/pa/NH50671_e16cefc82cd51ae9259d710c24f70207.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-11-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Modus 1.2 YAHOO!',
 'transmission': 'manual',
 'trim': 'YAHOO!',
 'year': 2011}
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH50671%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Saving data for NH50671: {'created_time': 1774856329.075306, 'last_price_update_time': 1774856329.075319, 'auction_closing_time': 1774969631.0}
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH50671') HTTP/1.1" 204 0
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: CF37997
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: FA11917
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: DX58927
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: XD63498
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD63498%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for XD63498: 2
2026-03-30 07:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88002292-8b02-5efa-9084-811e973649b0 with identifier: XD63498
2026-03-30 07:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88002292-8b02-5efa-9084-811e973649b0 with scrape type 2
2026-03-30 07:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88002292-8b02-5efa-9084-811e973649b0 with scrape type 2
2026-03-30 07:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88002292-8b02-5efa-9084-811e973649b0, identifier: XD63498
2026-03-30 07:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88002292-8b02-5efa-9084-811e973649b0 with identifier: XD63498
2026-03-30 07:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88002292-8b02-5efa-9084-811e973649b0 with identifier: XD63498
2026-03-30 07:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88002292-8b02-5efa-9084-811e973649b0 with identifier: XD63498 to the API
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:50:09Z',
 'fuel_type': 'diesel',
 'id': '88002292-8b02-5efa-9084-811e973649b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD63498',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 137476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-11',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d xLine',
 'transmission': 'automatic',
 'trim': 'xLine',
 'year': 2017}
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD63498%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Saving data for XD63498: {'auction_closing_time': 1774972209.0, 'created_time': 1774293514.391362, 'last_price_update_time': 1774856329.587806}
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD63498') HTTP/1.1" 204 0
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_930069de4b720ad7aab89f5037face05.png%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_930069de4b720ad7aab89f5037face05.png not downloaded yet
2026-03-30 07:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_261feee8fd716325eb3977a9da185006.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:49 [auto1.de] INFO: Found listing with ID: JB86449
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86449%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [auto1.de] INFO: Scrape type for JB86449: 2
2026-03-30 07:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a802972-b017-5350-922f-c8c371b5192e with identifier: JB86449
2026-03-30 07:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a802972-b017-5350-922f-c8c371b5192e with scrape type 2
2026-03-30 07:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a802972-b017-5350-922f-c8c371b5192e with scrape type 2
2026-03-30 07:38:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a802972-b017-5350-922f-c8c371b5192e, identifier: JB86449
2026-03-30 07:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB23810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UJ03238/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 012064c5-1888-5fde-a123-f8c75b6b9c49 with identifier: ZB59914
2026-03-30 07:38:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 012064c5-1888-5fde-a123-f8c75b6b9c49 with scrape type 1
2026-03-30 07:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 012064c5-1888-5fde-a123-f8c75b6b9c49
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_7437a3aca6d670d66a16b8e893a3000d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_7437a3aca6d670d66a16b8e893a3000d.jpg not downloaded yet
2026-03-30 07:38:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d15690>
2026-03-30 07:38:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_eb9baa0857ce258f443d4acba4ed5b98.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_eb9baa0857ce258f443d4acba4ed5b98.jpg saved to cache
2026-03-30 07:38:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41c6abda-2131-5867-8744-0db2324fd61f
2026-03-30 07:38:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a802972-b017-5350-922f-c8c371b5192e with identifier: JB86449
2026-03-30 07:38:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a802972-b017-5350-922f-c8c371b5192e with identifier: JB86449
2026-03-30 07:38:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a802972-b017-5350-922f-c8c371b5192e with identifier: JB86449 to the API
2026-03-30 07:38:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:34:32Z',
 'fuel_type': 'diesel',
 'id': '6a802972-b017-5350-922f-c8c371b5192e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB86449',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 282912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-02',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB86449%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [auto1.de] INFO: Saving data for JB86449: {'auction_closing_time': 1774971272.0, 'created_time': 1773659879.595324, 'last_price_update_time': 1774856330.133597}
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB86449') HTTP/1.1" 204 0
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_f4cc5657b6229aa353faf8ac93a749be.png%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_f4cc5657b6229aa353faf8ac93a749be.png not downloaded yet
2026-03-30 07:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: WP35762
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: UZ06003
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: FU96820
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU96820%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [auto1.de] INFO: Scrape type for FU96820: 2
2026-03-30 07:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa6946bb-d59a-5168-9661-98fadc9586b8 with identifier: FU96820
2026-03-30 07:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6946bb-d59a-5168-9661-98fadc9586b8 with scrape type 2
2026-03-30 07:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa6946bb-d59a-5168-9661-98fadc9586b8 with scrape type 2
2026-03-30 07:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa6946bb-d59a-5168-9661-98fadc9586b8, identifier: FU96820
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_3b1e835bd671ec9726d6e67f29d97624.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_3b1e835bd671ec9726d6e67f29d97624.jpg not downloaded yet
2026-03-30 07:38:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa6946bb-d59a-5168-9661-98fadc9586b8 with identifier: FU96820
2026-03-30 07:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa6946bb-d59a-5168-9661-98fadc9586b8 with identifier: FU96820
2026-03-30 07:38:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa6946bb-d59a-5168-9661-98fadc9586b8 with identifier: FU96820 to the API
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-31T15:11:57Z',
 'fuel_type': 'diesel',
 'id': 'aa6946bb-d59a-5168-9661-98fadc9586b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU96820',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 262949,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'BMW X3 xDrive 35d Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2016}
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU96820%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [auto1.de] INFO: Saving data for FU96820: {'auction_closing_time': 1774969917.0, 'created_time': 1774294865.689283, 'last_price_update_time': 1774856330.738734}
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FU96820') HTTP/1.1" 204 0
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_d8056a054b9c6a209d0cc35847ea3562.png%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_d8056a054b9c6a209d0cc35847ea3562.png not downloaded yet
2026-03-30 07:38:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d51c50>
2026-03-30 07:38:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_261feee8fd716325eb3977a9da185006.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_261feee8fd716325eb3977a9da185006.jpg saved to cache
2026-03-30 07:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41c6abda-2131-5867-8744-0db2324fd61f
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: LZ51048
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: CS88634
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: VV53605
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: YS60575
2026-03-30 07:38:50 [auto1.de] INFO: Found listing with ID: HL59368
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL59368%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [auto1.de] INFO: Scrape type for HL59368: 2
2026-03-30 07:38:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 327f36bb-8a13-52f6-ac0d-25c7ee6c1e82 with identifier: HL59368
2026-03-30 07:38:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327f36bb-8a13-52f6-ac0d-25c7ee6c1e82 with scrape type 2
2026-03-30 07:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 327f36bb-8a13-52f6-ac0d-25c7ee6c1e82 with scrape type 2
2026-03-30 07:38:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 327f36bb-8a13-52f6-ac0d-25c7ee6c1e82, identifier: HL59368
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_e1090ae1e8e5249485234ac349c9ecf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_e1090ae1e8e5249485234ac349c9ecf7.jpg not downloaded yet
2026-03-30 07:38:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 327f36bb-8a13-52f6-ac0d-25c7ee6c1e82 with identifier: HL59368
2026-03-30 07:38:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 327f36bb-8a13-52f6-ac0d-25c7ee6c1e82 with identifier: HL59368
2026-03-30 07:38:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 327f36bb-8a13-52f6-ac0d-25c7ee6c1e82 with identifier: HL59368 to the API
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:39:48Z',
 'fuel_type': 'petrol',
 'id': '327f36bb-8a13-52f6-ac0d-25c7ee6c1e82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL59368',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 297484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-30',
 'seller_name': None,
 'title': 'BMW 5er 520i',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL59368%27 HTTP/1.1" 200 None
2026-03-30 07:38:51 [auto1.de] INFO: Saving data for HL59368: {'auction_closing_time': 1774971588.0, 'created_time': 1774263134.049966, 'last_price_update_time': 1774856331.86606}
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL59368') HTTP/1.1" 204 0
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_4964283d326dcc03d7a0c4503b266c99.png%27 HTTP/1.1" 200 None
2026-03-30 07:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_4964283d326dcc03d7a0c4503b266c99.png not downloaded yet
2026-03-30 07:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_89b10ad3ec6d66d14d3a414a75698a55.png> (referer: https://www.auto1.com/)
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: DG33425
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: GD75642
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: DB45885
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: SF11828
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF11828%27 HTTP/1.1" 200 None
2026-03-30 07:38:51 [auto1.de] INFO: Scrape type for SF11828: 1
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_490bb20783bad01710139c2516334d8a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_490bb20783bad01710139c2516334d8a.jpg not downloaded yet
2026-03-30 07:38:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_7437a3aca6d670d66a16b8e893a3000d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:51 [auto1.de] INFO: Found listing with ID: RY63211
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY63211%27 HTTP/1.1" 200 None
2026-03-30 07:38:51 [auto1.de] INFO: Scrape type for RY63211: 2
2026-03-30 07:38:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e22cd7a-2496-557e-97d3-b92dd17c242a with identifier: RY63211
2026-03-30 07:38:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e22cd7a-2496-557e-97d3-b92dd17c242a with scrape type 2
2026-03-30 07:38:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e22cd7a-2496-557e-97d3-b92dd17c242a with scrape type 2
2026-03-30 07:38:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e22cd7a-2496-557e-97d3-b92dd17c242a, identifier: RY63211
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_f5c573ee0c5d2625a8f48809a8879c46.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_f5c573ee0c5d2625a8f48809a8879c46.jpg not downloaded yet
2026-03-30 07:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PS73688> (referer: https://www.auto1.com/v1/car-details-view/PS73688/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TY20529/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e22cd7a-2496-557e-97d3-b92dd17c242a with identifier: RY63211
2026-03-30 07:38:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e22cd7a-2496-557e-97d3-b92dd17c242a with identifier: RY63211
2026-03-30 07:38:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e22cd7a-2496-557e-97d3-b92dd17c242a with identifier: RY63211 to the API
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:45:25Z',
 'fuel_type': 'diesel',
 'id': '0e22cd7a-2496-557e-97d3-b92dd17c242a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY63211',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 151260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-02',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2019}
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY63211%27 HTTP/1.1" 200 None
2026-03-30 07:38:52 [auto1.de] INFO: Saving data for RY63211: {'auction_closing_time': 1774971925.0, 'created_time': 1773400611.758476, 'last_price_update_time': 1774856332.956214}
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RY63211') HTTP/1.1" 204 0
2026-03-30 07:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_1917c7e3127b18eaed418e05e54406a8.png> (referer: https://www.auto1.com/)
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: RM00087
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM00087%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for RM00087: 2
2026-03-30 07:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc6425d4-ee90-541f-8afb-3ee9904749d5 with identifier: RM00087
2026-03-30 07:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc6425d4-ee90-541f-8afb-3ee9904749d5 with scrape type 2
2026-03-30 07:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc6425d4-ee90-541f-8afb-3ee9904749d5 with scrape type 2
2026-03-30 07:38:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc6425d4-ee90-541f-8afb-3ee9904749d5, identifier: RM00087
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_c7525f4e53382bf72cdff783c28d65e7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_c7525f4e53382bf72cdff783c28d65e7.jpg not downloaded yet
2026-03-30 07:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_e1090ae1e8e5249485234ac349c9ecf7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc6425d4-ee90-541f-8afb-3ee9904749d5 with identifier: RM00087
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-30 07:38:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:38:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc6425d4-ee90-541f-8afb-3ee9904749d5 with identifier: RM00087
2026-03-30 07:38:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc6425d4-ee90-541f-8afb-3ee9904749d5 with identifier: RM00087 to the API
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:36:09Z',
 'fuel_type': 'diesel',
 'id': 'fc6425d4-ee90-541f-8afb-3ee9904749d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM00087',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 222415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-28',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 dCi 360',
 'transmission': 'manual',
 'trim': '360',
 'year': 2015}
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM00087%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Saving data for RM00087: {'auction_closing_time': 1774971369.0, 'created_time': 1774262322.456631, 'last_price_update_time': 1774856333.694693}
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM00087') HTTP/1.1" 204 0
2026-03-30 07:38:53 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 07:38:53 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 07:38:53 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 07:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d210c590>
2026-03-30 07:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_1.png HTTP/1.1" 201 0
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_89b10ad3ec6d66d14d3a414a75698a55.png') HTTP/1.1" 204 0
2026-03-30 07:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_89b10ad3ec6d66d14d3a414a75698a55.png saved to cache
2026-03-30 07:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41c6abda-2131-5867-8744-0db2324fd61f
2026-03-30 07:38:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e36010>
2026-03-30 07:38:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_7437a3aca6d670d66a16b8e893a3000d.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_7437a3aca6d670d66a16b8e893a3000d.jpg saved to cache
2026-03-30 07:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 012064c5-1888-5fde-a123-f8c75b6b9c49
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: JE79553
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: LM55241
2026-03-30 07:38:53 [auto1.de] INFO: Found listing with ID: HH37402
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH37402%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [auto1.de] INFO: Scrape type for HH37402: 1
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_7d9bf05afec4ad9db93c42b746cb504c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_7d9bf05afec4ad9db93c42b746cb504c.jpg not downloaded yet
2026-03-30 07:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_930069de4b720ad7aab89f5037face05.png> (referer: https://www.auto1.com/)
2026-03-30 07:38:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_490bb20783bad01710139c2516334d8a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2316e213-4159-566f-82ee-5590063f05c8 with identifier: PS73688
2026-03-30 07:38:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2316e213-4159-566f-82ee-5590063f05c8 with scrape type 1
2026-03-30 07:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2316e213-4159-566f-82ee-5590063f05c8
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F1b%252Fb01bb1d605bf24c8a188038239736eab%252Fpa%252FPS73688_1434bdccec73f922eaf15b44a56c3e07.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_1434bdccec73f922eaf15b44a56c3e07.jpg already downloaded
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F1b%252Fb01bb1d605bf24c8a188038239736eab%252Fpa%252FPS73688_d71c57ea562b0687d09a8cb3a06c9ff7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_d71c57ea562b0687d09a8cb3a06c9ff7.jpg already downloaded
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F1b%252Fb01bb1d605bf24c8a188038239736eab%252Fpa%252FPS73688_61a69ceb8bdb25e161f6b5d45c31ddc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_61a69ceb8bdb25e161f6b5d45c31ddc2.jpg already downloaded
2026-03-30 07:38:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F1b%252Fb01bb1d605bf24c8a188038239736eab%252Fpa%252FPS73688_aed7100c170285fcf2d7fdcb65622df4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_aed7100c170285fcf2d7fdcb65622df4.jpg already downloaded
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F1b%252Fb01bb1d605bf24c8a188038239736eab%252Fpa%252FPS73688_8591fe95e3478aad7d6d93644cb22efc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_8591fe95e3478aad7d6d93644cb22efc.jpg already downloaded
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F1b%252Fb01bb1d605bf24c8a188038239736eab%252Fpa%252FPS73688_8192bbb9e323e914528381db57ad9f23.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_8192bbb9e323e914528381db57ad9f23.jpg already downloaded
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F1b%252Fb01bb1d605bf24c8a188038239736eab%252Fpa%252FPS73688_b08b24c1a4bda5052b8d6391bb907a89.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_b08b24c1a4bda5052b8d6391bb907a89.jpg already downloaded
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F1b%252Fb01bb1d605bf24c8a188038239736eab%252Fpa%252FPS73688_dee450c0eeff1056766d334c71fa31eb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_dee450c0eeff1056766d334c71fa31eb.jpg already downloaded
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F1b%252Fb01bb1d605bf24c8a188038239736eab%252Fpa%252FPS73688_7886b17f3c3ed8ade1fd18d4554e3eb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_7886b17f3c3ed8ade1fd18d4554e3eb6.jpg already downloaded
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb0%252F1b%252Fb01bb1d605bf24c8a188038239736eab%252Fpa%252FPS73688_dd5890bb3b979048dbe614be835d6d22.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_dd5890bb3b979048dbe614be835d6d22.jpg already downloaded
2026-03-30 07:38:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2316e213-4159-566f-82ee-5590063f05c8, identifier: PS73688
2026-03-30 07:38:54 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 07:38:54 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 07:38:54 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f67450>
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_3.png HTTP/1.1" 201 0
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_1917c7e3127b18eaed418e05e54406a8.png') HTTP/1.1" 204 0
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_1917c7e3127b18eaed418e05e54406a8.png saved to cache
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41c6abda-2131-5867-8744-0db2324fd61f
2026-03-30 07:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_73c6499e1b7f0ffa334a72cda338e005.png> (referer: https://www.auto1.com/)
2026-03-30 07:38:54 [auto1.de] INFO: Found listing with ID: GN88157
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN88157%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [auto1.de] INFO: Scrape type for GN88157: 1
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_83d8228a300261c8c0181c5138381559.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_83d8228a300261c8c0181c5138381559.jpg not downloaded yet
2026-03-30 07:38:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2316e213-4159-566f-82ee-5590063f05c8 with identifier: PS73688
2026-03-30 07:38:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2316e213-4159-566f-82ee-5590063f05c8 with identifier: PS73688
2026-03-30 07:38:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2316e213-4159-566f-82ee-5590063f05c8 with identifier: PS73688 to the API
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PS73688>
{'auction_title': '',
 'c_o_2_emission_value': 234,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.5L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:27:37Z',
 'fuel_type': 'petrol',
 'id': '2316e213-4159-566f-82ee-5590063f05c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS73688',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 109389,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_1434bdccec73f922eaf15b44a56c3e07.jpg',
                'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_d71c57ea562b0687d09a8cb3a06c9ff7.jpg',
                'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_61a69ceb8bdb25e161f6b5d45c31ddc2.jpg',
                'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_aed7100c170285fcf2d7fdcb65622df4.jpg',
                'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_8591fe95e3478aad7d6d93644cb22efc.jpg',
                'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_8192bbb9e323e914528381db57ad9f23.jpg',
                'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_b08b24c1a4bda5052b8d6391bb907a89.jpg',
                'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_dee450c0eeff1056766d334c71fa31eb.jpg',
                'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_7886b17f3c3ed8ade1fd18d4554e3eb6.jpg',
                'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_dd5890bb3b979048dbe614be835d6d22.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2316e213-4159-566f-82ee-5590063f05c8/2316e213-4159-566f-82ee-5590063f05c8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3202543,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_1434bdccec73f922eaf15b44a56c3e07.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2316e213-4159-566f-82ee-5590063f05c8/2316e213-4159-566f-82ee-5590063f05c8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3125340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_d71c57ea562b0687d09a8cb3a06c9ff7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2316e213-4159-566f-82ee-5590063f05c8/2316e213-4159-566f-82ee-5590063f05c8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2927009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_61a69ceb8bdb25e161f6b5d45c31ddc2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2316e213-4159-566f-82ee-5590063f05c8/2316e213-4159-566f-82ee-5590063f05c8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3077120,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_aed7100c170285fcf2d7fdcb65622df4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2316e213-4159-566f-82ee-5590063f05c8/2316e213-4159-566f-82ee-5590063f05c8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_8591fe95e3478aad7d6d93644cb22efc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2316e213-4159-566f-82ee-5590063f05c8/2316e213-4159-566f-82ee-5590063f05c8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71021,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_8192bbb9e323e914528381db57ad9f23.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2316e213-4159-566f-82ee-5590063f05c8/2316e213-4159-566f-82ee-5590063f05c8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2742966,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_b08b24c1a4bda5052b8d6391bb907a89.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2316e213-4159-566f-82ee-5590063f05c8/2316e213-4159-566f-82ee-5590063f05c8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3206255,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_dee450c0eeff1056766d334c71fa31eb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2316e213-4159-566f-82ee-5590063f05c8/2316e213-4159-566f-82ee-5590063f05c8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3193108,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_7886b17f3c3ed8ade1fd18d4554e3eb6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2316e213-4159-566f-82ee-5590063f05c8/2316e213-4159-566f-82ee-5590063f05c8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3120049,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgb0/1b/b01bb1d605bf24c8a188038239736eab/pa/PS73688_dd5890bb3b979048dbe614be835d6d22.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-07-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS73688%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [auto1.de] INFO: Saving data for PS73688: {'created_time': 1774856334.72331, 'last_price_update_time': 1774856334.723323, 'auction_closing_time': 1774970857.0}
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS73688') HTTP/1.1" 204 0
2026-03-30 07:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HK59987> (referer: https://www.auto1.com/v1/car-details-view/HK59987/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e43dd0>
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_e1090ae1e8e5249485234ac349c9ecf7.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_e1090ae1e8e5249485234ac349c9ecf7.jpg saved to cache
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 012064c5-1888-5fde-a123-f8c75b6b9c49
2026-03-30 07:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_f5c573ee0c5d2625a8f48809a8879c46.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_317147385c5e2e97d239b09c7eebee80.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_317147385c5e2e97d239b09c7eebee80.jpg not downloaded yet
2026-03-30 07:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT41914/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:54 [auto1.de] INFO: Channel: 24h | Page: 23 | totalHits: 7828 | hits on page: 40
2026-03-30 07:38:54 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 07:38:54 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 07:38:54 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24f9ad0>
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_5.png HTTP/1.1" 201 0
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_930069de4b720ad7aab89f5037face05.png') HTTP/1.1" 204 0
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_930069de4b720ad7aab89f5037face05.png saved to cache
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41c6abda-2131-5867-8744-0db2324fd61f
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e2c250>
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_490bb20783bad01710139c2516334d8a.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_490bb20783bad01710139c2516334d8a.jpg saved to cache
2026-03-30 07:38:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 012064c5-1888-5fde-a123-f8c75b6b9c49
2026-03-30 07:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_04d51bed6715061293ff008188dc5642.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ED11962> (referer: https://www.auto1.com/v1/car-details-view/ED11962/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:54 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 07:38:54 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 07:38:54 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2da2c50>
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_4.png HTTP/1.1" 201 0
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_73c6499e1b7f0ffa334a72cda338e005.png') HTTP/1.1" 204 0
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_73c6499e1b7f0ffa334a72cda338e005.png saved to cache
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41c6abda-2131-5867-8744-0db2324fd61f
2026-03-30 07:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_7d9bf05afec4ad9db93c42b746cb504c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_73c592f54b4f7f09f5edda9d617db779.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_73c592f54b4f7f09f5edda9d617db779.jpg not downloaded yet
2026-03-30 07:38:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: HL59368
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL59368%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for HL59368: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: DG33425
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: GD75642
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: DB45885
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: SF11828
2026-03-30 07:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_c7525f4e53382bf72cdff783c28d65e7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57d97b55-4ab9-5d4e-a52a-8b6217eacaed with identifier: HK59987
2026-03-30 07:38:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57d97b55-4ab9-5d4e-a52a-8b6217eacaed with scrape type 1
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57d97b55-4ab9-5d4e-a52a-8b6217eacaed
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffa%252F6dfae5d2100e26657c10693c6a8b1819%252Fpa%252FHK59987_30d2a98d8c8403c419864e0fae1fe30d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_30d2a98d8c8403c419864e0fae1fe30d.jpg already downloaded
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffa%252F6dfae5d2100e26657c10693c6a8b1819%252Fpa%252FHK59987_65937f281e46c5a6976a709ae49db192.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_65937f281e46c5a6976a709ae49db192.jpg already downloaded
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffa%252F6dfae5d2100e26657c10693c6a8b1819%252Fpa%252FHK59987_1ad46aa49fc789e107ccd4ffe324c995.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_1ad46aa49fc789e107ccd4ffe324c995.jpg already downloaded
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffa%252F6dfae5d2100e26657c10693c6a8b1819%252Fpa%252FHK59987_2be372308ebfc9804ec61502f82207de.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_2be372308ebfc9804ec61502f82207de.jpg already downloaded
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffa%252F6dfae5d2100e26657c10693c6a8b1819%252Fpa%252FHK59987_7b09db10dc801507ec53c8a166a4eacc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_7b09db10dc801507ec53c8a166a4eacc.jpg already downloaded
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffa%252F6dfae5d2100e26657c10693c6a8b1819%252Fpa%252FHK59987_7258a14399826d75ff6f98d2715cfbcf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_7258a14399826d75ff6f98d2715cfbcf.jpg already downloaded
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffa%252F6dfae5d2100e26657c10693c6a8b1819%252Fpa%252FHK59987_3b3605426e6d86d61dffc038f5ca9e1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_3b3605426e6d86d61dffc038f5ca9e1a.jpg already downloaded
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffa%252F6dfae5d2100e26657c10693c6a8b1819%252Fpa%252FHK59987_70389d37f8875d81b95af08d28e8af99.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_70389d37f8875d81b95af08d28e8af99.jpg already downloaded
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffa%252F6dfae5d2100e26657c10693c6a8b1819%252Fpa%252FHK59987_2e4d2486e515ba0874a0432cf19eec87.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_2e4d2486e515ba0874a0432cf19eec87.jpg already downloaded
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6d%252Ffa%252F6dfae5d2100e26657c10693c6a8b1819%252Fpa%252FHK59987_6d9b8f9c3fc2f35c2c0995222a786aad.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_6d9b8f9c3fc2f35c2c0995222a786aad.jpg already downloaded
2026-03-30 07:38:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57d97b55-4ab9-5d4e-a52a-8b6217eacaed, identifier: HK59987
2026-03-30 07:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2462150>
2026-03-30 07:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_f5c573ee0c5d2625a8f48809a8879c46.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_f5c573ee0c5d2625a8f48809a8879c46.jpg saved to cache
2026-03-30 07:38:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 012064c5-1888-5fde-a123-f8c75b6b9c49
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: RY63211
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY63211%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for RY63211: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: RM00087
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM00087%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Scrape type for RM00087: 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: JE79553
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: LM55241
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: HH37402
2026-03-30 07:38:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57d97b55-4ab9-5d4e-a52a-8b6217eacaed with identifier: HK59987
2026-03-30 07:38:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57d97b55-4ab9-5d4e-a52a-8b6217eacaed with identifier: HK59987
2026-03-30 07:38:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57d97b55-4ab9-5d4e-a52a-8b6217eacaed with identifier: HK59987 to the API
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HK59987>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 82,
 'expiration_date': '2026-03-31T15:16:07Z',
 'fuel_type': 'petrol',
 'id': '57d97b55-4ab9-5d4e-a52a-8b6217eacaed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK59987',
 'listing': 'auction',
 'location': 'DE, Ellerau',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 163414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_30d2a98d8c8403c419864e0fae1fe30d.jpg',
                'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_65937f281e46c5a6976a709ae49db192.jpg',
                'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_1ad46aa49fc789e107ccd4ffe324c995.jpg',
                'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_2be372308ebfc9804ec61502f82207de.jpg',
                'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_7b09db10dc801507ec53c8a166a4eacc.jpg',
                'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_7258a14399826d75ff6f98d2715cfbcf.jpg',
                'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_3b3605426e6d86d61dffc038f5ca9e1a.jpg',
                'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_70389d37f8875d81b95af08d28e8af99.jpg',
                'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_2e4d2486e515ba0874a0432cf19eec87.jpg',
                'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_6d9b8f9c3fc2f35c2c0995222a786aad.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57d97b55-4ab9-5d4e-a52a-8b6217eacaed/57d97b55-4ab9-5d4e-a52a-8b6217eacaed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89633,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_30d2a98d8c8403c419864e0fae1fe30d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57d97b55-4ab9-5d4e-a52a-8b6217eacaed/57d97b55-4ab9-5d4e-a52a-8b6217eacaed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79981,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_65937f281e46c5a6976a709ae49db192.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57d97b55-4ab9-5d4e-a52a-8b6217eacaed/57d97b55-4ab9-5d4e-a52a-8b6217eacaed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78197,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_1ad46aa49fc789e107ccd4ffe324c995.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57d97b55-4ab9-5d4e-a52a-8b6217eacaed/57d97b55-4ab9-5d4e-a52a-8b6217eacaed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_2be372308ebfc9804ec61502f82207de.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57d97b55-4ab9-5d4e-a52a-8b6217eacaed/57d97b55-4ab9-5d4e-a52a-8b6217eacaed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2780535,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_7b09db10dc801507ec53c8a166a4eacc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57d97b55-4ab9-5d4e-a52a-8b6217eacaed/57d97b55-4ab9-5d4e-a52a-8b6217eacaed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2572273,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_7258a14399826d75ff6f98d2715cfbcf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57d97b55-4ab9-5d4e-a52a-8b6217eacaed/57d97b55-4ab9-5d4e-a52a-8b6217eacaed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54586,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_3b3605426e6d86d61dffc038f5ca9e1a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57d97b55-4ab9-5d4e-a52a-8b6217eacaed/57d97b55-4ab9-5d4e-a52a-8b6217eacaed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_70389d37f8875d81b95af08d28e8af99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57d97b55-4ab9-5d4e-a52a-8b6217eacaed/57d97b55-4ab9-5d4e-a52a-8b6217eacaed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_2e4d2486e515ba0874a0432cf19eec87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57d97b55-4ab9-5d4e-a52a-8b6217eacaed/57d97b55-4ab9-5d4e-a52a-8b6217eacaed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2665651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6d/fa/6dfae5d2100e26657c10693c6a8b1819/pa/HK59987_6d9b8f9c3fc2f35c2c0995222a786aad.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK59987%27 HTTP/1.1" 200 None
2026-03-30 07:38:55 [auto1.de] INFO: Saving data for HK59987: {'created_time': 1774856335.842319, 'last_price_update_time': 1774856335.84233, 'auction_closing_time': 1774970167.0}
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK59987') HTTP/1.1" 204 0
2026-03-30 07:38:55 [auto1.de] INFO: Found listing with ID: GN88157
2026-03-30 07:38:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SF11828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:38:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24a5210>
2026-03-30 07:38:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252Fff%252F91ffa4577ea73feafda2883be0ce2e79%252Fpa%252FHT21123_04d51bed6715061293ff008188dc5642.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_04d51bed6715061293ff008188dc5642.jpg saved to cache
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c3225a1a-aea7-5af5-ae47-4421d244b32f
2026-03-30 07:38:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c3225a1a-aea7-5af5-ae47-4421d244b32f, skipping ID generation
2026-03-30 07:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3225a1a-aea7-5af5-ae47-4421d244b32f with scrape type 1
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c3225a1a-aea7-5af5-ae47-4421d244b32f sending to next pipeline
2026-03-30 07:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3225a1a-aea7-5af5-ae47-4421d244b32f, identifier: HT21123
2026-03-30 07:38:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0cf4e10-81ee-5992-bcac-6f7826c7cff5 with identifier: ED11962
2026-03-30 07:38:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0cf4e10-81ee-5992-bcac-6f7826c7cff5 with scrape type 1
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e0cf4e10-81ee-5992-bcac-6f7826c7cff5
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F68%252Ffd681cc0c902f6e86a88b1751d0065d5%252Fpa%252FED11962_e1dfcf4e2ad5ec26793c821429e6cf84.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_e1dfcf4e2ad5ec26793c821429e6cf84.jpg already downloaded
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F68%252Ffd681cc0c902f6e86a88b1751d0065d5%252Fpa%252FED11962_6d48e59c91058af87a9cbfe77f9c02dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_6d48e59c91058af87a9cbfe77f9c02dc.jpg already downloaded
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F68%252Ffd681cc0c902f6e86a88b1751d0065d5%252Fpa%252FED11962_88df984eaf9e0d94bf57cb2cd8fd40b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_88df984eaf9e0d94bf57cb2cd8fd40b4.jpg already downloaded
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F68%252Ffd681cc0c902f6e86a88b1751d0065d5%252Fpa%252FED11962_69ddc192814ecbb4298eaf959e760290.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_69ddc192814ecbb4298eaf959e760290.jpg already downloaded
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F68%252Ffd681cc0c902f6e86a88b1751d0065d5%252Fpa%252FED11962_b8598d534add3445a9941a9d2ee62963.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_b8598d534add3445a9941a9d2ee62963.jpg already downloaded
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F68%252Ffd681cc0c902f6e86a88b1751d0065d5%252Fpa%252FED11962_2719027586addddca8344117f6f8647c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_2719027586addddca8344117f6f8647c.jpg already downloaded
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F68%252Ffd681cc0c902f6e86a88b1751d0065d5%252Fpa%252FED11962_f9b2e031e5a4ea1ac9bb47035669d6fd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_f9b2e031e5a4ea1ac9bb47035669d6fd.jpg already downloaded
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F68%252Ffd681cc0c902f6e86a88b1751d0065d5%252Fpa%252FED11962_186d44b6af4beb396672b31385475613.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_186d44b6af4beb396672b31385475613.jpg already downloaded
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F68%252Ffd681cc0c902f6e86a88b1751d0065d5%252Fpa%252FED11962_dab797d818cab0cb75feeb05e1a9b857.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_dab797d818cab0cb75feeb05e1a9b857.jpg already downloaded
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfd%252F68%252Ffd681cc0c902f6e86a88b1751d0065d5%252Fpa%252FED11962_8c3982bd6aa3244353a5a1b0c7863c77.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_8c3982bd6aa3244353a5a1b0c7863c77.jpg already downloaded
2026-03-30 07:38:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0cf4e10-81ee-5992-bcac-6f7826c7cff5, identifier: ED11962
2026-03-30 07:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f93ad0>
2026-03-30 07:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_7d9bf05afec4ad9db93c42b746cb504c.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_7d9bf05afec4ad9db93c42b746cb504c.jpg saved to cache
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 012064c5-1888-5fde-a123-f8c75b6b9c49
2026-03-30 07:38:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22b12d0>
2026-03-30 07:38:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_c7525f4e53382bf72cdff783c28d65e7.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_c7525f4e53382bf72cdff783c28d65e7.jpg saved to cache
2026-03-30 07:38:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 012064c5-1888-5fde-a123-f8c75b6b9c49
2026-03-30 07:38:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_317147385c5e2e97d239b09c7eebee80.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3225a1a-aea7-5af5-ae47-4421d244b32f with identifier: HT21123
2026-03-30 07:38:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3225a1a-aea7-5af5-ae47-4421d244b32f with identifier: HT21123
2026-03-30 07:38:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3225a1a-aea7-5af5-ae47-4421d244b32f with identifier: HT21123 to the API
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_04d51bed6715061293ff008188dc5642.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 180,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.7L',
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:11:58Z',
 'fuel_type': 'petrol',
 'id': 'c3225a1a-aea7-5af5-ae47-4421d244b32f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT21123',
 'listing': 'auction',
 'location': 'DE, Esslingen am Neckar',
 'make': 'Porsche',
 'model': 'Boxster',
 'odometer': 71094,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77111,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_99717fa3a742e76af56aca91f7098b28.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71829,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_3b78de2a34f1b89f47dcf43f39307618.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66424,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_3a3366c3691e5078951383c9ec07bfec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_a52b7bd429d2fd2bf66f556251e393f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_100c69e758ee4e7ee94fa147d31f7b4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76564,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_81359fa06dcdbd3b91a94bf5567fe4e9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2984074,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_04d51bed6715061293ff008188dc5642.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_19c20be39835888bc7aedc8df4dd5364.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_cbd6ca9f447be1e89505124eac022368.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c3225a1a-aea7-5af5-ae47-4421d244b32f/c3225a1a-aea7-5af5-ae47-4421d244b32f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73456,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/ff/91ffa4577ea73feafda2883be0ce2e79/pa/HT21123_afd85d8ebb0e7233417ecb70d0ee7c70.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-04-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Porsche Boxster 2.7',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT21123%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Saving data for HT21123: {'created_time': 1774856337.061486, 'last_price_update_time': 1774856337.061496, 'auction_closing_time': 1774969918.0}
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT21123') HTTP/1.1" 204 0
2026-03-30 07:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0cf4e10-81ee-5992-bcac-6f7826c7cff5 with identifier: ED11962
2026-03-30 07:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0cf4e10-81ee-5992-bcac-6f7826c7cff5 with identifier: ED11962
2026-03-30 07:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0cf4e10-81ee-5992-bcac-6f7826c7cff5 with identifier: ED11962 to the API
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ED11962>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:05:53Z',
 'fuel_type': 'diesel',
 'id': 'e0cf4e10-81ee-5992-bcac-6f7826c7cff5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED11962',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 245715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_e1dfcf4e2ad5ec26793c821429e6cf84.jpg',
                'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_6d48e59c91058af87a9cbfe77f9c02dc.jpg',
                'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_88df984eaf9e0d94bf57cb2cd8fd40b4.jpg',
                'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_69ddc192814ecbb4298eaf959e760290.jpg',
                'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_b8598d534add3445a9941a9d2ee62963.jpg',
                'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_2719027586addddca8344117f6f8647c.jpg',
                'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_f9b2e031e5a4ea1ac9bb47035669d6fd.jpg',
                'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_186d44b6af4beb396672b31385475613.jpg',
                'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_dab797d818cab0cb75feeb05e1a9b857.jpg',
                'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_8c3982bd6aa3244353a5a1b0c7863c77.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cf4e10-81ee-5992-bcac-6f7826c7cff5/e0cf4e10-81ee-5992-bcac-6f7826c7cff5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_e1dfcf4e2ad5ec26793c821429e6cf84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cf4e10-81ee-5992-bcac-6f7826c7cff5/e0cf4e10-81ee-5992-bcac-6f7826c7cff5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2619589,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_6d48e59c91058af87a9cbfe77f9c02dc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cf4e10-81ee-5992-bcac-6f7826c7cff5/e0cf4e10-81ee-5992-bcac-6f7826c7cff5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2506483,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_88df984eaf9e0d94bf57cb2cd8fd40b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cf4e10-81ee-5992-bcac-6f7826c7cff5/e0cf4e10-81ee-5992-bcac-6f7826c7cff5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67199,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_69ddc192814ecbb4298eaf959e760290.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cf4e10-81ee-5992-bcac-6f7826c7cff5/e0cf4e10-81ee-5992-bcac-6f7826c7cff5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55833,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_b8598d534add3445a9941a9d2ee62963.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cf4e10-81ee-5992-bcac-6f7826c7cff5/e0cf4e10-81ee-5992-bcac-6f7826c7cff5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64404,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_2719027586addddca8344117f6f8647c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cf4e10-81ee-5992-bcac-6f7826c7cff5/e0cf4e10-81ee-5992-bcac-6f7826c7cff5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_f9b2e031e5a4ea1ac9bb47035669d6fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cf4e10-81ee-5992-bcac-6f7826c7cff5/e0cf4e10-81ee-5992-bcac-6f7826c7cff5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75175,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_186d44b6af4beb396672b31385475613.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cf4e10-81ee-5992-bcac-6f7826c7cff5/e0cf4e10-81ee-5992-bcac-6f7826c7cff5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2625477,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_dab797d818cab0cb75feeb05e1a9b857.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e0cf4e10-81ee-5992-bcac-6f7826c7cff5/e0cf4e10-81ee-5992-bcac-6f7826c7cff5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2711834,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgfd/68/fd681cc0c902f6e86a88b1751d0065d5/pa/ED11962_8c3982bd6aa3244353a5a1b0c7863c77.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-09-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Cup BlueMotion',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion',
 'year': 2014}
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED11962%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Saving data for ED11962: {'created_time': 1774856337.39723, 'last_price_update_time': 1774856337.397241, 'auction_closing_time': 1774969553.0}
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED11962') HTTP/1.1" 204 0
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: TN02521
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: DJ06926
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: HP46959
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: EP15828
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: CD29935
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: BX02893
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: TF97551
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: UW91893
2026-03-30 07:38:57 [auto1.de] INFO: Found listing with ID: RD82198
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD82198%27 HTTP/1.1" 200 None
2026-03-30 07:38:57 [auto1.de] INFO: Scrape type for RD82198: 2
2026-03-30 07:38:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df82dfcc-40c1-575c-a05e-ec69848247de with identifier: RD82198
2026-03-30 07:38:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df82dfcc-40c1-575c-a05e-ec69848247de with scrape type 2
2026-03-30 07:38:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df82dfcc-40c1-575c-a05e-ec69848247de with scrape type 2
2026-03-30 07:38:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df82dfcc-40c1-575c-a05e-ec69848247de, identifier: RD82198
2026-03-30 07:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_4964283d326dcc03d7a0c4503b266c99.png> (referer: https://www.auto1.com/)
2026-03-30 07:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_d8056a054b9c6a209d0cc35847ea3562.png> (referer: https://www.auto1.com/)
2026-03-30 07:38:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_3b1e835bd671ec9726d6e67f29d97624.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df82dfcc-40c1-575c-a05e-ec69848247de with identifier: RD82198
2026-03-30 07:38:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df82dfcc-40c1-575c-a05e-ec69848247de with identifier: RD82198
2026-03-30 07:38:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df82dfcc-40c1-575c-a05e-ec69848247de with identifier: RD82198 to the API
2026-03-30 07:38:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-31T15:32:30Z',
 'fuel_type': 'petrol',
 'id': 'df82dfcc-40c1-575c-a05e-ec69848247de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD82198',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 138911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-26',
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2009}
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD82198%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Saving data for RD82198: {'auction_closing_time': 1774971150.0, 'created_time': 1772545669.033148, 'last_price_update_time': 1774856338.432897}
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD82198') HTTP/1.1" 204 0
2026-03-30 07:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB23810> (referer: https://www.auto1.com/v1/car-details-view/HB23810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CS96512> (referer: https://www.auto1.com/v1/car-details-view/CS96512/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG93073/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: HH96934
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: YR25521
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: TF02726
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF02726%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for TF02726: 1
2026-03-30 07:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d223f310>
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_317147385c5e2e97d239b09c7eebee80.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_317147385c5e2e97d239b09c7eebee80.jpg saved to cache
2026-03-30 07:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 012064c5-1888-5fde-a123-f8c75b6b9c49
2026-03-30 07:38:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_73c592f54b4f7f09f5edda9d617db779.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: RE43747
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: HG84341
2026-03-30 07:38:58 [auto1.de] INFO: Found listing with ID: KJ12622
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ12622%27 HTTP/1.1" 200 None
2026-03-30 07:38:58 [auto1.de] INFO: Scrape type for KJ12622: 2
2026-03-30 07:38:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87214a21-80a7-576b-9096-a69d8de838f5 with identifier: KJ12622
2026-03-30 07:38:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87214a21-80a7-576b-9096-a69d8de838f5 with scrape type 2
2026-03-30 07:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87214a21-80a7-576b-9096-a69d8de838f5 with scrape type 2
2026-03-30 07:38:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87214a21-80a7-576b-9096-a69d8de838f5, identifier: KJ12622
2026-03-30 07:38:58 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 07:38:58 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 07:38:58 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2247f50>
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_8.png HTTP/1.1" 201 0
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_4964283d326dcc03d7a0c4503b266c99.png') HTTP/1.1" 204 0
2026-03-30 07:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_4964283d326dcc03d7a0c4503b266c99.png saved to cache
2026-03-30 07:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41c6abda-2131-5867-8744-0db2324fd61f
2026-03-30 07:38:58 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 07:38:58 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 07:38:58 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23e9c50>
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_7.png HTTP/1.1" 201 0
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_d8056a054b9c6a209d0cc35847ea3562.png') HTTP/1.1" 204 0
2026-03-30 07:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_d8056a054b9c6a209d0cc35847ea3562.png saved to cache
2026-03-30 07:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41c6abda-2131-5867-8744-0db2324fd61f
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23d5e90>
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:38:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_3b1e835bd671ec9726d6e67f29d97624.jpg') HTTP/1.1" 204 0
2026-03-30 07:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_3b1e835bd671ec9726d6e67f29d97624.jpg saved to cache
2026-03-30 07:38:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 012064c5-1888-5fde-a123-f8c75b6b9c49
2026-03-30 07:38:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87214a21-80a7-576b-9096-a69d8de838f5 with identifier: KJ12622
2026-03-30 07:38:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87214a21-80a7-576b-9096-a69d8de838f5 with identifier: KJ12622
2026-03-30 07:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87214a21-80a7-576b-9096-a69d8de838f5 with identifier: KJ12622 to the API
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:38:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:51:39Z',
 'fuel_type': 'petrol',
 'id': '87214a21-80a7-576b-9096-a69d8de838f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ12622',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 145725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-22',
 'seller_name': None,
 'title': 'Skoda Roomster 1.2 TSI Ambition Plus Edition',
 'transmission': 'manual',
 'trim': 'Ambition Plus Edition',
 'year': 2012}
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ12622%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [auto1.de] INFO: Saving data for KJ12622: {'auction_closing_time': 1774972299.0, 'created_time': 1774263249.278856, 'last_price_update_time': 1774856339.300432}
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KJ12622') HTTP/1.1" 204 0
2026-03-30 07:38:59 [auto1.de] INFO: Found listing with ID: MB78581
2026-03-30 07:38:59 [auto1.de] INFO: Found listing with ID: BP06971
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP06971%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [auto1.de] INFO: Scrape type for BP06971: 1
2026-03-30 07:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357 with identifier: HB23810
2026-03-30 07:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357 with scrape type 1
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Faf%252F5aafe79b23d9dddcd709ae02e614eed1%252Fpa%252FHB23810_4570f5932e66f343c83b8b0c47704951.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_4570f5932e66f343c83b8b0c47704951.jpg not downloaded yet
2026-03-30 07:38:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 686b9e98-0ef8-5b80-947d-0dd9307b870c with identifier: CS96512
2026-03-30 07:38:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 686b9e98-0ef8-5b80-947d-0dd9307b870c with scrape type 1
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 686b9e98-0ef8-5b80-947d-0dd9307b870c
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5a%252Fd35a651c8d4fd8cea46f05592429820e%252Fpa%252FCS96512_31c5c791aec30f7c389591939d2d6c7c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_31c5c791aec30f7c389591939d2d6c7c.jpg already downloaded
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5a%252Fd35a651c8d4fd8cea46f05592429820e%252Fpa%252FCS96512_45a94b6a6d5a25a9ee652d3a2665ca08.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_45a94b6a6d5a25a9ee652d3a2665ca08.jpg already downloaded
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5a%252Fd35a651c8d4fd8cea46f05592429820e%252Fpa%252FCS96512_f169ec92adf0746f019a80ad52b81dbd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_f169ec92adf0746f019a80ad52b81dbd.jpg already downloaded
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5a%252Fd35a651c8d4fd8cea46f05592429820e%252Fpa%252FCS96512_6473989c929094edece3851e7ed89dba.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_6473989c929094edece3851e7ed89dba.jpg already downloaded
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5a%252Fd35a651c8d4fd8cea46f05592429820e%252Fpa%252FCS96512_416c5f46ee0afcf115e125b7d7dcd13a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_416c5f46ee0afcf115e125b7d7dcd13a.jpg already downloaded
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5a%252Fd35a651c8d4fd8cea46f05592429820e%252Fpa%252FCS96512_c72efe82b941f7e49e77615f8dccb137.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_c72efe82b941f7e49e77615f8dccb137.jpg already downloaded
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5a%252Fd35a651c8d4fd8cea46f05592429820e%252Fpa%252FCS96512_c3bd0ea0725fd24e55d93697f562a213.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_c3bd0ea0725fd24e55d93697f562a213.jpg already downloaded
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5a%252Fd35a651c8d4fd8cea46f05592429820e%252Fpa%252FCS96512_6cdbc229b5bbb968296a0e1fa6d4766a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_6cdbc229b5bbb968296a0e1fa6d4766a.jpg already downloaded
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5a%252Fd35a651c8d4fd8cea46f05592429820e%252Fpa%252FCS96512_b741766d75697d8d163e18138d7e7fbf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_b741766d75697d8d163e18138d7e7fbf.jpg already downloaded
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252F5a%252Fd35a651c8d4fd8cea46f05592429820e%252Fpa%252FCS96512_5daa1dd9c931a7e22491e7f545a94074.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_5daa1dd9c931a7e22491e7f545a94074.jpg already downloaded
2026-03-30 07:38:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 686b9e98-0ef8-5b80-947d-0dd9307b870c, identifier: CS96512
2026-03-30 07:38:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 686b9e98-0ef8-5b80-947d-0dd9307b870c with identifier: CS96512
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-30 07:38:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:38:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 686b9e98-0ef8-5b80-947d-0dd9307b870c with identifier: CS96512
2026-03-30 07:38:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 686b9e98-0ef8-5b80-947d-0dd9307b870c with identifier: CS96512 to the API
2026-03-30 07:38:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CS96512>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-31T15:40:52Z',
 'fuel_type': 'gas',
 'id': '686b9e98-0ef8-5b80-947d-0dd9307b870c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS96512',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Fiat',
 'model': 'Doblo',
 'odometer': 174827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_31c5c791aec30f7c389591939d2d6c7c.jpg',
                'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_45a94b6a6d5a25a9ee652d3a2665ca08.jpg',
                'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_f169ec92adf0746f019a80ad52b81dbd.jpg',
                'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_6473989c929094edece3851e7ed89dba.jpg',
                'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_416c5f46ee0afcf115e125b7d7dcd13a.jpg',
                'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_c72efe82b941f7e49e77615f8dccb137.jpg',
                'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_c3bd0ea0725fd24e55d93697f562a213.jpg',
                'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_6cdbc229b5bbb968296a0e1fa6d4766a.jpg',
                'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_b741766d75697d8d163e18138d7e7fbf.jpg',
                'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_5daa1dd9c931a7e22491e7f545a94074.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686b9e98-0ef8-5b80-947d-0dd9307b870c/686b9e98-0ef8-5b80-947d-0dd9307b870c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85798,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_31c5c791aec30f7c389591939d2d6c7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686b9e98-0ef8-5b80-947d-0dd9307b870c/686b9e98-0ef8-5b80-947d-0dd9307b870c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_45a94b6a6d5a25a9ee652d3a2665ca08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686b9e98-0ef8-5b80-947d-0dd9307b870c/686b9e98-0ef8-5b80-947d-0dd9307b870c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_f169ec92adf0746f019a80ad52b81dbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686b9e98-0ef8-5b80-947d-0dd9307b870c/686b9e98-0ef8-5b80-947d-0dd9307b870c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_6473989c929094edece3851e7ed89dba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686b9e98-0ef8-5b80-947d-0dd9307b870c/686b9e98-0ef8-5b80-947d-0dd9307b870c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_416c5f46ee0afcf115e125b7d7dcd13a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686b9e98-0ef8-5b80-947d-0dd9307b870c/686b9e98-0ef8-5b80-947d-0dd9307b870c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_c72efe82b941f7e49e77615f8dccb137.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686b9e98-0ef8-5b80-947d-0dd9307b870c/686b9e98-0ef8-5b80-947d-0dd9307b870c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_c3bd0ea0725fd24e55d93697f562a213.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686b9e98-0ef8-5b80-947d-0dd9307b870c/686b9e98-0ef8-5b80-947d-0dd9307b870c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88955,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_6cdbc229b5bbb968296a0e1fa6d4766a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686b9e98-0ef8-5b80-947d-0dd9307b870c/686b9e98-0ef8-5b80-947d-0dd9307b870c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_b741766d75697d8d163e18138d7e7fbf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_686b9e98-0ef8-5b80-947d-0dd9307b870c/686b9e98-0ef8-5b80-947d-0dd9307b870c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/5a/d35a651c8d4fd8cea46f05592429820e/pa/CS96512_5daa1dd9c931a7e22491e7f545a94074.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-19',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Fiat Doblo 1.4 Turbo SX Maxi Kasten',
 'transmission': 'manual',
 'trim': 'SX Maxi Kasten',
 'year': 2015}
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS96512%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Saving data for CS96512: {'created_time': 1774856340.203641, 'last_price_update_time': 1774856340.203653, 'auction_closing_time': 1774971652.0}
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS96512') HTTP/1.1" 204 0
2026-03-30 07:39:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24b0990>
2026-03-30 07:39:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_73c592f54b4f7f09f5edda9d617db779.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_73c592f54b4f7f09f5edda9d617db779.jpg saved to cache
2026-03-30 07:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 012064c5-1888-5fde-a123-f8c75b6b9c49
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: ET95564
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET95564%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for ET95564: 2
2026-03-30 07:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9abad25-1329-52f3-9fd7-26cd16a8a54c with identifier: ET95564
2026-03-30 07:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9abad25-1329-52f3-9fd7-26cd16a8a54c with scrape type 2
2026-03-30 07:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9abad25-1329-52f3-9fd7-26cd16a8a54c with scrape type 2
2026-03-30 07:39:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9abad25-1329-52f3-9fd7-26cd16a8a54c, identifier: ET95564
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Faf%252F5aafe79b23d9dddcd709ae02e614eed1%252Fpa%252FHB23810_88bab78a8be6ddc90e8db6e8814e0968.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_88bab78a8be6ddc90e8db6e8814e0968.jpg not downloaded yet
2026-03-30 07:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN88157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TY20529> (referer: https://www.auto1.com/v1/car-details-view/TY20529/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9abad25-1329-52f3-9fd7-26cd16a8a54c with identifier: ET95564
2026-03-30 07:39:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9abad25-1329-52f3-9fd7-26cd16a8a54c with identifier: ET95564
2026-03-30 07:39:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9abad25-1329-52f3-9fd7-26cd16a8a54c with identifier: ET95564 to the API
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:28:56Z',
 'fuel_type': 'petrol',
 'id': 'e9abad25-1329-52f3-9fd7-26cd16a8a54c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ET95564',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 6542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-25',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET95564%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Saving data for ET95564: {'auction_closing_time': 1774970936.0, 'created_time': 1773380523.13239, 'last_price_update_time': 1774856340.861255}
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ET95564') HTTP/1.1" 204 0
2026-03-30 07:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UJ03238> (referer: https://www.auto1.com/v1/car-details-view/UJ03238/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_ccbe5fd6bbee9667d7f4aeda8130bd5c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:00 [auto1.de] INFO: Found listing with ID: TB48945
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB48945%27 HTTP/1.1" 200 None
2026-03-30 07:39:00 [auto1.de] INFO: Scrape type for TB48945: 2
2026-03-30 07:39:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: addeaa2d-a71a-5f34-b3f9-a76e0488a5af with identifier: TB48945
2026-03-30 07:39:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item addeaa2d-a71a-5f34-b3f9-a76e0488a5af with scrape type 2
2026-03-30 07:39:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item addeaa2d-a71a-5f34-b3f9-a76e0488a5af with scrape type 2
2026-03-30 07:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: addeaa2d-a71a-5f34-b3f9-a76e0488a5af, identifier: TB48945
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Faf%252F5aafe79b23d9dddcd709ae02e614eed1%252Fpa%252FHB23810_5cffdbaed661da61ef17ba7176a090fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_5cffdbaed661da61ef17ba7176a090fa.jpg not downloaded yet
2026-03-30 07:39:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: addeaa2d-a71a-5f34-b3f9-a76e0488a5af with identifier: TB48945
2026-03-30 07:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: addeaa2d-a71a-5f34-b3f9-a76e0488a5af with identifier: TB48945
2026-03-30 07:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: addeaa2d-a71a-5f34-b3f9-a76e0488a5af with identifier: TB48945 to the API
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:02:07Z',
 'fuel_type': 'diesel',
 'id': 'addeaa2d-a71a-5f34-b3f9-a76e0488a5af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB48945',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 212911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-17',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2016}
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB48945%27 HTTP/1.1" 200 None
2026-03-30 07:39:01 [auto1.de] INFO: Saving data for TB48945: {'auction_closing_time': 1774969327.0, 'created_time': 1774378291.741058, 'last_price_update_time': 1774856341.395429}
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB48945') HTTP/1.1" 204 0
2026-03-30 07:39:01 [auto1.de] INFO: Found listing with ID: KP65433
2026-03-30 07:39:01 [auto1.de] INFO: Found listing with ID: LG15498
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG15498%27 HTTP/1.1" 200 None
2026-03-30 07:39:01 [auto1.de] INFO: Scrape type for LG15498: 2
2026-03-30 07:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87abf7db-0270-5a4e-9a8f-cdda80cd3039 with identifier: LG15498
2026-03-30 07:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87abf7db-0270-5a4e-9a8f-cdda80cd3039 with scrape type 2
2026-03-30 07:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87abf7db-0270-5a4e-9a8f-cdda80cd3039 with scrape type 2
2026-03-30 07:39:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87abf7db-0270-5a4e-9a8f-cdda80cd3039, identifier: LG15498
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Faf%252F5aafe79b23d9dddcd709ae02e614eed1%252Fpa%252FHB23810_9f1e7734325a9547d3067cdea62cce9a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_9f1e7734325a9547d3067cdea62cce9a.jpg not downloaded yet
2026-03-30 07:39:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH37402/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87abf7db-0270-5a4e-9a8f-cdda80cd3039 with identifier: LG15498
2026-03-30 07:39:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87abf7db-0270-5a4e-9a8f-cdda80cd3039 with identifier: LG15498
2026-03-30 07:39:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87abf7db-0270-5a4e-9a8f-cdda80cd3039 with identifier: LG15498 to the API
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-31T15:19:22Z',
 'fuel_type': 'petrol',
 'id': '87abf7db-0270-5a4e-9a8f-cdda80cd3039',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG15498',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo X',
 'odometer': 5874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-03',
 'seller_name': None,
 'title': 'Toyota Aygo X 1.0 Pulse',
 'transmission': 'manual',
 'trim': 'Pulse',
 'year': 2024}
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG15498%27 HTTP/1.1" 200 None
2026-03-30 07:39:01 [auto1.de] INFO: Saving data for LG15498: {'auction_closing_time': 1774970362.0, 'created_time': 1774637262.450731, 'last_price_update_time': 1774856341.915133}
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG15498') HTTP/1.1" 204 0
2026-03-30 07:39:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4231f3a-7f12-5125-9e8c-f8714c8390f0 with identifier: TY20529
2026-03-30 07:39:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4231f3a-7f12-5125-9e8c-f8714c8390f0 with scrape type 1
2026-03-30 07:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4231f3a-7f12-5125-9e8c-f8714c8390f0
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F72%252F9d72c133a02e0730a3951b4501115b62%252Fpa%252FTY20529_0085544df86ea5b5dd56760560ecace6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_0085544df86ea5b5dd56760560ecace6.jpg already downloaded
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F72%252F9d72c133a02e0730a3951b4501115b62%252Fpa%252FTY20529_15cfbc244481b5bc268747d8151398a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_15cfbc244481b5bc268747d8151398a0.jpg already downloaded
2026-03-30 07:39:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F72%252F9d72c133a02e0730a3951b4501115b62%252Fpa%252FTY20529_d244cf54b22ddd665e344ea42c407d1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_d244cf54b22ddd665e344ea42c407d1f.jpg already downloaded
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F72%252F9d72c133a02e0730a3951b4501115b62%252Fpa%252FTY20529_cb765900602497dc545f09470221a194.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_cb765900602497dc545f09470221a194.jpg already downloaded
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F72%252F9d72c133a02e0730a3951b4501115b62%252Fpa%252FTY20529_11f7088289e76313a02a27c5ab496b4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_11f7088289e76313a02a27c5ab496b4c.jpg already downloaded
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F72%252F9d72c133a02e0730a3951b4501115b62%252Fpa%252FTY20529_d7e2aa7766a5b306fa7fd4843b184aec.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_d7e2aa7766a5b306fa7fd4843b184aec.jpg already downloaded
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F72%252F9d72c133a02e0730a3951b4501115b62%252Fpa%252FTY20529_26d7365cc51313f6fe122011f2565516.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_26d7365cc51313f6fe122011f2565516.jpg already downloaded
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F72%252F9d72c133a02e0730a3951b4501115b62%252Fpa%252FTY20529_3e51fafd0a244c09eba33165cf893474.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_3e51fafd0a244c09eba33165cf893474.jpg already downloaded
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F72%252F9d72c133a02e0730a3951b4501115b62%252Fpa%252FTY20529_ccfea3dac86914c9f0275c3172121bda.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_ccfea3dac86914c9f0275c3172121bda.jpg already downloaded
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg9d%252F72%252F9d72c133a02e0730a3951b4501115b62%252Fpa%252FTY20529_1324d8e9678e44adf65c48893165d411.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_1324d8e9678e44adf65c48893165d411.jpg already downloaded
2026-03-30 07:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4231f3a-7f12-5125-9e8c-f8714c8390f0, identifier: TY20529
2026-03-30 07:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 289c208e-e7fe-577a-b458-b9fd4614533b with identifier: UJ03238
2026-03-30 07:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 289c208e-e7fe-577a-b458-b9fd4614533b with scrape type 1
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 289c208e-e7fe-577a-b458-b9fd4614533b
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_ae8d3c868137d7069c21485d4c2e87cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_ae8d3c868137d7069c21485d4c2e87cf.jpg not downloaded yet
2026-03-30 07:39:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:39:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d245b090>
2026-03-30 07:39:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf0%252Fb3%252Ff0b392359ccc2ffeb6f7cd4e750dfe0a%252Fpa%252FTJ43394_ccbe5fd6bbee9667d7f4aeda8130bd5c.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_ccbe5fd6bbee9667d7f4aeda8130bd5c.jpg saved to cache
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94323638-e75a-5610-9408-d796c485f7cc
2026-03-30 07:39:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94323638-e75a-5610-9408-d796c485f7cc, skipping ID generation
2026-03-30 07:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94323638-e75a-5610-9408-d796c485f7cc with scrape type 1
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94323638-e75a-5610-9408-d796c485f7cc sending to next pipeline
2026-03-30 07:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94323638-e75a-5610-9408-d796c485f7cc, identifier: TJ43394
2026-03-30 07:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_f4cc5657b6229aa353faf8ac93a749be.png> (referer: https://www.auto1.com/)
2026-03-30 07:39:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_4570f5932e66f343c83b8b0c47704951.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: VG83409
2026-03-30 07:39:02 [auto1.de] INFO: Found listing with ID: PV53792
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV53792%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [auto1.de] INFO: Scrape type for PV53792: 2
2026-03-30 07:39:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 660fa5f4-9efc-5a0e-b291-813be1195a7c with identifier: PV53792
2026-03-30 07:39:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 660fa5f4-9efc-5a0e-b291-813be1195a7c with scrape type 2
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 660fa5f4-9efc-5a0e-b291-813be1195a7c with scrape type 2
2026-03-30 07:39:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 660fa5f4-9efc-5a0e-b291-813be1195a7c, identifier: PV53792
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Faf%252F5aafe79b23d9dddcd709ae02e614eed1%252Fpa%252FHB23810_6a94ab0255102576f8ae0c452b45af26.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_6a94ab0255102576f8ae0c452b45af26.jpg not downloaded yet
2026-03-30 07:39:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4231f3a-7f12-5125-9e8c-f8714c8390f0 with identifier: TY20529
2026-03-30 07:39:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4231f3a-7f12-5125-9e8c-f8714c8390f0 with identifier: TY20529
2026-03-30 07:39:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4231f3a-7f12-5125-9e8c-f8714c8390f0 with identifier: TY20529 to the API
2026-03-30 07:39:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TY20529>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 117,
 'expiration_date': '2026-03-31T15:07:32Z',
 'fuel_type': 'petrol',
 'id': 'e4231f3a-7f12-5125-9e8c-f8714c8390f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY20529',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 65786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_0085544df86ea5b5dd56760560ecace6.jpg',
                'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_15cfbc244481b5bc268747d8151398a0.jpg',
                'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_d244cf54b22ddd665e344ea42c407d1f.jpg',
                'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_cb765900602497dc545f09470221a194.jpg',
                'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_11f7088289e76313a02a27c5ab496b4c.jpg',
                'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_d7e2aa7766a5b306fa7fd4843b184aec.jpg',
                'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_26d7365cc51313f6fe122011f2565516.jpg',
                'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_3e51fafd0a244c09eba33165cf893474.jpg',
                'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_ccfea3dac86914c9f0275c3172121bda.jpg',
                'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_1324d8e9678e44adf65c48893165d411.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4231f3a-7f12-5125-9e8c-f8714c8390f0/e4231f3a-7f12-5125-9e8c-f8714c8390f0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96056,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_0085544df86ea5b5dd56760560ecace6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4231f3a-7f12-5125-9e8c-f8714c8390f0/e4231f3a-7f12-5125-9e8c-f8714c8390f0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96474,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_15cfbc244481b5bc268747d8151398a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4231f3a-7f12-5125-9e8c-f8714c8390f0/e4231f3a-7f12-5125-9e8c-f8714c8390f0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77956,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_d244cf54b22ddd665e344ea42c407d1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4231f3a-7f12-5125-9e8c-f8714c8390f0/e4231f3a-7f12-5125-9e8c-f8714c8390f0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71129,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_cb765900602497dc545f09470221a194.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4231f3a-7f12-5125-9e8c-f8714c8390f0/e4231f3a-7f12-5125-9e8c-f8714c8390f0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_11f7088289e76313a02a27c5ab496b4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4231f3a-7f12-5125-9e8c-f8714c8390f0/e4231f3a-7f12-5125-9e8c-f8714c8390f0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80311,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_d7e2aa7766a5b306fa7fd4843b184aec.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4231f3a-7f12-5125-9e8c-f8714c8390f0/e4231f3a-7f12-5125-9e8c-f8714c8390f0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_26d7365cc51313f6fe122011f2565516.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4231f3a-7f12-5125-9e8c-f8714c8390f0/e4231f3a-7f12-5125-9e8c-f8714c8390f0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_3e51fafd0a244c09eba33165cf893474.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4231f3a-7f12-5125-9e8c-f8714c8390f0/e4231f3a-7f12-5125-9e8c-f8714c8390f0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89160,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_ccfea3dac86914c9f0275c3172121bda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4231f3a-7f12-5125-9e8c-f8714c8390f0/e4231f3a-7f12-5125-9e8c-f8714c8390f0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img9d/72/9d72c133a02e0730a3951b4501115b62/pa/TY20529_1324d8e9678e44adf65c48893165d411.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Ministry of Sound',
 'transmission': 'manual',
 'trim': 'Ministry of Sound',
 'year': 2012}
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20529%27 HTTP/1.1" 200 None
2026-03-30 07:39:03 [auto1.de] INFO: Saving data for TY20529: {'created_time': 1774856343.129912, 'last_price_update_time': 1774856343.129923, 'auction_closing_time': 1774969652.0}
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY20529') HTTP/1.1" 204 0
2026-03-30 07:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94323638-e75a-5610-9408-d796c485f7cc with identifier: TJ43394
2026-03-30 07:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94323638-e75a-5610-9408-d796c485f7cc with identifier: TJ43394
2026-03-30 07:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94323638-e75a-5610-9408-d796c485f7cc with identifier: TJ43394 to the API
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_ccbe5fd6bbee9667d7f4aeda8130bd5c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:44:53Z',
 'fuel_type': 'petrol',
 'id': '94323638-e75a-5610-9408-d796c485f7cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ43394',
 'listing': 'auction',
 'location': 'DE, Seesen',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 111369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_42f6ba0f634c162b2b9ce5914de4701a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75467,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_2f211ff404607a700cf24aadd50e1d19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3096065,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_ccbe5fd6bbee9667d7f4aeda8130bd5c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_5c12b8b30f56ebf60f88d389c3bb6c26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_25b55ea07bc2f382b2b866252f0df1b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_7f398295fa257c5e01dbe4a721ff336b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61407,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_4df4270235d0a12a9c26050ca9734652.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65210,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_95c013db6fa4d5a139a4cb28b8354d7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_ed31665d6d0b1778d9a1acb8d9f82ce1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94323638-e75a-5610-9408-d796c485f7cc/94323638-e75a-5610-9408-d796c485f7cc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67664,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf0/b3/f0b392359ccc2ffeb6f7cd4e750dfe0a/pa/TJ43394_f0a121358f48b76ab7ce6d760b78d12c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-07-09',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2013}
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ43394%27 HTTP/1.1" 200 None
2026-03-30 07:39:03 [auto1.de] INFO: Saving data for TJ43394: {'created_time': 1774856343.581205, 'last_price_update_time': 1774856343.581218, 'auction_closing_time': 1774971893.0}
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TJ43394') HTTP/1.1" 204 0
2026-03-30 07:39:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_88bab78a8be6ddc90e8db6e8814e0968.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 660fa5f4-9efc-5a0e-b291-813be1195a7c with identifier: PV53792
2026-03-30 07:39:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 660fa5f4-9efc-5a0e-b291-813be1195a7c with identifier: PV53792
2026-03-30 07:39:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 660fa5f4-9efc-5a0e-b291-813be1195a7c with identifier: PV53792 to the API
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-31T15:42:19Z',
 'fuel_type': 'petrol',
 'id': '660fa5f4-9efc-5a0e-b291-813be1195a7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV53792',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 92819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-18',
 'seller_name': None,
 'title': 'Kia Rio 1.4 EX Top',
 'transmission': 'manual',
 'trim': 'EX Top',
 'year': 2007}
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV53792%27 HTTP/1.1" 200 None
2026-03-30 07:39:03 [auto1.de] INFO: Saving data for PV53792: {'auction_closing_time': 1774971739.0, 'created_time': 1774380859.554868, 'last_price_update_time': 1774856343.937663}
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV53792') HTTP/1.1" 204 0
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_f5fd06a764682b29c5cabe7e47963221.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_f5fd06a764682b29c5cabe7e47963221.jpg not downloaded yet
2026-03-30 07:39:03 [auto1.de] INFO: Found listing with ID: BN18490
2026-03-30 07:39:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN18490%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for BN18490: 2
2026-03-30 07:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3998843-1567-5da2-a965-b20fed4c543c with identifier: BN18490
2026-03-30 07:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3998843-1567-5da2-a965-b20fed4c543c with scrape type 2
2026-03-30 07:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3998843-1567-5da2-a965-b20fed4c543c with scrape type 2
2026-03-30 07:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3998843-1567-5da2-a965-b20fed4c543c, identifier: BN18490
2026-03-30 07:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK94658> (referer: https://www.auto1.com/v1/car-details-view/EK94658/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_5cffdbaed661da61ef17ba7176a090fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3998843-1567-5da2-a965-b20fed4c543c with identifier: BN18490
2026-03-30 07:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3998843-1567-5da2-a965-b20fed4c543c with identifier: BN18490
2026-03-30 07:39:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3998843-1567-5da2-a965-b20fed4c543c with identifier: BN18490 to the API
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:33:23Z',
 'fuel_type': 'diesel',
 'id': 'd3998843-1567-5da2-a965-b20fed4c543c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN18490',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 196965,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-11',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN18490%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Saving data for BN18490: {'auction_closing_time': 1774971203.0, 'created_time': 1774552726.566721, 'last_price_update_time': 1774856344.535438}
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN18490') HTTP/1.1" 204 0
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_1dd8bbf3f42f749f8545ffb53e64ca1a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_1dd8bbf3f42f749f8545ffb53e64ca1a.jpg not downloaded yet
2026-03-30 07:39:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT41914> (referer: https://www.auto1.com/v1/car-details-view/YT41914/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-03-30 07:39:04 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-03-30 07:39:04 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-03-30 07:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2203490>
2026-03-30 07:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_6.png HTTP/1.1" 201 0
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg56%252F83%252F56830fdbafd8188716298526da4477c1%252Fpa%252FCX99229_f4cc5657b6229aa353faf8ac93a749be.png') HTTP/1.1" 204 0
2026-03-30 07:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_f4cc5657b6229aa353faf8ac93a749be.png saved to cache
2026-03-30 07:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41c6abda-2131-5867-8744-0db2324fd61f
2026-03-30 07:39:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41c6abda-2131-5867-8744-0db2324fd61f, skipping ID generation
2026-03-30 07:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c6abda-2131-5867-8744-0db2324fd61f with scrape type 1
2026-03-30 07:39:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41c6abda-2131-5867-8744-0db2324fd61f sending to next pipeline
2026-03-30 07:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41c6abda-2131-5867-8744-0db2324fd61f, identifier: CX99229
2026-03-30 07:39:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d235a750>
2026-03-30 07:39:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357/2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Faf%252F5aafe79b23d9dddcd709ae02e614eed1%252Fpa%252FHB23810_4570f5932e66f343c83b8b0c47704951.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_4570f5932e66f343c83b8b0c47704951.jpg saved to cache
2026-03-30 07:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357
2026-03-30 07:39:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_9f1e7734325a9547d3067cdea62cce9a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: XD17470
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: FN61491
2026-03-30 07:39:04 [auto1.de] INFO: Found listing with ID: FK15614
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK15614%27 HTTP/1.1" 200 None
2026-03-30 07:39:04 [auto1.de] INFO: Scrape type for FK15614: 2
2026-03-30 07:39:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e229ea38-61b4-5f35-8b81-ac2d491c263a with identifier: FK15614
2026-03-30 07:39:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e229ea38-61b4-5f35-8b81-ac2d491c263a with scrape type 2
2026-03-30 07:39:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e229ea38-61b4-5f35-8b81-ac2d491c263a with scrape type 2
2026-03-30 07:39:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e229ea38-61b4-5f35-8b81-ac2d491c263a, identifier: FK15614
2026-03-30 07:39:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41c6abda-2131-5867-8744-0db2324fd61f with identifier: CX99229
2026-03-30 07:39:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41c6abda-2131-5867-8744-0db2324fd61f with identifier: CX99229
2026-03-30 07:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41c6abda-2131-5867-8744-0db2324fd61f with identifier: CX99229 to the API
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_f4cc5657b6229aa353faf8ac93a749be.png>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:00:44Z',
 'fuel_type': 'diesel',
 'id': '41c6abda-2131-5867-8744-0db2324fd61f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX99229',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 12378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26485,
             'Height': 258,
             'OriginUrl': 'https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_eb9baa0857ce258f443d4acba4ed5b98.jpg',
             'Width': 460},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_1.png',
             'Extension': 'png',
             'FileSizeInBytes': 576713,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_89b10ad3ec6d66d14d3a414a75698a55.png',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25822,
             'Height': 258,
             'OriginUrl': 'https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_261feee8fd716325eb3977a9da185006.jpg',
             'Width': 460},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_3.png',
             'Extension': 'png',
             'FileSizeInBytes': 613167,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_1917c7e3127b18eaed418e05e54406a8.png',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_4.png',
             'Extension': 'png',
             'FileSizeInBytes': 650039,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_73c6499e1b7f0ffa334a72cda338e005.png',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_5.png',
             'Extension': 'png',
             'FileSizeInBytes': 569711,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_930069de4b720ad7aab89f5037face05.png',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_6.png',
             'Extension': 'png',
             'FileSizeInBytes': 556202,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_f4cc5657b6229aa353faf8ac93a749be.png',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_7.png',
             'Extension': 'png',
             'FileSizeInBytes': 469353,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_d8056a054b9c6a209d0cc35847ea3562.png',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41c6abda-2131-5867-8744-0db2324fd61f/41c6abda-2131-5867-8744-0db2324fd61f_image_8.png',
             'Extension': 'png',
             'FileSizeInBytes': 469928,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/img56/83/56830fdbafd8188716298526da4477c1/pa/CX99229_4964283d326dcc03d7a0c4503b266c99.png',
             'Width': 688}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2023}
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX99229%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Saving data for CX99229: {'created_time': 1774856345.406234, 'last_price_update_time': 1774856345.406246, 'auction_closing_time': 1774969244.0}
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX99229') HTTP/1.1" 204 0
2026-03-30 07:39:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d234eb10>
2026-03-30 07:39:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357/2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Faf%252F5aafe79b23d9dddcd709ae02e614eed1%252Fpa%252FHB23810_88bab78a8be6ddc90e8db6e8814e0968.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_88bab78a8be6ddc90e8db6e8814e0968.jpg saved to cache
2026-03-30 07:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357
2026-03-30 07:39:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_ae8d3c868137d7069c21485d4c2e87cf.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e229ea38-61b4-5f35-8b81-ac2d491c263a with identifier: FK15614
2026-03-30 07:39:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e229ea38-61b4-5f35-8b81-ac2d491c263a with identifier: FK15614
2026-03-30 07:39:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e229ea38-61b4-5f35-8b81-ac2d491c263a with identifier: FK15614 to the API
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-31T15:43:48Z',
 'fuel_type': 'diesel',
 'id': 'e229ea38-61b4-5f35-8b81-ac2d491c263a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK15614',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker Express',
 'odometer': 137722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-02',
 'seller_name': None,
 'title': 'Dacia Dokker Express 1.5 dCi Diesel Ambiance',
 'transmission': 'manual',
 'trim': 'Ambiance',
 'year': 2015}
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK15614%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Saving data for FK15614: {'auction_closing_time': 1774971828.0, 'created_time': 1774639652.707708, 'last_price_update_time': 1774856345.911354}
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK15614') HTTP/1.1" 204 0
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_741de9fb38709df95055091076d2a066.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_741de9fb38709df95055091076d2a066.jpg not downloaded yet
2026-03-30 07:39:05 [auto1.de] INFO: Found listing with ID: BN13564
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN13564%27 HTTP/1.1" 200 None
2026-03-30 07:39:05 [auto1.de] INFO: Scrape type for BN13564: 2
2026-03-30 07:39:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ec43620-64f1-544f-b12c-a6ca31b887c2 with identifier: BN13564
2026-03-30 07:39:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ec43620-64f1-544f-b12c-a6ca31b887c2 with scrape type 2
2026-03-30 07:39:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ec43620-64f1-544f-b12c-a6ca31b887c2 with scrape type 2
2026-03-30 07:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ec43620-64f1-544f-b12c-a6ca31b887c2, identifier: BN13564
2026-03-30 07:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF02726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:06 [auto1.de] INFO: Channel: 24h | Page: 24 | totalHits: 7836 | hits on page: 40
2026-03-30 07:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d0272b4-c55c-55a6-90b3-40b814d3520f with identifier: EK94658
2026-03-30 07:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d0272b4-c55c-55a6-90b3-40b814d3520f with scrape type 1
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d0272b4-c55c-55a6-90b3-40b814d3520f
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F34%252F783471dc0e8f1baeb2709472ac5eee8f%252Fpa%252FEK94658_3070a0c9661735549202a46274a235f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_3070a0c9661735549202a46274a235f5.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F34%252F783471dc0e8f1baeb2709472ac5eee8f%252Fpa%252FEK94658_5a4a4ae590177def93b3a8392b48a363.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_5a4a4ae590177def93b3a8392b48a363.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F34%252F783471dc0e8f1baeb2709472ac5eee8f%252Fpa%252FEK94658_4337f1127ece054556fe2a95e6a45120.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_4337f1127ece054556fe2a95e6a45120.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F34%252F783471dc0e8f1baeb2709472ac5eee8f%252Fpa%252FEK94658_6fc531dc1a8388891759fed783c87d75.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_6fc531dc1a8388891759fed783c87d75.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F34%252F783471dc0e8f1baeb2709472ac5eee8f%252Fpa%252FEK94658_d07a7b73c17c01751e51f63b4e408983.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_d07a7b73c17c01751e51f63b4e408983.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F34%252F783471dc0e8f1baeb2709472ac5eee8f%252Fpa%252FEK94658_43c4e0beacd2243de7ba916acb34c32c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_43c4e0beacd2243de7ba916acb34c32c.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F34%252F783471dc0e8f1baeb2709472ac5eee8f%252Fpa%252FEK94658_950842ee22df38554c789ad34473752b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_950842ee22df38554c789ad34473752b.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F34%252F783471dc0e8f1baeb2709472ac5eee8f%252Fpa%252FEK94658_a9c4d975cab7fedbb49c9fa49e60539d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_a9c4d975cab7fedbb49c9fa49e60539d.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F34%252F783471dc0e8f1baeb2709472ac5eee8f%252Fpa%252FEK94658_d3abd3f3579226b9c42e2cff08bd4029.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_d3abd3f3579226b9c42e2cff08bd4029.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252F34%252F783471dc0e8f1baeb2709472ac5eee8f%252Fpa%252FEK94658_2fc0e23a56ac8fd4301904ebcc4afb31.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_2fc0e23a56ac8fd4301904ebcc4afb31.jpg already downloaded
2026-03-30 07:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d0272b4-c55c-55a6-90b3-40b814d3520f, identifier: EK94658
2026-03-30 07:39:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24dc150>
2026-03-30 07:39:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357/2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Faf%252F5aafe79b23d9dddcd709ae02e614eed1%252Fpa%252FHB23810_5cffdbaed661da61ef17ba7176a090fa.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_5cffdbaed661da61ef17ba7176a090fa.jpg saved to cache
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357
2026-03-30 07:39:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd9f8c03-9a35-5b08-b93c-b59f88d86451 with identifier: YT41914
2026-03-30 07:39:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd9f8c03-9a35-5b08-b93c-b59f88d86451 with scrape type 1
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item dd9f8c03-9a35-5b08-b93c-b59f88d86451
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Faf%252Fb9aff12cb520680c0b026c628d757357%252Fpa%252FYT41914_4aea2528a891a28386e4fda0c4d47f8e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_4aea2528a891a28386e4fda0c4d47f8e.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Faf%252Fb9aff12cb520680c0b026c628d757357%252Fpa%252FYT41914_c573cbb78ca094f603a3b56334ab374a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_c573cbb78ca094f603a3b56334ab374a.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Faf%252Fb9aff12cb520680c0b026c628d757357%252Fpa%252FYT41914_df8d1dd0e89e29cee8e6b13d5943d7a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_df8d1dd0e89e29cee8e6b13d5943d7a7.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Faf%252Fb9aff12cb520680c0b026c628d757357%252Fpa%252FYT41914_e0d1e249b7c0d0488f414960d17c8bda.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_e0d1e249b7c0d0488f414960d17c8bda.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Faf%252Fb9aff12cb520680c0b026c628d757357%252Fpa%252FYT41914_b0510efa997f63a055c6606962250978.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_b0510efa997f63a055c6606962250978.jpg already downloaded
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb9%252Faf%252Fb9aff12cb520680c0b026c628d757357%252Fpa%252FYT41914_b28c4e0a7870b1e6c525ee58b39072d7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_b28c4e0a7870b1e6c525ee58b39072d7.jpg already downloaded
2026-03-30 07:39:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd9f8c03-9a35-5b08-b93c-b59f88d86451, identifier: YT41914
2026-03-30 07:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_f5fd06a764682b29c5cabe7e47963221.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_6a94ab0255102576f8ae0c452b45af26.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:06 [scrapy.extensions.logstats] INFO: Crawled 156 pages (at 77 pages/min), scraped 351 items (at 72 items/min)
2026-03-30 07:39:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 187MiB
2026-03-30 07:39:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ec43620-64f1-544f-b12c-a6ca31b887c2 with identifier: BN13564
2026-03-30 07:39:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ec43620-64f1-544f-b12c-a6ca31b887c2 with identifier: BN13564
2026-03-30 07:39:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ec43620-64f1-544f-b12c-a6ca31b887c2 with identifier: BN13564 to the API
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:11:59Z',
 'fuel_type': 'diesel',
 'id': '1ec43620-64f1-544f-b12c-a6ca31b887c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN13564',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 154831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-24',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2020}
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN13564%27 HTTP/1.1" 200 None
2026-03-30 07:39:06 [auto1.de] INFO: Saving data for BN13564: {'auction_closing_time': 1774969919.0, 'created_time': 1773775565.46109, 'last_price_update_time': 1774856346.985419}
2026-03-30 07:39:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BN13564') HTTP/1.1" 204 0
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_8068d2a231ef4cafbdfdb6730cbdbd77.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_8068d2a231ef4cafbdfdb6730cbdbd77.jpg not downloaded yet
2026-03-30 07:39:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SF11828> (referer: https://www.auto1.com/v1/car-details-view/SF11828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d0272b4-c55c-55a6-90b3-40b814d3520f with identifier: EK94658
2026-03-30 07:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d0272b4-c55c-55a6-90b3-40b814d3520f with identifier: EK94658
2026-03-30 07:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d0272b4-c55c-55a6-90b3-40b814d3520f with identifier: EK94658 to the API
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK94658>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 179,
 'expiration_date': '2026-03-31T15:59:54Z',
 'fuel_type': 'petrol',
 'id': '2d0272b4-c55c-55a6-90b3-40b814d3520f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK94658',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 18327,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_3070a0c9661735549202a46274a235f5.jpg',
                'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_5a4a4ae590177def93b3a8392b48a363.jpg',
                'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_4337f1127ece054556fe2a95e6a45120.jpg',
                'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_6fc531dc1a8388891759fed783c87d75.jpg',
                'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_d07a7b73c17c01751e51f63b4e408983.jpg',
                'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_43c4e0beacd2243de7ba916acb34c32c.jpg',
                'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_950842ee22df38554c789ad34473752b.jpg',
                'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_a9c4d975cab7fedbb49c9fa49e60539d.jpg',
                'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_d3abd3f3579226b9c42e2cff08bd4029.jpg',
                'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_2fc0e23a56ac8fd4301904ebcc4afb31.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0272b4-c55c-55a6-90b3-40b814d3520f/2d0272b4-c55c-55a6-90b3-40b814d3520f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2879492,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_3070a0c9661735549202a46274a235f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0272b4-c55c-55a6-90b3-40b814d3520f/2d0272b4-c55c-55a6-90b3-40b814d3520f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85443,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_5a4a4ae590177def93b3a8392b48a363.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0272b4-c55c-55a6-90b3-40b814d3520f/2d0272b4-c55c-55a6-90b3-40b814d3520f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80018,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_4337f1127ece054556fe2a95e6a45120.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0272b4-c55c-55a6-90b3-40b814d3520f/2d0272b4-c55c-55a6-90b3-40b814d3520f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_6fc531dc1a8388891759fed783c87d75.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0272b4-c55c-55a6-90b3-40b814d3520f/2d0272b4-c55c-55a6-90b3-40b814d3520f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86944,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_d07a7b73c17c01751e51f63b4e408983.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0272b4-c55c-55a6-90b3-40b814d3520f/2d0272b4-c55c-55a6-90b3-40b814d3520f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80006,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_43c4e0beacd2243de7ba916acb34c32c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0272b4-c55c-55a6-90b3-40b814d3520f/2d0272b4-c55c-55a6-90b3-40b814d3520f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_950842ee22df38554c789ad34473752b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0272b4-c55c-55a6-90b3-40b814d3520f/2d0272b4-c55c-55a6-90b3-40b814d3520f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88053,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_a9c4d975cab7fedbb49c9fa49e60539d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0272b4-c55c-55a6-90b3-40b814d3520f/2d0272b4-c55c-55a6-90b3-40b814d3520f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88866,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_d3abd3f3579226b9c42e2cff08bd4029.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d0272b4-c55c-55a6-90b3-40b814d3520f/2d0272b4-c55c-55a6-90b3-40b814d3520f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82242,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/34/783471dc0e8f1baeb2709472ac5eee8f/pa/EK94658_2fc0e23a56ac8fd4301904ebcc4afb31.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-12-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid GT-Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT-Line 4WD',
 'year': 2023}
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK94658%27 HTTP/1.1" 200 None
2026-03-30 07:39:07 [auto1.de] INFO: Saving data for EK94658: {'created_time': 1774856347.37091, 'last_price_update_time': 1774856347.370922, 'auction_closing_time': 1774972794.0}
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK94658') HTTP/1.1" 204 0
2026-03-30 07:39:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd9f8c03-9a35-5b08-b93c-b59f88d86451 with identifier: YT41914
2026-03-30 07:39:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd9f8c03-9a35-5b08-b93c-b59f88d86451 with identifier: YT41914
2026-03-30 07:39:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd9f8c03-9a35-5b08-b93c-b59f88d86451 with identifier: YT41914 to the API
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YT41914>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:53:42Z',
 'fuel_type': 'diesel',
 'id': 'dd9f8c03-9a35-5b08-b93c-b59f88d86451',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT41914',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 323255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_4aea2528a891a28386e4fda0c4d47f8e.jpg',
                'https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_c573cbb78ca094f603a3b56334ab374a.jpg',
                'https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_df8d1dd0e89e29cee8e6b13d5943d7a7.jpg',
                'https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_e0d1e249b7c0d0488f414960d17c8bda.jpg',
                'https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_b0510efa997f63a055c6606962250978.jpg',
                'https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_b28c4e0a7870b1e6c525ee58b39072d7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9f8c03-9a35-5b08-b93c-b59f88d86451/dd9f8c03-9a35-5b08-b93c-b59f88d86451_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86562,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_4aea2528a891a28386e4fda0c4d47f8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9f8c03-9a35-5b08-b93c-b59f88d86451/dd9f8c03-9a35-5b08-b93c-b59f88d86451_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87511,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_c573cbb78ca094f603a3b56334ab374a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9f8c03-9a35-5b08-b93c-b59f88d86451/dd9f8c03-9a35-5b08-b93c-b59f88d86451_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82275,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_df8d1dd0e89e29cee8e6b13d5943d7a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9f8c03-9a35-5b08-b93c-b59f88d86451/dd9f8c03-9a35-5b08-b93c-b59f88d86451_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74925,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_e0d1e249b7c0d0488f414960d17c8bda.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9f8c03-9a35-5b08-b93c-b59f88d86451/dd9f8c03-9a35-5b08-b93c-b59f88d86451_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68986,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_b0510efa997f63a055c6606962250978.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd9f8c03-9a35-5b08-b93c-b59f88d86451/dd9f8c03-9a35-5b08-b93c-b59f88d86451_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51850,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb9/af/b9aff12cb520680c0b026c628d757357/pa/YT41914_b28c4e0a7870b1e6c525ee58b39072d7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2010}
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT41914%27 HTTP/1.1" 200 None
2026-03-30 07:39:07 [auto1.de] INFO: Saving data for YT41914: {'created_time': 1774856347.75153, 'last_price_update_time': 1774856347.751544, 'auction_closing_time': 1774972422.0}
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT41914') HTTP/1.1" 204 0
2026-03-30 07:39:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d230d1d0>
2026-03-30 07:39:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357/2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Faf%252F5aafe79b23d9dddcd709ae02e614eed1%252Fpa%252FHB23810_9f1e7734325a9547d3067cdea62cce9a.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_9f1e7734325a9547d3067cdea62cce9a.jpg saved to cache
2026-03-30 07:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: TC53143
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC53143%27 HTTP/1.1" 200 None
2026-03-30 07:39:07 [auto1.de] INFO: Scrape type for TC53143: 2
2026-03-30 07:39:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e218d151-2650-5b39-a3bc-81aa998ebba0 with identifier: TC53143
2026-03-30 07:39:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e218d151-2650-5b39-a3bc-81aa998ebba0 with scrape type 2
2026-03-30 07:39:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e218d151-2650-5b39-a3bc-81aa998ebba0 with scrape type 2
2026-03-30 07:39:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e218d151-2650-5b39-a3bc-81aa998ebba0, identifier: TC53143
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: VG83409
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: PV53792
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV53792%27 HTTP/1.1" 200 None
2026-03-30 07:39:07 [auto1.de] INFO: Scrape type for PV53792: 0
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: BN18490
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN18490%27 HTTP/1.1" 200 None
2026-03-30 07:39:07 [auto1.de] INFO: Scrape type for BN18490: 0
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: XD17470
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: FN61491
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: FK15614
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK15614%27 HTTP/1.1" 200 None
2026-03-30 07:39:07 [auto1.de] INFO: Scrape type for FK15614: 0
2026-03-30 07:39:07 [auto1.de] INFO: Found listing with ID: BN13564
2026-03-30 07:39:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN13564%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for BN13564: 0
2026-03-30 07:39:08 [auto1.de] INFO: Found listing with ID: TC53143
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC53143%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Scrape type for TC53143: 2
2026-03-30 07:39:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e218d151-2650-5b39-a3bc-81aa998ebba0 with scrape type 2
2026-03-30 07:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e218d151-2650-5b39-a3bc-81aa998ebba0 with scrape type 2
2026-03-30 07:39:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e218d151-2650-5b39-a3bc-81aa998ebba0, identifier: TC53143
2026-03-30 07:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG93073> (referer: https://www.auto1.com/v1/car-details-view/GG93073/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2116f50>
2026-03-30 07:39:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_ae8d3c868137d7069c21485d4c2e87cf.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_ae8d3c868137d7069c21485d4c2e87cf.jpg saved to cache
2026-03-30 07:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 289c208e-e7fe-577a-b458-b9fd4614533b
2026-03-30 07:39:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_1dd8bbf3f42f749f8545ffb53e64ca1a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e218d151-2650-5b39-a3bc-81aa998ebba0 with identifier: TC53143
2026-03-30 07:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e218d151-2650-5b39-a3bc-81aa998ebba0 with identifier: TC53143
2026-03-30 07:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e218d151-2650-5b39-a3bc-81aa998ebba0 with identifier: TC53143 to the API
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:35:12Z',
 'fuel_type': 'petrol',
 'id': 'e218d151-2650-5b39-a3bc-81aa998ebba0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC53143',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 115706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-25',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2010}
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC53143%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Saving data for TC53143: {'auction_closing_time': 1774971312.0, 'created_time': 1774378500.023819, 'last_price_update_time': 1774856348.668679}
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC53143') HTTP/1.1" 204 0
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_f50047ef032219912d21b2e9f7ad73c5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_f50047ef032219912d21b2e9f7ad73c5.jpg not downloaded yet
2026-03-30 07:39:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e218d151-2650-5b39-a3bc-81aa998ebba0 with identifier: TC53143
2026-03-30 07:39:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e218d151-2650-5b39-a3bc-81aa998ebba0 with identifier: TC53143
2026-03-30 07:39:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e218d151-2650-5b39-a3bc-81aa998ebba0 with identifier: TC53143 to the API
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:35:12Z',
 'fuel_type': 'petrol',
 'id': 'e218d151-2650-5b39-a3bc-81aa998ebba0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC53143',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 115706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-25',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2010}
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC53143%27 HTTP/1.1" 200 None
2026-03-30 07:39:08 [auto1.de] INFO: Saving data for TC53143: {'auction_closing_time': 1774971312.0, 'created_time': 1774378500.023819, 'last_price_update_time': 1774856348.982255}
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TC53143') HTTP/1.1" 204 0
2026-03-30 07:39:09 [auto1.de] INFO: Found listing with ID: DP33373
2026-03-30 07:39:09 [auto1.de] INFO: Found listing with ID: RS49275
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS49275%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [auto1.de] INFO: Scrape type for RS49275: 1
2026-03-30 07:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d84ead10>
2026-03-30 07:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_f5fd06a764682b29c5cabe7e47963221.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_f5fd06a764682b29c5cabe7e47963221.jpg saved to cache
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 289c208e-e7fe-577a-b458-b9fd4614533b
2026-03-30 07:39:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22f5d10>
2026-03-30 07:39:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357/2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg5a%252Faf%252F5aafe79b23d9dddcd709ae02e614eed1%252Fpa%252FHB23810_6a94ab0255102576f8ae0c452b45af26.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_6a94ab0255102576f8ae0c452b45af26.jpg saved to cache
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357
2026-03-30 07:39:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357, skipping ID generation
2026-03-30 07:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357 with scrape type 1
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357 sending to next pipeline
2026-03-30 07:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357, identifier: HB23810
2026-03-30 07:39:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f378cb45-8f30-53bc-a06d-c6db64125f5d with identifier: SF11828
2026-03-30 07:39:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f378cb45-8f30-53bc-a06d-c6db64125f5d with scrape type 1
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f378cb45-8f30-53bc-a06d-c6db64125f5d
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fecec05d9126cc452afb79766f5a0a52c%252Fpa%252FSF11828_44882ec9ab4203f1d7e3aa665dbd3c7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_44882ec9ab4203f1d7e3aa665dbd3c7e.jpg already downloaded
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fecec05d9126cc452afb79766f5a0a52c%252Fpa%252FSF11828_d2587cb753d9369417e575c2de96d514.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_d2587cb753d9369417e575c2de96d514.jpg already downloaded
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fecec05d9126cc452afb79766f5a0a52c%252Fpa%252FSF11828_db29ac088b4d4956a3900b90fbbed0c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_db29ac088b4d4956a3900b90fbbed0c9.jpg already downloaded
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fecec05d9126cc452afb79766f5a0a52c%252Fpa%252FSF11828_30734fd984d7d471285bcc00ebd6c561.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_30734fd984d7d471285bcc00ebd6c561.jpg already downloaded
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fecec05d9126cc452afb79766f5a0a52c%252Fpa%252FSF11828_9b01f67d6d7d9bc5c5d725c21406e325.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_9b01f67d6d7d9bc5c5d725c21406e325.jpg already downloaded
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fecec05d9126cc452afb79766f5a0a52c%252Fpa%252FSF11828_29d88f535dfa75e9e0ac6ecc5eb7df7e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_29d88f535dfa75e9e0ac6ecc5eb7df7e.jpg already downloaded
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fecec05d9126cc452afb79766f5a0a52c%252Fpa%252FSF11828_c005ae6ea0862c738c7db2193ba17545.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_c005ae6ea0862c738c7db2193ba17545.jpg already downloaded
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fecec05d9126cc452afb79766f5a0a52c%252Fpa%252FSF11828_b02cab4741cf024f18bc77e607f5487c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_b02cab4741cf024f18bc77e607f5487c.jpg already downloaded
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fecec05d9126cc452afb79766f5a0a52c%252Fpa%252FSF11828_5ef2bd76a63950aebb202ddd43d31bf7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_5ef2bd76a63950aebb202ddd43d31bf7.jpg already downloaded
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252Fec%252Fecec05d9126cc452afb79766f5a0a52c%252Fpa%252FSF11828_ebda1369d76cdb68aff6182fb1db3bac.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_ebda1369d76cdb68aff6182fb1db3bac.jpg already downloaded
2026-03-30 07:39:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f378cb45-8f30-53bc-a06d-c6db64125f5d, identifier: SF11828
2026-03-30 07:39:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_741de9fb38709df95055091076d2a066.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_d9068ee92a3c98ae44f7df6ca2ae5920.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_d9068ee92a3c98ae44f7df6ca2ae5920.jpg not downloaded yet
2026-03-30 07:39:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357 with identifier: HB23810
2026-03-30 07:39:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357 with identifier: HB23810
2026-03-30 07:39:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357 with identifier: HB23810 to the API
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_6a94ab0255102576f8ae0c452b45af26.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:10:13Z',
 'fuel_type': 'petrol',
 'id': '2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB23810',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 144020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357/2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_4570f5932e66f343c83b8b0c47704951.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357/2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67507,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_88bab78a8be6ddc90e8db6e8814e0968.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357/2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_5cffdbaed661da61ef17ba7176a090fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357/2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_9f1e7734325a9547d3067cdea62cce9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357/2ab03a41-0e63-5ec5-8ce4-d3b0b7b59357_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65422,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5a/af/5aafe79b23d9dddcd709ae02e614eed1/pa/HB23810_6a94ab0255102576f8ae0c452b45af26.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-09-28',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Sol',
 'transmission': 'manual',
 'trim': 'Sol',
 'year': 2006}
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB23810%27 HTTP/1.1" 200 None
2026-03-30 07:39:09 [auto1.de] INFO: Saving data for HB23810: {'created_time': 1774856349.923968, 'last_price_update_time': 1774856349.923984, 'auction_closing_time': 1774969813.0}
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB23810') HTTP/1.1" 204 0
2026-03-30 07:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f378cb45-8f30-53bc-a06d-c6db64125f5d with identifier: SF11828
2026-03-30 07:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f378cb45-8f30-53bc-a06d-c6db64125f5d with identifier: SF11828
2026-03-30 07:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f378cb45-8f30-53bc-a06d-c6db64125f5d with identifier: SF11828 to the API
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SF11828>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:41:14Z',
 'fuel_type': 'diesel',
 'id': 'f378cb45-8f30-53bc-a06d-c6db64125f5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SF11828',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'BMW',
 'model': '3er',
 'odometer': 90298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_44882ec9ab4203f1d7e3aa665dbd3c7e.jpg',
                'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_d2587cb753d9369417e575c2de96d514.jpg',
                'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_db29ac088b4d4956a3900b90fbbed0c9.jpg',
                'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_30734fd984d7d471285bcc00ebd6c561.jpg',
                'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_9b01f67d6d7d9bc5c5d725c21406e325.jpg',
                'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_29d88f535dfa75e9e0ac6ecc5eb7df7e.jpg',
                'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_c005ae6ea0862c738c7db2193ba17545.jpg',
                'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_b02cab4741cf024f18bc77e607f5487c.jpg',
                'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_5ef2bd76a63950aebb202ddd43d31bf7.jpg',
                'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_ebda1369d76cdb68aff6182fb1db3bac.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f378cb45-8f30-53bc-a06d-c6db64125f5d/f378cb45-8f30-53bc-a06d-c6db64125f5d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3019531,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_44882ec9ab4203f1d7e3aa665dbd3c7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f378cb45-8f30-53bc-a06d-c6db64125f5d/f378cb45-8f30-53bc-a06d-c6db64125f5d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2510767,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_d2587cb753d9369417e575c2de96d514.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f378cb45-8f30-53bc-a06d-c6db64125f5d/f378cb45-8f30-53bc-a06d-c6db64125f5d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2249655,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_db29ac088b4d4956a3900b90fbbed0c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f378cb45-8f30-53bc-a06d-c6db64125f5d/f378cb45-8f30-53bc-a06d-c6db64125f5d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_30734fd984d7d471285bcc00ebd6c561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f378cb45-8f30-53bc-a06d-c6db64125f5d/f378cb45-8f30-53bc-a06d-c6db64125f5d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_9b01f67d6d7d9bc5c5d725c21406e325.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f378cb45-8f30-53bc-a06d-c6db64125f5d/f378cb45-8f30-53bc-a06d-c6db64125f5d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2186469,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_29d88f535dfa75e9e0ac6ecc5eb7df7e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f378cb45-8f30-53bc-a06d-c6db64125f5d/f378cb45-8f30-53bc-a06d-c6db64125f5d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1939860,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_c005ae6ea0862c738c7db2193ba17545.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f378cb45-8f30-53bc-a06d-c6db64125f5d/f378cb45-8f30-53bc-a06d-c6db64125f5d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_b02cab4741cf024f18bc77e607f5487c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f378cb45-8f30-53bc-a06d-c6db64125f5d/f378cb45-8f30-53bc-a06d-c6db64125f5d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92590,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_5ef2bd76a63950aebb202ddd43d31bf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f378cb45-8f30-53bc-a06d-c6db64125f5d/f378cb45-8f30-53bc-a06d-c6db64125f5d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2380690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/ec/ecec05d9126cc452afb79766f5a0a52c/pa/SF11828_ebda1369d76cdb68aff6182fb1db3bac.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-06-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 320d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF11828%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Saving data for SF11828: {'created_time': 1774856350.415512, 'last_price_update_time': 1774856350.415524, 'auction_closing_time': 1774971674.0}
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SF11828') HTTP/1.1" 204 0
2026-03-30 07:39:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: NT12498
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: AF38150
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: HU95530
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: DR13547
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: EW76258
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: AV87266
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV87266%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Scrape type for AV87266: 2
2026-03-30 07:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a51209ad-4666-5c70-8f63-74928f36d99e with identifier: AV87266
2026-03-30 07:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a51209ad-4666-5c70-8f63-74928f36d99e with scrape type 2
2026-03-30 07:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a51209ad-4666-5c70-8f63-74928f36d99e with scrape type 2
2026-03-30 07:39:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a51209ad-4666-5c70-8f63-74928f36d99e, identifier: AV87266
2026-03-30 07:39:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc9ec621-6506-5aae-9037-bc7cb6a4f2d5 with identifier: GG93073
2026-03-30 07:39:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5 with scrape type 1
2026-03-30 07:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_286f5f4bbdf943b771ca9684e3e3cac5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_286f5f4bbdf943b771ca9684e3e3cac5.jpg not downloaded yet
2026-03-30 07:39:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2388f10>
2026-03-30 07:39:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_1dd8bbf3f42f749f8545ffb53e64ca1a.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_1dd8bbf3f42f749f8545ffb53e64ca1a.jpg saved to cache
2026-03-30 07:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 289c208e-e7fe-577a-b458-b9fd4614533b
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_fb1150ed1c609c0b292f9a7afff3931c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_fb1150ed1c609c0b292f9a7afff3931c.jpg not downloaded yet
2026-03-30 07:39:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a51209ad-4666-5c70-8f63-74928f36d99e with identifier: AV87266
2026-03-30 07:39:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a51209ad-4666-5c70-8f63-74928f36d99e with identifier: AV87266
2026-03-30 07:39:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a51209ad-4666-5c70-8f63-74928f36d99e with identifier: AV87266 to the API
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:08:23Z',
 'fuel_type': 'diesel',
 'id': 'a51209ad-4666-5c70-8f63-74928f36d99e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV87266',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 196005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-28',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV87266%27 HTTP/1.1" 200 None
2026-03-30 07:39:10 [auto1.de] INFO: Saving data for AV87266: {'auction_closing_time': 1774969703.0, 'created_time': 1774293770.521019, 'last_price_update_time': 1774856350.966888}
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV87266') HTTP/1.1" 204 0
2026-03-30 07:39:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_8068d2a231ef4cafbdfdb6730cbdbd77.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:10 [auto1.de] INFO: Found listing with ID: PV47102
2026-03-30 07:39:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV47102%27 HTTP/1.1" 200 None
2026-03-30 07:39:11 [auto1.de] INFO: Scrape type for PV47102: 1
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_56b54346a7fc1000d2eb7fd96dcbb4f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_56b54346a7fc1000d2eb7fd96dcbb4f0.jpg not downloaded yet
2026-03-30 07:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BP06971/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5e5609650>
2026-03-30 07:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_741de9fb38709df95055091076d2a066.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_741de9fb38709df95055091076d2a066.jpg saved to cache
2026-03-30 07:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 289c208e-e7fe-577a-b458-b9fd4614533b
2026-03-30 07:39:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_f50047ef032219912d21b2e9f7ad73c5.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_1d0909d2e2f79d51a135b388e78cf4fa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_1d0909d2e2f79d51a135b388e78cf4fa.jpg not downloaded yet
2026-03-30 07:39:11 [auto1.de] INFO: Found listing with ID: AU31378
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU31378%27 HTTP/1.1" 200 None
2026-03-30 07:39:11 [auto1.de] INFO: Scrape type for AU31378: 1
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_2802ea5f4e0908fe9e82e7bc8633b21f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_2802ea5f4e0908fe9e82e7bc8633b21f.jpg not downloaded yet
2026-03-30 07:39:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:11 [auto1.de] INFO: Found listing with ID: GZ16727
2026-03-30 07:39:11 [auto1.de] INFO: Found listing with ID: RW74261
2026-03-30 07:39:11 [auto1.de] INFO: Found listing with ID: UW81873
2026-03-30 07:39:11 [auto1.de] INFO: Found listing with ID: US20964
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US20964%27 HTTP/1.1" 200 None
2026-03-30 07:39:11 [auto1.de] INFO: Scrape type for US20964: 2
2026-03-30 07:39:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with identifier: US20964
2026-03-30 07:39:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with scrape type 2
2026-03-30 07:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with scrape type 2
2026-03-30 07:39:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11e2490e-4a6a-5d8f-b951-2c88e46ae07e, identifier: US20964
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_07936b7749f17a9162c07402bb3d46d1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_07936b7749f17a9162c07402bb3d46d1.jpg not downloaded yet
2026-03-30 07:39:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22ced50>
2026-03-30 07:39:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_8068d2a231ef4cafbdfdb6730cbdbd77.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_8068d2a231ef4cafbdfdb6730cbdbd77.jpg saved to cache
2026-03-30 07:39:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 289c208e-e7fe-577a-b458-b9fd4614533b
2026-03-30 07:39:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with identifier: US20964
2026-03-30 07:39:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with identifier: US20964
2026-03-30 07:39:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11e2490e-4a6a-5d8f-b951-2c88e46ae07e with identifier: US20964 to the API
2026-03-30 07:39:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:28:36Z',
 'fuel_type': 'petrol',
 'id': '11e2490e-4a6a-5d8f-b951-2c88e46ae07e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US20964',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 29143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-09-03',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake Mild-Hybrid AMG '
          'Line Edition',
 'transmission': 'automatic',
 'trim': 'AMG Line Edition',
 'year': 2023}
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US20964%27 HTTP/1.1" 200 None
2026-03-30 07:39:12 [auto1.de] INFO: Saving data for US20964: {'auction_closing_time': 1774970916.0, 'created_time': 1773306406.337176, 'last_price_update_time': 1774856352.577662}
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US20964') HTTP/1.1" 204 0
2026-03-30 07:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_286f5f4bbdf943b771ca9684e3e3cac5.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_fb1150ed1c609c0b292f9a7afff3931c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_d9068ee92a3c98ae44f7df6ca2ae5920.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:12 [auto1.de] INFO: Found listing with ID: YG60561
2026-03-30 07:39:12 [auto1.de] INFO: Found listing with ID: MU83144
2026-03-30 07:39:12 [auto1.de] INFO: Found listing with ID: DN83607
2026-03-30 07:39:12 [auto1.de] INFO: Found listing with ID: CH63331
2026-03-30 07:39:12 [auto1.de] INFO: Found listing with ID: AW55090
2026-03-30 07:39:12 [auto1.de] INFO: Found listing with ID: DF41364
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF41364%27 HTTP/1.1" 200 None
2026-03-30 07:39:12 [auto1.de] INFO: Scrape type for DF41364: 1
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_f152e36e4ccc72cef4a8ee35f601a2f0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_f152e36e4ccc72cef4a8ee35f601a2f0.jpg not downloaded yet
2026-03-30 07:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_83d8228a300261c8c0181c5138381559.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_56b54346a7fc1000d2eb7fd96dcbb4f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH37402> (referer: https://www.auto1.com/v1/car-details-view/HH37402/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2fac4d0>
2026-03-30 07:39:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_f50047ef032219912d21b2e9f7ad73c5.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_f50047ef032219912d21b2e9f7ad73c5.jpg saved to cache
2026-03-30 07:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 289c208e-e7fe-577a-b458-b9fd4614533b
2026-03-30 07:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_1d0909d2e2f79d51a135b388e78cf4fa.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:12 [auto1.de] INFO: Found listing with ID: KS24021
2026-03-30 07:39:12 [auto1.de] INFO: Found listing with ID: FG90508
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG90508%27 HTTP/1.1" 200 None
2026-03-30 07:39:12 [auto1.de] INFO: Scrape type for FG90508: 2
2026-03-30 07:39:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 397f67be-9875-55c2-a3b0-c252cae4dbf8 with identifier: FG90508
2026-03-30 07:39:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 397f67be-9875-55c2-a3b0-c252cae4dbf8 with scrape type 2
2026-03-30 07:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 397f67be-9875-55c2-a3b0-c252cae4dbf8 with scrape type 2
2026-03-30 07:39:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 397f67be-9875-55c2-a3b0-c252cae4dbf8, identifier: FG90508
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_bf29e7698b8ea476022c4701205a4afd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_bf29e7698b8ea476022c4701205a4afd.jpg not downloaded yet
2026-03-30 07:39:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN88157> (referer: https://www.auto1.com/v1/car-details-view/GN88157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 397f67be-9875-55c2-a3b0-c252cae4dbf8 with identifier: FG90508
2026-03-30 07:39:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 397f67be-9875-55c2-a3b0-c252cae4dbf8 with identifier: FG90508
2026-03-30 07:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 397f67be-9875-55c2-a3b0-c252cae4dbf8 with identifier: FG90508 to the API
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:52:37Z',
 'fuel_type': 'diesel',
 'id': '397f67be-9875-55c2-a3b0-c252cae4dbf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG90508',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 251297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Audi Q5 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG90508%27 HTTP/1.1" 200 None
2026-03-30 07:39:13 [auto1.de] INFO: Saving data for FG90508: {'auction_closing_time': 1774972357.0, 'created_time': 1774380017.421205, 'last_price_update_time': 1774856353.274632}
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG90508') HTTP/1.1" 204 0
2026-03-30 07:39:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:13 [auto1.de] INFO: Found listing with ID: HX93212
2026-03-30 07:39:13 [auto1.de] INFO: Found listing with ID: YM41627
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM41627%27 HTTP/1.1" 200 None
2026-03-30 07:39:13 [auto1.de] INFO: Scrape type for YM41627: 2
2026-03-30 07:39:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca49846c-b198-543c-af4a-ead7818681d5 with identifier: YM41627
2026-03-30 07:39:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca49846c-b198-543c-af4a-ead7818681d5 with scrape type 2
2026-03-30 07:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca49846c-b198-543c-af4a-ead7818681d5 with scrape type 2
2026-03-30 07:39:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca49846c-b198-543c-af4a-ead7818681d5, identifier: YM41627
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_520b43b9a0386255e33456a95d394d6a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_520b43b9a0386255e33456a95d394d6a.jpg not downloaded yet
2026-03-30 07:39:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca49846c-b198-543c-af4a-ead7818681d5 with identifier: YM41627
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=other HTTP/1.1" 200 None
2026-03-30 07:39:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:39:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca49846c-b198-543c-af4a-ead7818681d5 with identifier: YM41627
2026-03-30 07:39:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca49846c-b198-543c-af4a-ead7818681d5 with identifier: YM41627 to the API
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'other',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-31T15:58:46Z',
 'fuel_type': 'petrol',
 'id': 'ca49846c-b198-543c-af4a-ead7818681d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM41627',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 31970,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seller_name': None,
 'title': 'Cupra Leon 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2022}
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM41627%27 HTTP/1.1" 200 None
2026-03-30 07:39:13 [auto1.de] INFO: Saving data for YM41627: {'auction_closing_time': 1774972726.0, 'created_time': 1774379314.402889, 'last_price_update_time': 1774856353.95913}
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YM41627') HTTP/1.1" 204 0
2026-03-30 07:39:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d211c510>
2026-03-30 07:39:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_286f5f4bbdf943b771ca9684e3e3cac5.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_286f5f4bbdf943b771ca9684e3e3cac5.jpg saved to cache
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2126410>
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_fb1150ed1c609c0b292f9a7afff3931c.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_fb1150ed1c609c0b292f9a7afff3931c.jpg saved to cache
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 289c208e-e7fe-577a-b458-b9fd4614533b
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2fb8490>
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_d9068ee92a3c98ae44f7df6ca2ae5920.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_d9068ee92a3c98ae44f7df6ca2ae5920.jpg saved to cache
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 289c208e-e7fe-577a-b458-b9fd4614533b
2026-03-30 07:39:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2fbb950>
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg08%252Fac%252F08ac6ce4f141c205b5eb03c504cbe64c%252Fpa%252FZB59914_83d8228a300261c8c0181c5138381559.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_83d8228a300261c8c0181c5138381559.jpg saved to cache
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 012064c5-1888-5fde-a123-f8c75b6b9c49
2026-03-30 07:39:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 012064c5-1888-5fde-a123-f8c75b6b9c49, skipping ID generation
2026-03-30 07:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 012064c5-1888-5fde-a123-f8c75b6b9c49 with scrape type 1
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 012064c5-1888-5fde-a123-f8c75b6b9c49 sending to next pipeline
2026-03-30 07:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 012064c5-1888-5fde-a123-f8c75b6b9c49, identifier: ZB59914
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d55190>
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_56b54346a7fc1000d2eb7fd96dcbb4f0.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_56b54346a7fc1000d2eb7fd96dcbb4f0.jpg saved to cache
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5
2026-03-30 07:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 634b2fed-8eeb-5bd3-b784-d0905c1c9c09 with identifier: HH37402
2026-03-30 07:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 634b2fed-8eeb-5bd3-b784-d0905c1c9c09 with scrape type 1
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 634b2fed-8eeb-5bd3-b784-d0905c1c9c09
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d519a66e93d80960b34e373ab609443%252Fpa%252FHH37402_32373731a197176d6f96092ea936efc4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_32373731a197176d6f96092ea936efc4.jpg already downloaded
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d519a66e93d80960b34e373ab609443%252Fpa%252FHH37402_57f6e6de3e9c5ef3fdd5568d78a0ccbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_57f6e6de3e9c5ef3fdd5568d78a0ccbc.jpg already downloaded
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d519a66e93d80960b34e373ab609443%252Fpa%252FHH37402_0f48b834a443cf8d3f473f560eec88b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_0f48b834a443cf8d3f473f560eec88b1.jpg already downloaded
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d519a66e93d80960b34e373ab609443%252Fpa%252FHH37402_9cbe7d01901805e76167e77f727102bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_9cbe7d01901805e76167e77f727102bb.jpg already downloaded
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d519a66e93d80960b34e373ab609443%252Fpa%252FHH37402_91bdcd98e5455ccb0845a2ab36eb8f17.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_91bdcd98e5455ccb0845a2ab36eb8f17.jpg already downloaded
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d519a66e93d80960b34e373ab609443%252Fpa%252FHH37402_2c3bba3cd0cd8f8fce7e97c3edd132ed.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_2c3bba3cd0cd8f8fce7e97c3edd132ed.jpg already downloaded
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d519a66e93d80960b34e373ab609443%252Fpa%252FHH37402_52858497550ee0570273ad1997ad8492.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_52858497550ee0570273ad1997ad8492.jpg already downloaded
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d519a66e93d80960b34e373ab609443%252Fpa%252FHH37402_6db1dc5ff1b216f17e1a1ac1312f9b90.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_6db1dc5ff1b216f17e1a1ac1312f9b90.jpg already downloaded
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d519a66e93d80960b34e373ab609443%252Fpa%252FHH37402_33244c88b2dbe2f9eeb5c3a31587e122.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_33244c88b2dbe2f9eeb5c3a31587e122.jpg already downloaded
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3d%252F51%252F3d519a66e93d80960b34e373ab609443%252Fpa%252FHH37402_bf4fa3e13d1ee5bf522b43490835283c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_bf4fa3e13d1ee5bf522b43490835283c.jpg already downloaded
2026-03-30 07:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 634b2fed-8eeb-5bd3-b784-d0905c1c9c09, identifier: HH37402
2026-03-30 07:39:14 [auto1.de] INFO: Channel: 24h | Page: 25 | totalHits: 7849 | hits on page: 40
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d21241d0>
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgdc%252Fe3%252Fdce3e81855f5ce8abf94454013959f96%252Fpa%252FUJ03238_1d0909d2e2f79d51a135b388e78cf4fa.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_1d0909d2e2f79d51a135b388e78cf4fa.jpg saved to cache
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 289c208e-e7fe-577a-b458-b9fd4614533b
2026-03-30 07:39:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 289c208e-e7fe-577a-b458-b9fd4614533b, skipping ID generation
2026-03-30 07:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 289c208e-e7fe-577a-b458-b9fd4614533b with scrape type 1
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 289c208e-e7fe-577a-b458-b9fd4614533b sending to next pipeline
2026-03-30 07:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 289c208e-e7fe-577a-b458-b9fd4614533b, identifier: UJ03238
2026-03-30 07:39:14 [auto1.de] INFO: Found listing with ID: DW80278
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW80278%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [auto1.de] INFO: Scrape type for DW80278: 2
2026-03-30 07:39:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98e3a95e-da74-58a0-9359-6cb5c76031a2 with identifier: DW80278
2026-03-30 07:39:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98e3a95e-da74-58a0-9359-6cb5c76031a2 with scrape type 2
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98e3a95e-da74-58a0-9359-6cb5c76031a2 with scrape type 2
2026-03-30 07:39:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98e3a95e-da74-58a0-9359-6cb5c76031a2, identifier: DW80278
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_3c166f180cd06cbd6d8b185068671990.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_3c166f180cd06cbd6d8b185068671990.jpg not downloaded yet
2026-03-30 07:39:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 012064c5-1888-5fde-a123-f8c75b6b9c49 with identifier: ZB59914
2026-03-30 07:39:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 012064c5-1888-5fde-a123-f8c75b6b9c49 with identifier: ZB59914
2026-03-30 07:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 012064c5-1888-5fde-a123-f8c75b6b9c49 with identifier: ZB59914 to the API
2026-03-30 07:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_83d8228a300261c8c0181c5138381559.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 107,
 'expiration_date': '2026-03-31T15:41:13Z',
 'fuel_type': 'diesel',
 'id': '012064c5-1888-5fde-a123-f8c75b6b9c49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB59914',
 'listing': 'auction',
 'location': 'DE, Bruchsal',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 137100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_7437a3aca6d670d66a16b8e893a3000d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68492,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_3b1e835bd671ec9726d6e67f29d97624.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74769,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_e1090ae1e8e5249485234ac349c9ecf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_490bb20783bad01710139c2516334d8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69888,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_f5c573ee0c5d2625a8f48809a8879c46.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_c7525f4e53382bf72cdff783c28d65e7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62070,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_7d9bf05afec4ad9db93c42b746cb504c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2591705,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_83d8228a300261c8c0181c5138381559.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73689,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_317147385c5e2e97d239b09c7eebee80.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_012064c5-1888-5fde-a123-f8c75b6b9c49/012064c5-1888-5fde-a123-f8c75b6b9c49_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img08/ac/08ac6ce4f141c205b5eb03c504cbe64c/pa/ZB59914_73c592f54b4f7f09f5edda9d617db779.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Dacia Duster 1.5 dCi Prestige 4x2',
 'transmission': 'manual',
 'trim': 'Prestige 4x2',
 'year': 2013}
2026-03-30 07:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59914%27 HTTP/1.1" 200 None
2026-03-30 07:39:15 [auto1.de] INFO: Saving data for ZB59914: {'created_time': 1774856355.410958, 'last_price_update_time': 1774856355.410971, 'auction_closing_time': 1774971673.0}
2026-03-30 07:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB59914') HTTP/1.1" 204 0
2026-03-30 07:39:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 634b2fed-8eeb-5bd3-b784-d0905c1c9c09 with identifier: HH37402
2026-03-30 07:39:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 634b2fed-8eeb-5bd3-b784-d0905c1c9c09 with identifier: HH37402
2026-03-30 07:39:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 634b2fed-8eeb-5bd3-b784-d0905c1c9c09 with identifier: HH37402 to the API
2026-03-30 07:39:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HH37402>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:02:51Z',
 'fuel_type': 'diesel',
 'id': '634b2fed-8eeb-5bd3-b784-d0905c1c9c09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH37402',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 220366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_32373731a197176d6f96092ea936efc4.jpg',
                'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_57f6e6de3e9c5ef3fdd5568d78a0ccbc.jpg',
                'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_0f48b834a443cf8d3f473f560eec88b1.jpg',
                'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_9cbe7d01901805e76167e77f727102bb.jpg',
                'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_91bdcd98e5455ccb0845a2ab36eb8f17.jpg',
                'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_2c3bba3cd0cd8f8fce7e97c3edd132ed.jpg',
                'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_52858497550ee0570273ad1997ad8492.jpg',
                'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_6db1dc5ff1b216f17e1a1ac1312f9b90.jpg',
                'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_33244c88b2dbe2f9eeb5c3a31587e122.jpg',
                'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_bf4fa3e13d1ee5bf522b43490835283c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_634b2fed-8eeb-5bd3-b784-d0905c1c9c09/634b2fed-8eeb-5bd3-b784-d0905c1c9c09_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2860129,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_32373731a197176d6f96092ea936efc4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_634b2fed-8eeb-5bd3-b784-d0905c1c9c09/634b2fed-8eeb-5bd3-b784-d0905c1c9c09_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2647915,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_57f6e6de3e9c5ef3fdd5568d78a0ccbc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_634b2fed-8eeb-5bd3-b784-d0905c1c9c09/634b2fed-8eeb-5bd3-b784-d0905c1c9c09_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2632859,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_0f48b834a443cf8d3f473f560eec88b1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_634b2fed-8eeb-5bd3-b784-d0905c1c9c09/634b2fed-8eeb-5bd3-b784-d0905c1c9c09_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2551668,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_9cbe7d01901805e76167e77f727102bb.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_634b2fed-8eeb-5bd3-b784-d0905c1c9c09/634b2fed-8eeb-5bd3-b784-d0905c1c9c09_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2571783,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_91bdcd98e5455ccb0845a2ab36eb8f17.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_634b2fed-8eeb-5bd3-b784-d0905c1c9c09/634b2fed-8eeb-5bd3-b784-d0905c1c9c09_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2622527,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_2c3bba3cd0cd8f8fce7e97c3edd132ed.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_634b2fed-8eeb-5bd3-b784-d0905c1c9c09/634b2fed-8eeb-5bd3-b784-d0905c1c9c09_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2592700,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_52858497550ee0570273ad1997ad8492.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_634b2fed-8eeb-5bd3-b784-d0905c1c9c09/634b2fed-8eeb-5bd3-b784-d0905c1c9c09_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2687735,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_6db1dc5ff1b216f17e1a1ac1312f9b90.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_634b2fed-8eeb-5bd3-b784-d0905c1c9c09/634b2fed-8eeb-5bd3-b784-d0905c1c9c09_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2835156,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_33244c88b2dbe2f9eeb5c3a31587e122.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_634b2fed-8eeb-5bd3-b784-d0905c1c9c09/634b2fed-8eeb-5bd3-b784-d0905c1c9c09_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73121,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3d/51/3d519a66e93d80960b34e373ab609443/pa/HH37402_bf4fa3e13d1ee5bf522b43490835283c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-05-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2017}
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH37402%27 HTTP/1.1" 200 None
2026-03-30 07:39:16 [auto1.de] INFO: Saving data for HH37402: {'created_time': 1774856356.269772, 'last_price_update_time': 1774856356.269789, 'auction_closing_time': 1774969371.0}
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH37402') HTTP/1.1" 204 0
2026-03-30 07:39:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 289c208e-e7fe-577a-b458-b9fd4614533b with identifier: UJ03238
2026-03-30 07:39:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 289c208e-e7fe-577a-b458-b9fd4614533b with identifier: UJ03238
2026-03-30 07:39:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 289c208e-e7fe-577a-b458-b9fd4614533b with identifier: UJ03238 to the API
2026-03-30 07:39:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_1d0909d2e2f79d51a135b388e78cf4fa.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 220,
 'expiration_date': '2026-03-31T15:34:46Z',
 'fuel_type': 'diesel',
 'id': '289c208e-e7fe-577a-b458-b9fd4614533b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UJ03238',
 'listing': 'auction',
 'location': 'DE',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 14958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58714,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_ae8d3c868137d7069c21485d4c2e87cf.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56179,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_f5fd06a764682b29c5cabe7e47963221.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54650,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_1dd8bbf3f42f749f8545ffb53e64ca1a.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60478,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_741de9fb38709df95055091076d2a066.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69716,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_8068d2a231ef4cafbdfdb6730cbdbd77.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59308,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_f50047ef032219912d21b2e9f7ad73c5.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47042,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_d9068ee92a3c98ae44f7df6ca2ae5920.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39952,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_fb1150ed1c609c0b292f9a7afff3931c.jpg',
             'Width': 688},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_289c208e-e7fe-577a-b458-b9fd4614533b/289c208e-e7fe-577a-b458-b9fd4614533b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102705,
             'Height': 387,
             'OriginUrl': 'https://img-pa.auto1.com/imgdc/e3/dce3e81855f5ce8abf94454013959f96/pa/UJ03238_1d0909d2e2f79d51a135b388e78cf4fa.jpg',
             'Width': 688}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-01-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T',
 'transmission': 'automatic',
 'trim': 'T',
 'year': 2023}
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ03238%27 HTTP/1.1" 200 None
2026-03-30 07:39:17 [auto1.de] INFO: Saving data for UJ03238: {'created_time': 1774856357.692927, 'last_price_update_time': 1774856357.692941, 'auction_closing_time': 1774971286.0}
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UJ03238') HTTP/1.1" 204 0
2026-03-30 07:39:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5 with identifier: GN88157
2026-03-30 07:39:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5 with scrape type 1
2026-03-30 07:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F90%252Ffb902170ebcb4ad2631a33b055baa3e1%252Fpa%252FGN88157_e6b0930778ef286782c2aa5d95857568.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_e6b0930778ef286782c2aa5d95857568.jpg already downloaded
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F90%252Ffb902170ebcb4ad2631a33b055baa3e1%252Fpa%252FGN88157_4374e0564e34a872d4ae32a3b68c4703.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_4374e0564e34a872d4ae32a3b68c4703.jpg already downloaded
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F90%252Ffb902170ebcb4ad2631a33b055baa3e1%252Fpa%252FGN88157_c8c677c687587140f3954bf8c7ab55e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_c8c677c687587140f3954bf8c7ab55e1.jpg already downloaded
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F90%252Ffb902170ebcb4ad2631a33b055baa3e1%252Fpa%252FGN88157_7f9e247721ac0bbf24e0d73487fac108.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_7f9e247721ac0bbf24e0d73487fac108.jpg already downloaded
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgfb%252F90%252Ffb902170ebcb4ad2631a33b055baa3e1%252Fpa%252FGN88157_19fad171647c349a46595d20d4797d76.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_19fad171647c349a46595d20d4797d76.jpg already downloaded
2026-03-30 07:39:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5, identifier: GN88157
2026-03-30 07:39:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98e3a95e-da74-58a0-9359-6cb5c76031a2 with identifier: DW80278
2026-03-30 07:39:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98e3a95e-da74-58a0-9359-6cb5c76031a2 with identifier: DW80278
2026-03-30 07:39:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98e3a95e-da74-58a0-9359-6cb5c76031a2 with identifier: DW80278 to the API
2026-03-30 07:39:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:27:01Z',
 'fuel_type': 'diesel',
 'id': '98e3a95e-da74-58a0-9359-6cb5c76031a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW80278',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 283340,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-24',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2013}
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW80278%27 HTTP/1.1" 200 None
2026-03-30 07:39:18 [auto1.de] INFO: Saving data for DW80278: {'auction_closing_time': 1774970821.0, 'created_time': 1773302781.401142, 'last_price_update_time': 1774856358.76155}
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW80278') HTTP/1.1" 204 0
2026-03-30 07:39:18 [auto1.de] INFO: Found listing with ID: DF41364
2026-03-30 07:39:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV47102/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5 with identifier: GN88157
2026-03-30 07:39:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5 with identifier: GN88157
2026-03-30 07:39:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5 with identifier: GN88157 to the API
2026-03-30 07:39:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN88157>
{'auction_title': '',
 'c_o_2_emission_value': 176,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-31T15:22:15Z',
 'fuel_type': 'petrol',
 'id': '7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN88157',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 201331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_e6b0930778ef286782c2aa5d95857568.jpg',
                'https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_4374e0564e34a872d4ae32a3b68c4703.jpg',
                'https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_c8c677c687587140f3954bf8c7ab55e1.jpg',
                'https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_7f9e247721ac0bbf24e0d73487fac108.jpg',
                'https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_19fad171647c349a46595d20d4797d76.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5/7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 130883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_e6b0930778ef286782c2aa5d95857568.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5/7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_4374e0564e34a872d4ae32a3b68c4703.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5/7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76641,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_c8c677c687587140f3954bf8c7ab55e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5/7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_7f9e247721ac0bbf24e0d73487fac108.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5/7dfbdabe-4b72-5e6d-ac6e-ee291cac1af5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 126190,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgfb/90/fb902170ebcb4ad2631a33b055baa3e1/pa/GN88157_19fad171647c349a46595d20d4797d76.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN88157%27 HTTP/1.1" 200 None
2026-03-30 07:39:19 [auto1.de] INFO: Saving data for GN88157: {'created_time': 1774856359.847304, 'last_price_update_time': 1774856359.847319, 'auction_closing_time': 1774970535.0}
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN88157') HTTP/1.1" 204 0
2026-03-30 07:39:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_f152e36e4ccc72cef4a8ee35f601a2f0.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:19 [auto1.de] INFO: Found listing with ID: FH27884
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH27884%27 HTTP/1.1" 200 None
2026-03-30 07:39:19 [auto1.de] INFO: Scrape type for FH27884: 2
2026-03-30 07:39:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b65a56e-783c-5565-94d1-279cf69ebed1 with identifier: FH27884
2026-03-30 07:39:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b65a56e-783c-5565-94d1-279cf69ebed1 with scrape type 2
2026-03-30 07:39:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b65a56e-783c-5565-94d1-279cf69ebed1 with scrape type 2
2026-03-30 07:39:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b65a56e-783c-5565-94d1-279cf69ebed1, identifier: FH27884
2026-03-30 07:39:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_0fc35b1666070a1e9886670f1da3258f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_0fc35b1666070a1e9886670f1da3258f.jpg not downloaded yet
2026-03-30 07:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS49275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF02726> (referer: https://www.auto1.com/v1/car-details-view/TF02726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b65a56e-783c-5565-94d1-279cf69ebed1 with identifier: FH27884
2026-03-30 07:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b65a56e-783c-5565-94d1-279cf69ebed1 with identifier: FH27884
2026-03-30 07:39:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b65a56e-783c-5565-94d1-279cf69ebed1 with identifier: FH27884 to the API
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:44:25Z',
 'fuel_type': 'petrol',
 'id': '0b65a56e-783c-5565-94d1-279cf69ebed1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH27884',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 140401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-04',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2009}
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH27884%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Saving data for FH27884: {'auction_closing_time': 1774971865.0, 'created_time': 1773775416.179931, 'last_price_update_time': 1774856360.565262}
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH27884') HTTP/1.1" 204 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: KS24021
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: FG90508
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG90508%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for FG90508: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: HX93212
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: YM41627
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM41627%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for YM41627: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: DW80278
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW80278%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for DW80278: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: FH27884
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH27884%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for FH27884: 0
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: YE99980
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: NE04560
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: JT04540
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT04540%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for JT04540: 2
2026-03-30 07:39:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 891a3a33-832c-5d55-a880-d2c04f899ff7 with identifier: JT04540
2026-03-30 07:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891a3a33-832c-5d55-a880-d2c04f899ff7 with scrape type 2
2026-03-30 07:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 891a3a33-832c-5d55-a880-d2c04f899ff7 with scrape type 2
2026-03-30 07:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 891a3a33-832c-5d55-a880-d2c04f899ff7, identifier: JT04540
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: YE99980
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: NE04560
2026-03-30 07:39:20 [auto1.de] INFO: Found listing with ID: JT04540
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT04540%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [auto1.de] INFO: Scrape type for JT04540: 2
2026-03-30 07:39:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 891a3a33-832c-5d55-a880-d2c04f899ff7 with scrape type 2
2026-03-30 07:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 891a3a33-832c-5d55-a880-d2c04f899ff7 with scrape type 2
2026-03-30 07:39:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 891a3a33-832c-5d55-a880-d2c04f899ff7, identifier: JT04540
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_475d7df922815037328629445aad8c2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_475d7df922815037328629445aad8c2c.jpg not downloaded yet
2026-03-30 07:39:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 891a3a33-832c-5d55-a880-d2c04f899ff7 with identifier: JT04540
2026-03-30 07:39:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 891a3a33-832c-5d55-a880-d2c04f899ff7 with identifier: JT04540
2026-03-30 07:39:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 891a3a33-832c-5d55-a880-d2c04f899ff7 with identifier: JT04540 to the API
2026-03-30 07:39:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:49:41Z',
 'fuel_type': 'petrol',
 'id': '891a3a33-832c-5d55-a880-d2c04f899ff7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT04540',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 41841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-18',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT04540%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Saving data for JT04540: {'auction_closing_time': 1774972181.0, 'created_time': 1774118942.948096, 'last_price_update_time': 1774856362.036266}
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT04540') HTTP/1.1" 204 0
2026-03-30 07:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VW31483> (referer: https://www.auto1.com/v1/car-details-view/VW31483/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 891a3a33-832c-5d55-a880-d2c04f899ff7 with identifier: JT04540
2026-03-30 07:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 891a3a33-832c-5d55-a880-d2c04f899ff7 with identifier: JT04540
2026-03-30 07:39:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 891a3a33-832c-5d55-a880-d2c04f899ff7 with identifier: JT04540 to the API
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:49:41Z',
 'fuel_type': 'petrol',
 'id': '891a3a33-832c-5d55-a880-d2c04f899ff7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT04540',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 41841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-18',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT04540%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Saving data for JT04540: {'auction_closing_time': 1774972181.0, 'created_time': 1774118942.948096, 'last_price_update_time': 1774856362.66752}
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JT04540') HTTP/1.1" 204 0
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: AN60739
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60739%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for AN60739: 2
2026-03-30 07:39:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed4dff4f-660b-545e-85a7-3f6e917c6768 with identifier: AN60739
2026-03-30 07:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed4dff4f-660b-545e-85a7-3f6e917c6768 with scrape type 2
2026-03-30 07:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed4dff4f-660b-545e-85a7-3f6e917c6768 with scrape type 2
2026-03-30 07:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed4dff4f-660b-545e-85a7-3f6e917c6768, identifier: AN60739
2026-03-30 07:39:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f9e010>
2026-03-30 07:39:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_f152e36e4ccc72cef4a8ee35f601a2f0.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_f152e36e4ccc72cef4a8ee35f601a2f0.jpg saved to cache
2026-03-30 07:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5
2026-03-30 07:39:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_520b43b9a0386255e33456a95d394d6a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:22 [auto1.de] INFO: Found listing with ID: AN60739
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60739%27 HTTP/1.1" 200 None
2026-03-30 07:39:22 [auto1.de] INFO: Scrape type for AN60739: 2
2026-03-30 07:39:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed4dff4f-660b-545e-85a7-3f6e917c6768 with scrape type 2
2026-03-30 07:39:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed4dff4f-660b-545e-85a7-3f6e917c6768 with scrape type 2
2026-03-30 07:39:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed4dff4f-660b-545e-85a7-3f6e917c6768, identifier: AN60739
2026-03-30 07:39:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed4dff4f-660b-545e-85a7-3f6e917c6768 with identifier: AN60739
2026-03-30 07:39:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed4dff4f-660b-545e-85a7-3f6e917c6768 with identifier: AN60739
2026-03-30 07:39:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed4dff4f-660b-545e-85a7-3f6e917c6768 with identifier: AN60739 to the API
2026-03-30 07:39:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:07:04Z',
 'fuel_type': 'petrol',
 'id': 'ed4dff4f-660b-545e-85a7-3f6e917c6768',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN60739',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 110269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-07',
 'seller_name': None,
 'title': 'BMW 1er 125i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60739%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [auto1.de] INFO: Saving data for AN60739: {'auction_closing_time': 1774969624.0, 'created_time': 1772728531.746754, 'last_price_update_time': 1774856364.25296}
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN60739') HTTP/1.1" 204 0
2026-03-30 07:39:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15352ecf-410a-5b4a-b083-0a4579e33c5f with identifier: TF02726
2026-03-30 07:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15352ecf-410a-5b4a-b083-0a4579e33c5f with scrape type 1
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 15352ecf-410a-5b4a-b083-0a4579e33c5f
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F80%252Fa3808daa864a13deafe90193af25a314%252Fpa%252FTF02726_33f7ef1628541178da85a9655424aeaf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_33f7ef1628541178da85a9655424aeaf.jpg already downloaded
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F80%252Fa3808daa864a13deafe90193af25a314%252Fpa%252FTF02726_b25f5a2942da7ee2bab73a699d798352.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_b25f5a2942da7ee2bab73a699d798352.jpg already downloaded
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F80%252Fa3808daa864a13deafe90193af25a314%252Fpa%252FTF02726_33e7ffd41daf259445dea44f75b0ea46.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_33e7ffd41daf259445dea44f75b0ea46.jpg already downloaded
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F80%252Fa3808daa864a13deafe90193af25a314%252Fpa%252FTF02726_f19d0e5fe6a4832e5c9a650849262eeb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_f19d0e5fe6a4832e5c9a650849262eeb.jpg already downloaded
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F80%252Fa3808daa864a13deafe90193af25a314%252Fpa%252FTF02726_35e5932233720664b58c81bdfe11ccca.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_35e5932233720664b58c81bdfe11ccca.jpg already downloaded
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F80%252Fa3808daa864a13deafe90193af25a314%252Fpa%252FTF02726_26520946ff2492ca09a6932a3b40ca24.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_26520946ff2492ca09a6932a3b40ca24.jpg already downloaded
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F80%252Fa3808daa864a13deafe90193af25a314%252Fpa%252FTF02726_b0bf5933d39764599ea7f5c5d872bdf5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_b0bf5933d39764599ea7f5c5d872bdf5.jpg already downloaded
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F80%252Fa3808daa864a13deafe90193af25a314%252Fpa%252FTF02726_14f8f18b4d5f38ef67aaea4cc6b1324a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_14f8f18b4d5f38ef67aaea4cc6b1324a.jpg already downloaded
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F80%252Fa3808daa864a13deafe90193af25a314%252Fpa%252FTF02726_d889dc663de4bb3e41e2916569a7dd29.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_d889dc663de4bb3e41e2916569a7dd29.jpg already downloaded
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga3%252F80%252Fa3808daa864a13deafe90193af25a314%252Fpa%252FTF02726_92158167b3dc1e56ff17ce43ccbe0f9c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_92158167b3dc1e56ff17ce43ccbe0f9c.jpg already downloaded
2026-03-30 07:39:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15352ecf-410a-5b4a-b083-0a4579e33c5f, identifier: TF02726
2026-03-30 07:39:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed4dff4f-660b-545e-85a7-3f6e917c6768 with identifier: AN60739
2026-03-30 07:39:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed4dff4f-660b-545e-85a7-3f6e917c6768 with identifier: AN60739
2026-03-30 07:39:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed4dff4f-660b-545e-85a7-3f6e917c6768 with identifier: AN60739 to the API
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-31T15:07:04Z',
 'fuel_type': 'petrol',
 'id': 'ed4dff4f-660b-545e-85a7-3f6e917c6768',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN60739',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 110269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-07',
 'seller_name': None,
 'title': 'BMW 1er 125i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60739%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [auto1.de] INFO: Saving data for AN60739: {'auction_closing_time': 1774969624.0, 'created_time': 1772728531.746754, 'last_price_update_time': 1774856364.957656}
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN60739') HTTP/1.1" 204 0
2026-03-30 07:39:24 [auto1.de] INFO: Found listing with ID: BM26089
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM26089%27 HTTP/1.1" 200 None
2026-03-30 07:39:24 [auto1.de] INFO: Scrape type for BM26089: 2
2026-03-30 07:39:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cb32681-35b9-5575-9a0e-27e4ceee20ba with identifier: BM26089
2026-03-30 07:39:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cb32681-35b9-5575-9a0e-27e4ceee20ba with scrape type 2
2026-03-30 07:39:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cb32681-35b9-5575-9a0e-27e4ceee20ba with scrape type 2
2026-03-30 07:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cb32681-35b9-5575-9a0e-27e4ceee20ba, identifier: BM26089
2026-03-30 07:39:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BP06971> (referer: https://www.auto1.com/v1/car-details-view/BP06971/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15352ecf-410a-5b4a-b083-0a4579e33c5f with identifier: TF02726
2026-03-30 07:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15352ecf-410a-5b4a-b083-0a4579e33c5f with identifier: TF02726
2026-03-30 07:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15352ecf-410a-5b4a-b083-0a4579e33c5f with identifier: TF02726 to the API
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TF02726>
{'auction_title': '',
 'c_o_2_emission_value': 111,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 130,
 'expiration_date': '2026-03-31T15:57:16Z',
 'fuel_type': 'diesel',
 'id': '15352ecf-410a-5b4a-b083-0a4579e33c5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF02726',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 144804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_33f7ef1628541178da85a9655424aeaf.jpg',
                'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_b25f5a2942da7ee2bab73a699d798352.jpg',
                'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_33e7ffd41daf259445dea44f75b0ea46.jpg',
                'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_f19d0e5fe6a4832e5c9a650849262eeb.jpg',
                'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_35e5932233720664b58c81bdfe11ccca.jpg',
                'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_26520946ff2492ca09a6932a3b40ca24.jpg',
                'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_b0bf5933d39764599ea7f5c5d872bdf5.jpg',
                'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_14f8f18b4d5f38ef67aaea4cc6b1324a.jpg',
                'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_d889dc663de4bb3e41e2916569a7dd29.jpg',
                'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_92158167b3dc1e56ff17ce43ccbe0f9c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15352ecf-410a-5b4a-b083-0a4579e33c5f/15352ecf-410a-5b4a-b083-0a4579e33c5f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3231241,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_33f7ef1628541178da85a9655424aeaf.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15352ecf-410a-5b4a-b083-0a4579e33c5f/15352ecf-410a-5b4a-b083-0a4579e33c5f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2878625,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_b25f5a2942da7ee2bab73a699d798352.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15352ecf-410a-5b4a-b083-0a4579e33c5f/15352ecf-410a-5b4a-b083-0a4579e33c5f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2723363,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_33e7ffd41daf259445dea44f75b0ea46.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15352ecf-410a-5b4a-b083-0a4579e33c5f/15352ecf-410a-5b4a-b083-0a4579e33c5f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73878,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_f19d0e5fe6a4832e5c9a650849262eeb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15352ecf-410a-5b4a-b083-0a4579e33c5f/15352ecf-410a-5b4a-b083-0a4579e33c5f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2901321,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_35e5932233720664b58c81bdfe11ccca.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15352ecf-410a-5b4a-b083-0a4579e33c5f/15352ecf-410a-5b4a-b083-0a4579e33c5f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2753911,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_26520946ff2492ca09a6932a3b40ca24.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15352ecf-410a-5b4a-b083-0a4579e33c5f/15352ecf-410a-5b4a-b083-0a4579e33c5f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2600651,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_b0bf5933d39764599ea7f5c5d872bdf5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15352ecf-410a-5b4a-b083-0a4579e33c5f/15352ecf-410a-5b4a-b083-0a4579e33c5f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2677817,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_14f8f18b4d5f38ef67aaea4cc6b1324a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15352ecf-410a-5b4a-b083-0a4579e33c5f/15352ecf-410a-5b4a-b083-0a4579e33c5f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2981028,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_d889dc663de4bb3e41e2916569a7dd29.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_15352ecf-410a-5b4a-b083-0a4579e33c5f/15352ecf-410a-5b4a-b083-0a4579e33c5f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga3/80/a3808daa864a13deafe90193af25a314/pa/TF02726_92158167b3dc1e56ff17ce43ccbe0f9c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-04-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.5 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF02726%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Saving data for TF02726: {'created_time': 1774856365.43062, 'last_price_update_time': 1774856365.430632, 'auction_closing_time': 1774972636.0}
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF02726') HTTP/1.1" 204 0
2026-03-30 07:39:25 [auto1.de] INFO: Found listing with ID: BM26089
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM26089%27 HTTP/1.1" 200 None
2026-03-30 07:39:25 [auto1.de] INFO: Scrape type for BM26089: 2
2026-03-30 07:39:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cb32681-35b9-5575-9a0e-27e4ceee20ba with scrape type 2
2026-03-30 07:39:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cb32681-35b9-5575-9a0e-27e4ceee20ba with scrape type 2
2026-03-30 07:39:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cb32681-35b9-5575-9a0e-27e4ceee20ba, identifier: BM26089
2026-03-30 07:39:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cb32681-35b9-5575-9a0e-27e4ceee20ba with identifier: BM26089
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-30 07:39:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:39:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cb32681-35b9-5575-9a0e-27e4ceee20ba with identifier: BM26089
2026-03-30 07:39:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cb32681-35b9-5575-9a0e-27e4ceee20ba with identifier: BM26089 to the API
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:47:08Z',
 'fuel_type': 'electro',
 'id': '0cb32681-35b9-5575-9a0e-27e4ceee20ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM26089',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Enyaq',
 'odometer': 83939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-26',
 'seller_name': None,
 'title': 'Skoda Enyaq iV 80X Sportline',
 'transmission': 'automatic',
 'trim': 'Sportline',
 'year': 2023}
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM26089%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [auto1.de] INFO: Saving data for BM26089: {'auction_closing_time': 1774972028.0, 'created_time': 1774639143.950786, 'last_price_update_time': 1774856366.070023}
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM26089') HTTP/1.1" 204 0
2026-03-30 07:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DF41364/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 549d7081-0da5-5abb-a494-ec0bec015859 with identifier: VW31483
2026-03-30 07:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 549d7081-0da5-5abb-a494-ec0bec015859 with scrape type 1
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 549d7081-0da5-5abb-a494-ec0bec015859
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F9c%252F6c9c45a76f8c166ef745cda710d6102c%252Fpa%252FVW31483_9377779240b00acdbe5ef5078fb086ce.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_9377779240b00acdbe5ef5078fb086ce.jpg already downloaded
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F9c%252F6c9c45a76f8c166ef745cda710d6102c%252Fpa%252FVW31483_0caa171fd602770e529d3dffd9c991e0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_0caa171fd602770e529d3dffd9c991e0.jpg already downloaded
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F9c%252F6c9c45a76f8c166ef745cda710d6102c%252Fpa%252FVW31483_00b5d0758f65ddfd4844e8733113fbcd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_00b5d0758f65ddfd4844e8733113fbcd.jpg already downloaded
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F9c%252F6c9c45a76f8c166ef745cda710d6102c%252Fpa%252FVW31483_a8fa3aaf31a31875fb62424d4697729d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_a8fa3aaf31a31875fb62424d4697729d.jpg already downloaded
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F9c%252F6c9c45a76f8c166ef745cda710d6102c%252Fpa%252FVW31483_1096d45640096e305eb381515732436d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_1096d45640096e305eb381515732436d.jpg already downloaded
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F9c%252F6c9c45a76f8c166ef745cda710d6102c%252Fpa%252FVW31483_7a5a3ca2bea06974a073c9e8f4b58e74.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_7a5a3ca2bea06974a073c9e8f4b58e74.jpg already downloaded
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F9c%252F6c9c45a76f8c166ef745cda710d6102c%252Fpa%252FVW31483_183c973d0fb5f72df7628f84cd063572.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_183c973d0fb5f72df7628f84cd063572.jpg already downloaded
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F9c%252F6c9c45a76f8c166ef745cda710d6102c%252Fpa%252FVW31483_15dd9b9b16dc68bdd27920d80c8be386.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_15dd9b9b16dc68bdd27920d80c8be386.jpg already downloaded
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F9c%252F6c9c45a76f8c166ef745cda710d6102c%252Fpa%252FVW31483_4be649bbe80e96b1a8fa4216547518a6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_4be649bbe80e96b1a8fa4216547518a6.jpg already downloaded
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F9c%252F6c9c45a76f8c166ef745cda710d6102c%252Fpa%252FVW31483_4a67d17deec2b4146654a6e43b009c30.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_4a67d17deec2b4146654a6e43b009c30.jpg already downloaded
2026-03-30 07:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 549d7081-0da5-5abb-a494-ec0bec015859, identifier: VW31483
2026-03-30 07:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_0fc35b1666070a1e9886670f1da3258f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cb32681-35b9-5575-9a0e-27e4ceee20ba with identifier: BM26089
2026-03-30 07:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cb32681-35b9-5575-9a0e-27e4ceee20ba with identifier: BM26089
2026-03-30 07:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cb32681-35b9-5575-9a0e-27e4ceee20ba with identifier: BM26089 to the API
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:47:08Z',
 'fuel_type': 'electro',
 'id': '0cb32681-35b9-5575-9a0e-27e4ceee20ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM26089',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Enyaq',
 'odometer': 83939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-26',
 'seller_name': None,
 'title': 'Skoda Enyaq iV 80X Sportline',
 'transmission': 'automatic',
 'trim': 'Sportline',
 'year': 2023}
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM26089%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [auto1.de] INFO: Saving data for BM26089: {'auction_closing_time': 1774972028.0, 'created_time': 1774639143.950786, 'last_price_update_time': 1774856366.636468}
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM26089') HTTP/1.1" 204 0
2026-03-30 07:39:26 [auto1.de] INFO: Found listing with ID: YY75784
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY75784%27 HTTP/1.1" 200 None
2026-03-30 07:39:26 [auto1.de] INFO: Scrape type for YY75784: 2
2026-03-30 07:39:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88658b91-4b02-5c49-9b41-a09d6df09d93 with identifier: YY75784
2026-03-30 07:39:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88658b91-4b02-5c49-9b41-a09d6df09d93 with scrape type 2
2026-03-30 07:39:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88658b91-4b02-5c49-9b41-a09d6df09d93 with scrape type 2
2026-03-30 07:39:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88658b91-4b02-5c49-9b41-a09d6df09d93, identifier: YY75784
2026-03-30 07:39:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AU31378/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 549d7081-0da5-5abb-a494-ec0bec015859 with identifier: VW31483
2026-03-30 07:39:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 549d7081-0da5-5abb-a494-ec0bec015859 with identifier: VW31483
2026-03-30 07:39:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 549d7081-0da5-5abb-a494-ec0bec015859 with identifier: VW31483 to the API
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VW31483>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 195,
 'expiration_date': '2026-03-31T15:57:47Z',
 'fuel_type': 'diesel',
 'id': '549d7081-0da5-5abb-a494-ec0bec015859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW31483',
 'listing': 'auction',
 'location': 'DE, Atting',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 173512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_9377779240b00acdbe5ef5078fb086ce.jpg',
                'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_0caa171fd602770e529d3dffd9c991e0.jpg',
                'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_00b5d0758f65ddfd4844e8733113fbcd.jpg',
                'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_a8fa3aaf31a31875fb62424d4697729d.jpg',
                'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_1096d45640096e305eb381515732436d.jpg',
                'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_7a5a3ca2bea06974a073c9e8f4b58e74.jpg',
                'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_183c973d0fb5f72df7628f84cd063572.jpg',
                'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_15dd9b9b16dc68bdd27920d80c8be386.jpg',
                'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_4be649bbe80e96b1a8fa4216547518a6.jpg',
                'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_4a67d17deec2b4146654a6e43b009c30.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549d7081-0da5-5abb-a494-ec0bec015859/549d7081-0da5-5abb-a494-ec0bec015859_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_9377779240b00acdbe5ef5078fb086ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549d7081-0da5-5abb-a494-ec0bec015859/549d7081-0da5-5abb-a494-ec0bec015859_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95226,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_0caa171fd602770e529d3dffd9c991e0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549d7081-0da5-5abb-a494-ec0bec015859/549d7081-0da5-5abb-a494-ec0bec015859_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_00b5d0758f65ddfd4844e8733113fbcd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549d7081-0da5-5abb-a494-ec0bec015859/549d7081-0da5-5abb-a494-ec0bec015859_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_a8fa3aaf31a31875fb62424d4697729d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549d7081-0da5-5abb-a494-ec0bec015859/549d7081-0da5-5abb-a494-ec0bec015859_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99694,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_1096d45640096e305eb381515732436d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549d7081-0da5-5abb-a494-ec0bec015859/549d7081-0da5-5abb-a494-ec0bec015859_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83498,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_7a5a3ca2bea06974a073c9e8f4b58e74.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549d7081-0da5-5abb-a494-ec0bec015859/549d7081-0da5-5abb-a494-ec0bec015859_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_183c973d0fb5f72df7628f84cd063572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549d7081-0da5-5abb-a494-ec0bec015859/549d7081-0da5-5abb-a494-ec0bec015859_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93993,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_15dd9b9b16dc68bdd27920d80c8be386.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549d7081-0da5-5abb-a494-ec0bec015859/549d7081-0da5-5abb-a494-ec0bec015859_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107830,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_4be649bbe80e96b1a8fa4216547518a6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_549d7081-0da5-5abb-a494-ec0bec015859/549d7081-0da5-5abb-a494-ec0bec015859_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/9c/6c9c45a76f8c166ef745cda710d6102c/pa/VW31483_4a67d17deec2b4146654a6e43b009c30.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-24',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2013}
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW31483%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Saving data for VW31483: {'created_time': 1774856367.102733, 'last_price_update_time': 1774856367.102744, 'auction_closing_time': 1774972667.0}
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW31483') HTTP/1.1" 204 0
2026-03-30 07:39:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d6c3d0>
2026-03-30 07:39:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_520b43b9a0386255e33456a95d394d6a.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_520b43b9a0386255e33456a95d394d6a.jpg saved to cache
2026-03-30 07:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: YY75784
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY75784%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for YY75784: 2
2026-03-30 07:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88658b91-4b02-5c49-9b41-a09d6df09d93 with scrape type 2
2026-03-30 07:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88658b91-4b02-5c49-9b41-a09d6df09d93 with scrape type 2
2026-03-30 07:39:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88658b91-4b02-5c49-9b41-a09d6df09d93, identifier: YY75784
2026-03-30 07:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88658b91-4b02-5c49-9b41-a09d6df09d93 with identifier: YY75784
2026-03-30 07:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88658b91-4b02-5c49-9b41-a09d6df09d93 with identifier: YY75784
2026-03-30 07:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88658b91-4b02-5c49-9b41-a09d6df09d93 with identifier: YY75784 to the API
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:36:26Z',
 'fuel_type': 'petrol',
 'id': '88658b91-4b02-5c49-9b41-a09d6df09d93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY75784',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 42257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY75784%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Saving data for YY75784: {'auction_closing_time': 1774971386.0, 'created_time': 1773773953.594005, 'last_price_update_time': 1774856367.645106}
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY75784') HTTP/1.1" 204 0
2026-03-30 07:39:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88658b91-4b02-5c49-9b41-a09d6df09d93 with identifier: YY75784
2026-03-30 07:39:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88658b91-4b02-5c49-9b41-a09d6df09d93 with identifier: YY75784
2026-03-30 07:39:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88658b91-4b02-5c49-9b41-a09d6df09d93 with identifier: YY75784 to the API
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-31T15:36:26Z',
 'fuel_type': 'petrol',
 'id': '88658b91-4b02-5c49-9b41-a09d6df09d93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY75784',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 42257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-11',
 'seller_name': None,
 'title': 'Jeep Compass 1.4 M-Air Limited 4WD',
 'transmission': 'automatic',
 'trim': 'Limited 4WD',
 'year': 2018}
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY75784%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Saving data for YY75784: {'auction_closing_time': 1774971386.0, 'created_time': 1773773953.594005, 'last_price_update_time': 1774856367.948157}
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY75784') HTTP/1.1" 204 0
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: SY47476
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: HN83229
2026-03-30 07:39:27 [auto1.de] INFO: Found listing with ID: AF40953
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF40953%27 HTTP/1.1" 200 None
2026-03-30 07:39:27 [auto1.de] INFO: Scrape type for AF40953: 1
2026-03-30 07:39:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d33b299-97b9-5a46-9ccb-ab590b168b6f with identifier: BP06971
2026-03-30 07:39:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d33b299-97b9-5a46-9ccb-ab590b168b6f with scrape type 1
2026-03-30 07:39:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d33b299-97b9-5a46-9ccb-ab590b168b6f
2026-03-30 07:39:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0e%252Fe80eb33104e6c8a21e5e01dc31e178cc%252Fpa%252FBP06971_e6a904b7f0c8c39ad18231050d31b3ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_e6a904b7f0c8c39ad18231050d31b3ef.jpg already downloaded
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0e%252Fe80eb33104e6c8a21e5e01dc31e178cc%252Fpa%252FBP06971_3ce6174abc7afc4fb3861742efb546f5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_3ce6174abc7afc4fb3861742efb546f5.jpg already downloaded
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0e%252Fe80eb33104e6c8a21e5e01dc31e178cc%252Fpa%252FBP06971_26689272551929c2f922901691977d0b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_26689272551929c2f922901691977d0b.jpg already downloaded
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0e%252Fe80eb33104e6c8a21e5e01dc31e178cc%252Fpa%252FBP06971_f30c85324ea2c1ea0d0780904403d90c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_f30c85324ea2c1ea0d0780904403d90c.jpg already downloaded
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0e%252Fe80eb33104e6c8a21e5e01dc31e178cc%252Fpa%252FBP06971_3202d84900fdd189aa0018e38ae6d264.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_3202d84900fdd189aa0018e38ae6d264.jpg already downloaded
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0e%252Fe80eb33104e6c8a21e5e01dc31e178cc%252Fpa%252FBP06971_36935ce78e1e3ccb19c5a7e5da44c328.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_36935ce78e1e3ccb19c5a7e5da44c328.jpg already downloaded
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0e%252Fe80eb33104e6c8a21e5e01dc31e178cc%252Fpa%252FBP06971_4a451cd96a53c10f75377256676e8b83.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_4a451cd96a53c10f75377256676e8b83.jpg already downloaded
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0e%252Fe80eb33104e6c8a21e5e01dc31e178cc%252Fpa%252FBP06971_4cbfa71cc8684895ce7498d27a0163ae.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_4cbfa71cc8684895ce7498d27a0163ae.jpg already downloaded
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0e%252Fe80eb33104e6c8a21e5e01dc31e178cc%252Fpa%252FBP06971_e19dea89a8618ad7267f3cc52241eda5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_e19dea89a8618ad7267f3cc52241eda5.jpg already downloaded
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252F0e%252Fe80eb33104e6c8a21e5e01dc31e178cc%252Fpa%252FBP06971_a78663910ee75b30d019f8a04081c290.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_a78663910ee75b30d019f8a04081c290.jpg already downloaded
2026-03-30 07:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d33b299-97b9-5a46-9ccb-ab590b168b6f, identifier: BP06971
2026-03-30 07:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d33b299-97b9-5a46-9ccb-ab590b168b6f with identifier: BP06971
2026-03-30 07:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d33b299-97b9-5a46-9ccb-ab590b168b6f with identifier: BP06971
2026-03-30 07:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d33b299-97b9-5a46-9ccb-ab590b168b6f with identifier: BP06971 to the API
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BP06971>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:12:40Z',
 'fuel_type': 'petrol',
 'id': '1d33b299-97b9-5a46-9ccb-ab590b168b6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP06971',
 'listing': 'auction',
 'location': 'DE, Schöneck-Kilianstädten',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 87027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_e6a904b7f0c8c39ad18231050d31b3ef.jpg',
                'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_3ce6174abc7afc4fb3861742efb546f5.jpg',
                'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_26689272551929c2f922901691977d0b.jpg',
                'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_f30c85324ea2c1ea0d0780904403d90c.jpg',
                'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_3202d84900fdd189aa0018e38ae6d264.jpg',
                'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_36935ce78e1e3ccb19c5a7e5da44c328.jpg',
                'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_4a451cd96a53c10f75377256676e8b83.jpg',
                'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_4cbfa71cc8684895ce7498d27a0163ae.jpg',
                'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_e19dea89a8618ad7267f3cc52241eda5.jpg',
                'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_a78663910ee75b30d019f8a04081c290.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d33b299-97b9-5a46-9ccb-ab590b168b6f/1d33b299-97b9-5a46-9ccb-ab590b168b6f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_e6a904b7f0c8c39ad18231050d31b3ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d33b299-97b9-5a46-9ccb-ab590b168b6f/1d33b299-97b9-5a46-9ccb-ab590b168b6f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 1977303,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_3ce6174abc7afc4fb3861742efb546f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d33b299-97b9-5a46-9ccb-ab590b168b6f/1d33b299-97b9-5a46-9ccb-ab590b168b6f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71523,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_26689272551929c2f922901691977d0b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d33b299-97b9-5a46-9ccb-ab590b168b6f/1d33b299-97b9-5a46-9ccb-ab590b168b6f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_f30c85324ea2c1ea0d0780904403d90c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d33b299-97b9-5a46-9ccb-ab590b168b6f/1d33b299-97b9-5a46-9ccb-ab590b168b6f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2160591,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_3202d84900fdd189aa0018e38ae6d264.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d33b299-97b9-5a46-9ccb-ab590b168b6f/1d33b299-97b9-5a46-9ccb-ab590b168b6f_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2026046,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_36935ce78e1e3ccb19c5a7e5da44c328.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d33b299-97b9-5a46-9ccb-ab590b168b6f/1d33b299-97b9-5a46-9ccb-ab590b168b6f_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_4a451cd96a53c10f75377256676e8b83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d33b299-97b9-5a46-9ccb-ab590b168b6f/1d33b299-97b9-5a46-9ccb-ab590b168b6f_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_4cbfa71cc8684895ce7498d27a0163ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d33b299-97b9-5a46-9ccb-ab590b168b6f/1d33b299-97b9-5a46-9ccb-ab590b168b6f_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_e19dea89a8618ad7267f3cc52241eda5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1d33b299-97b9-5a46-9ccb-ab590b168b6f/1d33b299-97b9-5a46-9ccb-ab590b168b6f_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/0e/e80eb33104e6c8a21e5e01dc31e178cc/pa/BP06971_a78663910ee75b30d019f8a04081c290.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-02-11',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Ford Ka 1.2 Cool & Sound Edition',
 'transmission': 'manual',
 'trim': 'Cool & Sound Edition',
 'year': 2015}
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP06971%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [auto1.de] INFO: Saving data for BP06971: {'created_time': 1774856368.616195, 'last_price_update_time': 1774856368.616207, 'auction_closing_time': 1774969960.0}
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP06971') HTTP/1.1" 204 0
2026-03-30 07:39:28 [auto1.de] INFO: Found listing with ID: VC76519
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC76519%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [auto1.de] INFO: Scrape type for VC76519: 1
2026-03-30 07:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e89b50>
2026-03-30 07:39:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_0fc35b1666070a1e9886670f1da3258f.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_0fc35b1666070a1e9886670f1da3258f.jpg saved to cache
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5
2026-03-30 07:39:28 [auto1.de] INFO: Found listing with ID: PS21174
2026-03-30 07:39:28 [auto1.de] INFO: Found listing with ID: YJ43291
2026-03-30 07:39:28 [auto1.de] INFO: Found listing with ID: MM49725
2026-03-30 07:39:28 [auto1.de] INFO: Found listing with ID: TZ88543
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ88543%27 HTTP/1.1" 200 None
2026-03-30 07:39:28 [auto1.de] INFO: Scrape type for TZ88543: 2
2026-03-30 07:39:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ec8a1e5-83fa-5034-9978-f8496bbcc77b with identifier: TZ88543
2026-03-30 07:39:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ec8a1e5-83fa-5034-9978-f8496bbcc77b with scrape type 2
2026-03-30 07:39:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ec8a1e5-83fa-5034-9978-f8496bbcc77b with scrape type 2
2026-03-30 07:39:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ec8a1e5-83fa-5034-9978-f8496bbcc77b, identifier: TZ88543
2026-03-30 07:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ec8a1e5-83fa-5034-9978-f8496bbcc77b with identifier: TZ88543
2026-03-30 07:39:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ec8a1e5-83fa-5034-9978-f8496bbcc77b with identifier: TZ88543
2026-03-30 07:39:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ec8a1e5-83fa-5034-9978-f8496bbcc77b with identifier: TZ88543 to the API
2026-03-30 07:39:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:36:38Z',
 'fuel_type': 'petrol',
 'id': '9ec8a1e5-83fa-5034-9978-f8496bbcc77b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ88543',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 325502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-03-17',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 320 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2002}
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ88543%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Saving data for TZ88543: {'auction_closing_time': 1774971398.0, 'created_time': 1773773942.722668, 'last_price_update_time': 1774856369.179836}
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ88543') HTTP/1.1" 204 0
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: AL17171
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: VZ09254
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ09254%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for VZ09254: 2
2026-03-30 07:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bcb4e4b-31ad-5648-a251-a150db64f98d with identifier: VZ09254
2026-03-30 07:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bcb4e4b-31ad-5648-a251-a150db64f98d with scrape type 2
2026-03-30 07:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bcb4e4b-31ad-5648-a251-a150db64f98d with scrape type 2
2026-03-30 07:39:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bcb4e4b-31ad-5648-a251-a150db64f98d, identifier: VZ09254
2026-03-30 07:39:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bcb4e4b-31ad-5648-a251-a150db64f98d with identifier: VZ09254
2026-03-30 07:39:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bcb4e4b-31ad-5648-a251-a150db64f98d with identifier: VZ09254
2026-03-30 07:39:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bcb4e4b-31ad-5648-a251-a150db64f98d with identifier: VZ09254 to the API
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:05:48Z',
 'fuel_type': 'petrol',
 'id': '6bcb4e4b-31ad-5648-a251-a150db64f98d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ09254',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 141633,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-22',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ09254%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Saving data for VZ09254: {'auction_closing_time': 1774969548.0, 'created_time': 1774293280.753012, 'last_price_update_time': 1774856369.81247}
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ09254') HTTP/1.1" 204 0
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: SS05467
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS05467%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for SS05467: 1
2026-03-30 07:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV47102> (referer: https://www.auto1.com/v1/car-details-view/PV47102/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: RF02857
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: ZM27094
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM27094%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for ZM27094: 1
2026-03-30 07:39:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS49275> (referer: https://www.auto1.com/v1/car-details-view/RS49275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: GF71499
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: EN37654
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: SK33918
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: VV18496
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV18496%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for VV18496: 1
2026-03-30 07:39:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: BN15380
2026-03-30 07:39:29 [auto1.de] INFO: Found listing with ID: TE38995
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE38995%27 HTTP/1.1" 200 None
2026-03-30 07:39:29 [auto1.de] INFO: Scrape type for TE38995: 2
2026-03-30 07:39:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51a1517c-dd0e-5eb3-84c8-266d6c299c15 with identifier: TE38995
2026-03-30 07:39:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51a1517c-dd0e-5eb3-84c8-266d6c299c15 with scrape type 2
2026-03-30 07:39:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51a1517c-dd0e-5eb3-84c8-266d6c299c15 with scrape type 2
2026-03-30 07:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51a1517c-dd0e-5eb3-84c8-266d6c299c15, identifier: TE38995
2026-03-30 07:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51a1517c-dd0e-5eb3-84c8-266d6c299c15 with identifier: TE38995
2026-03-30 07:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51a1517c-dd0e-5eb3-84c8-266d6c299c15 with identifier: TE38995
2026-03-30 07:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51a1517c-dd0e-5eb3-84c8-266d6c299c15 with identifier: TE38995 to the API
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:06:47Z',
 'fuel_type': 'diesel',
 'id': '51a1517c-dd0e-5eb3-84c8-266d6c299c15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE38995',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 151295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-31',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE38995%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Saving data for TE38995: {'auction_closing_time': 1774969607.0, 'created_time': 1774265063.841863, 'last_price_update_time': 1774856370.392814}
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE38995') HTTP/1.1" 204 0
2026-03-30 07:39:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: GM10989
2026-03-30 07:39:30 [auto1.de] INFO: Found listing with ID: KX99318
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX99318%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Scrape type for KX99318: 2
2026-03-30 07:39:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 598e6164-f5c1-5cde-9666-a0c3a8a0a2e4 with identifier: KX99318
2026-03-30 07:39:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 598e6164-f5c1-5cde-9666-a0c3a8a0a2e4 with scrape type 2
2026-03-30 07:39:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 598e6164-f5c1-5cde-9666-a0c3a8a0a2e4 with scrape type 2
2026-03-30 07:39:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 598e6164-f5c1-5cde-9666-a0c3a8a0a2e4, identifier: KX99318
2026-03-30 07:39:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 598e6164-f5c1-5cde-9666-a0c3a8a0a2e4 with identifier: KX99318
2026-03-30 07:39:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 598e6164-f5c1-5cde-9666-a0c3a8a0a2e4 with identifier: KX99318
2026-03-30 07:39:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 598e6164-f5c1-5cde-9666-a0c3a8a0a2e4 with identifier: KX99318 to the API
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-31T15:36:18Z',
 'fuel_type': 'petrol',
 'id': '598e6164-f5c1-5cde-9666-a0c3a8a0a2e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX99318',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 149555,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-06',
 'seller_name': None,
 'title': 'Kia Rio 1.4 EX Basis',
 'transmission': 'manual',
 'trim': 'EX Basis',
 'year': 2009}
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX99318%27 HTTP/1.1" 200 None
2026-03-30 07:39:30 [auto1.de] INFO: Saving data for KX99318: {'auction_closing_time': 1774971378.0, 'created_time': 1774330541.418947, 'last_price_update_time': 1774856370.99508}
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX99318') HTTP/1.1" 204 0
2026-03-30 07:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08a06a52-b3f0-5bb2-b212-c84f0121206a with identifier: PV47102
2026-03-30 07:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a06a52-b3f0-5bb2-b212-c84f0121206a with scrape type 1
2026-03-30 07:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 08a06a52-b3f0-5bb2-b212-c84f0121206a
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F25%252F4c25c998474c02dbfeb3ceec13327c37%252Fpa%252FPV47102_13cb6cab7266d48437c70162b4765a14.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_13cb6cab7266d48437c70162b4765a14.jpg not downloaded yet
2026-03-30 07:39:31 [auto1.de] INFO: Channel: 24h | Page: 26 | totalHits: 7874 | hits on page: 40
2026-03-30 07:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb0a979a-46d4-5ea3-b933-f5995402facf with identifier: RS49275
2026-03-30 07:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb0a979a-46d4-5ea3-b933-f5995402facf with scrape type 1
2026-03-30 07:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item eb0a979a-46d4-5ea3-b933-f5995402facf
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_e5f5216625d436623bc318a386f0a762.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_e5f5216625d436623bc318a386f0a762.jpg not downloaded yet
2026-03-30 07:39:31 [auto1.de] INFO: Found listing with ID: UC44293
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC44293%27 HTTP/1.1" 200 None
2026-03-30 07:39:31 [auto1.de] INFO: Scrape type for UC44293: 2
2026-03-30 07:39:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9349cc3a-6600-565f-8178-e9a0a05a1617 with identifier: UC44293
2026-03-30 07:39:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9349cc3a-6600-565f-8178-e9a0a05a1617 with scrape type 2
2026-03-30 07:39:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9349cc3a-6600-565f-8178-e9a0a05a1617 with scrape type 2
2026-03-30 07:39:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9349cc3a-6600-565f-8178-e9a0a05a1617, identifier: UC44293
2026-03-30 07:39:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9349cc3a-6600-565f-8178-e9a0a05a1617 with identifier: UC44293
2026-03-30 07:39:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9349cc3a-6600-565f-8178-e9a0a05a1617 with identifier: UC44293
2026-03-30 07:39:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9349cc3a-6600-565f-8178-e9a0a05a1617 with identifier: UC44293 to the API
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:41:45Z',
 'fuel_type': 'petrol',
 'id': '9349cc3a-6600-565f-8178-e9a0a05a1617',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC44293',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 206439,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-04',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 CATCH ME Now',
 'transmission': 'automatic',
 'trim': 'CATCH ME Now',
 'year': 2007}
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC44293%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Saving data for UC44293: {'auction_closing_time': 1774971705.0, 'created_time': 1774089557.813383, 'last_price_update_time': 1774856372.028099}
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC44293') HTTP/1.1" 204 0
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F25%252F4c25c998474c02dbfeb3ceec13327c37%252Fpa%252FPV47102_97fb0d38c83adff6baf4f9613c7b9a5e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_97fb0d38c83adff6baf4f9613c7b9a5e.jpg not downloaded yet
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: AF40953
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_2a1fe766f51bf499a17621b6d8b26615.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2a1fe766f51bf499a17621b6d8b26615.jpg not downloaded yet
2026-03-30 07:39:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: DT29379
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT29379%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for DT29379: 1
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F25%252F4c25c998474c02dbfeb3ceec13327c37%252Fpa%252FPV47102_767f9bbfcc84fb8feb1a065d08a8417f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_767f9bbfcc84fb8feb1a065d08a8417f.jpg not downloaded yet
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: VC76519
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_4965357b8b34b61fba773ddb93a37e07.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_4965357b8b34b61fba773ddb93a37e07.jpg not downloaded yet
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: MY20439
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: MM40978
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: PX34024
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX34024%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for PX34024: 2
2026-03-30 07:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe7406a9-a740-5d63-ae5a-a13b0bcbb207 with identifier: PX34024
2026-03-30 07:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe7406a9-a740-5d63-ae5a-a13b0bcbb207 with scrape type 2
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe7406a9-a740-5d63-ae5a-a13b0bcbb207 with scrape type 2
2026-03-30 07:39:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe7406a9-a740-5d63-ae5a-a13b0bcbb207, identifier: PX34024
2026-03-30 07:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF40953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC76519/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DF41364> (referer: https://www.auto1.com/v1/car-details-view/DF41364/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe7406a9-a740-5d63-ae5a-a13b0bcbb207 with identifier: PX34024
2026-03-30 07:39:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe7406a9-a740-5d63-ae5a-a13b0bcbb207 with identifier: PX34024
2026-03-30 07:39:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe7406a9-a740-5d63-ae5a-a13b0bcbb207 with identifier: PX34024 to the API
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:30:07Z',
 'fuel_type': 'diesel',
 'id': 'fe7406a9-a740-5d63-ae5a-a13b0bcbb207',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX34024',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 155405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-11',
 'seller_name': None,
 'title': 'BMW X5 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX34024%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Saving data for PX34024: {'auction_closing_time': 1774971007.0, 'created_time': 1773308202.29013, 'last_price_update_time': 1774856372.619236}
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX34024') HTTP/1.1" 204 0
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F25%252F4c25c998474c02dbfeb3ceec13327c37%252Fpa%252FPV47102_c1732b8a3438176ce1ee9149891d90f3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_c1732b8a3438176ce1ee9149891d90f3.jpg not downloaded yet
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: PS21174
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: YJ43291
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: MM49725
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: TZ88543
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ88543%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for TZ88543: 0
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: AL17171
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: VZ09254
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ09254%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [auto1.de] INFO: Scrape type for VZ09254: 0
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: SS05467
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_2721a0cafed2efb5760c2da3b06a6d4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2721a0cafed2efb5760c2da3b06a6d4e.jpg not downloaded yet
2026-03-30 07:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_e5f5216625d436623bc318a386f0a762.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_13cb6cab7266d48437c70162b4765a14.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: NZ57035
2026-03-30 07:39:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F25%252F4c25c998474c02dbfeb3ceec13327c37%252Fpa%252FPV47102_07b6b834f50d90c71716fc909c4b9861.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_07b6b834f50d90c71716fc909c4b9861.jpg not downloaded yet
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: RF02857
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: ZM27094
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_0e132b30eb02552e325deba65870f767.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_0e132b30eb02552e325deba65870f767.jpg not downloaded yet
2026-03-30 07:39:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2a1fe766f51bf499a17621b6d8b26615.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: GF71499
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: EN37654
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: SK33918
2026-03-30 07:39:32 [auto1.de] INFO: Found listing with ID: VV18496
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_1ad420b7cb612d62533ccbccd7cf845c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_1ad420b7cb612d62533ccbccd7cf845c.jpg not downloaded yet
2026-03-30 07:39:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 454163f4-7179-5ba5-bfca-51c35629a5a9 with identifier: DF41364
2026-03-30 07:39:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 454163f4-7179-5ba5-bfca-51c35629a5a9 with scrape type 1
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 454163f4-7179-5ba5-bfca-51c35629a5a9
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa8%252Fd3a84adf1a5ccd563f399fa60ea3f52a%252Fpa%252FDF41364_97123cef0318deda309ba0bf45757070.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_97123cef0318deda309ba0bf45757070.jpg already downloaded
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa8%252Fd3a84adf1a5ccd563f399fa60ea3f52a%252Fpa%252FDF41364_07f931fd7d88fcf390b4725a58abaa68.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_07f931fd7d88fcf390b4725a58abaa68.jpg already downloaded
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa8%252Fd3a84adf1a5ccd563f399fa60ea3f52a%252Fpa%252FDF41364_9760bb28301f9b28e0d3f4a59b7eebc6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_9760bb28301f9b28e0d3f4a59b7eebc6.jpg already downloaded
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa8%252Fd3a84adf1a5ccd563f399fa60ea3f52a%252Fpa%252FDF41364_250749b610e3be922c318805d78f5619.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_250749b610e3be922c318805d78f5619.jpg already downloaded
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa8%252Fd3a84adf1a5ccd563f399fa60ea3f52a%252Fpa%252FDF41364_f62dc0cb0636169a34cea79342f1f96b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_f62dc0cb0636169a34cea79342f1f96b.jpg already downloaded
2026-03-30 07:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 454163f4-7179-5ba5-bfca-51c35629a5a9, identifier: DF41364
2026-03-30 07:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 454163f4-7179-5ba5-bfca-51c35629a5a9 with identifier: DF41364
2026-03-30 07:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 454163f4-7179-5ba5-bfca-51c35629a5a9 with identifier: DF41364
2026-03-30 07:39:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 454163f4-7179-5ba5-bfca-51c35629a5a9 with identifier: DF41364 to the API
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DF41364>
{'auction_title': '',
 'c_o_2_emission_value': 251,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:36:32Z',
 'fuel_type': 'petrol',
 'id': '454163f4-7179-5ba5-bfca-51c35629a5a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF41364',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Saab',
 'model': '9-5',
 'odometer': 207062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_97123cef0318deda309ba0bf45757070.jpg',
                'https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_07f931fd7d88fcf390b4725a58abaa68.jpg',
                'https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_9760bb28301f9b28e0d3f4a59b7eebc6.jpg',
                'https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_250749b610e3be922c318805d78f5619.jpg',
                'https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_f62dc0cb0636169a34cea79342f1f96b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454163f4-7179-5ba5-bfca-51c35629a5a9/454163f4-7179-5ba5-bfca-51c35629a5a9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105647,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_97123cef0318deda309ba0bf45757070.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454163f4-7179-5ba5-bfca-51c35629a5a9/454163f4-7179-5ba5-bfca-51c35629a5a9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_07f931fd7d88fcf390b4725a58abaa68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454163f4-7179-5ba5-bfca-51c35629a5a9/454163f4-7179-5ba5-bfca-51c35629a5a9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_9760bb28301f9b28e0d3f4a59b7eebc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454163f4-7179-5ba5-bfca-51c35629a5a9/454163f4-7179-5ba5-bfca-51c35629a5a9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57209,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_250749b610e3be922c318805d78f5619.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_454163f4-7179-5ba5-bfca-51c35629a5a9/454163f4-7179-5ba5-bfca-51c35629a5a9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95867,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/a8/d3a84adf1a5ccd563f399fa60ea3f52a/pa/DF41364_f62dc0cb0636169a34cea79342f1f96b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Saab 9-5 2.0 T ARC',
 'transmission': 'automatic',
 'trim': 'T ARC',
 'year': 2004}
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF41364%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Saving data for DF41364: {'created_time': 1774856373.36424, 'last_price_update_time': 1774856373.364252, 'auction_closing_time': 1774971392.0}
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF41364') HTTP/1.1" 204 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: BN15380
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: TE38995
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE38995%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for TE38995: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: GM10989
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: KX99318
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX99318%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for KX99318: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: UC44293
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC44293%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for UC44293: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: DT29379
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_369367569b9de78bdb7b3a44dbc14fd8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_369367569b9de78bdb7b3a44dbc14fd8.jpg not downloaded yet
2026-03-30 07:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_767f9bbfcc84fb8feb1a065d08a8417f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_4965357b8b34b61fba773ddb93a37e07.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZM27094/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS05467/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_97fb0d38c83adff6baf4f9613c7b9a5e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: MY20439
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: MM40978
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: PX34024
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX34024%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for PX34024: 0
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: NZ57035
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: FT91283
2026-03-30 07:39:33 [auto1.de] INFO: Found listing with ID: LH58112
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH58112%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [auto1.de] INFO: Scrape type for LH58112: 2
2026-03-30 07:39:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50beb19d-4fd1-5298-b605-014faf0d6cc2 with identifier: LH58112
2026-03-30 07:39:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50beb19d-4fd1-5298-b605-014faf0d6cc2 with scrape type 2
2026-03-30 07:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50beb19d-4fd1-5298-b605-014faf0d6cc2 with scrape type 2
2026-03-30 07:39:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50beb19d-4fd1-5298-b605-014faf0d6cc2, identifier: LH58112
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_2e8e947724f2014f7491d1092e03b0be.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2e8e947724f2014f7491d1092e03b0be.jpg not downloaded yet
2026-03-30 07:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23bed10>
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_e5f5216625d436623bc318a386f0a762.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_e5f5216625d436623bc318a386f0a762.jpg saved to cache
2026-03-30 07:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb0a979a-46d4-5ea3-b933-f5995402facf
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2edc9d0>
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a06a52-b3f0-5bb2-b212-c84f0121206a/08a06a52-b3f0-5bb2-b212-c84f0121206a_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F25%252F4c25c998474c02dbfeb3ceec13327c37%252Fpa%252FPV47102_13cb6cab7266d48437c70162b4765a14.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_13cb6cab7266d48437c70162b4765a14.jpg saved to cache
2026-03-30 07:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 08a06a52-b3f0-5bb2-b212-c84f0121206a
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f879d0>
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_2a1fe766f51bf499a17621b6d8b26615.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2a1fe766f51bf499a17621b6d8b26615.jpg saved to cache
2026-03-30 07:39:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb0a979a-46d4-5ea3-b933-f5995402facf
2026-03-30 07:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_2802ea5f4e0908fe9e82e7bc8633b21f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_bf29e7698b8ea476022c4701205a4afd.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50beb19d-4fd1-5298-b605-014faf0d6cc2 with identifier: LH58112
2026-03-30 07:39:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50beb19d-4fd1-5298-b605-014faf0d6cc2 with identifier: LH58112
2026-03-30 07:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50beb19d-4fd1-5298-b605-014faf0d6cc2 with identifier: LH58112 to the API
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:07:57Z',
 'fuel_type': 'diesel',
 'id': '50beb19d-4fd1-5298-b605-014faf0d6cc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH58112',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 285278,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'GTD BlueMotion Tech',
 'year': 2015}
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH58112%27 HTTP/1.1" 200 None
2026-03-30 07:39:34 [auto1.de] INFO: Saving data for LH58112: {'auction_closing_time': 1774969677.0, 'created_time': 1774263424.172736, 'last_price_update_time': 1774856374.405493}
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LH58112') HTTP/1.1" 204 0
2026-03-30 07:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VV18496/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:34 [auto1.de] INFO: Found listing with ID: HJ00196
2026-03-30 07:39:34 [auto1.de] INFO: Found listing with ID: CD55313
2026-03-30 07:39:34 [auto1.de] INFO: Found listing with ID: LY25058
2026-03-30 07:39:34 [auto1.de] INFO: Found listing with ID: FA41844
2026-03-30 07:39:34 [auto1.de] INFO: Found listing with ID: ST24513
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST24513%27 HTTP/1.1" 200 None
2026-03-30 07:39:34 [auto1.de] INFO: Scrape type for ST24513: 1
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_ff2e133c598a4a56621678408b6ee220.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_ff2e133c598a4a56621678408b6ee220.jpg not downloaded yet
2026-03-30 07:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_3c166f180cd06cbd6d8b185068671990.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2721a0cafed2efb5760c2da3b06a6d4e.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2356c50>
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a06a52-b3f0-5bb2-b212-c84f0121206a/08a06a52-b3f0-5bb2-b212-c84f0121206a_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F25%252F4c25c998474c02dbfeb3ceec13327c37%252Fpa%252FPV47102_767f9bbfcc84fb8feb1a065d08a8417f.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_767f9bbfcc84fb8feb1a065d08a8417f.jpg saved to cache
2026-03-30 07:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 08a06a52-b3f0-5bb2-b212-c84f0121206a
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22fa990>
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_4965357b8b34b61fba773ddb93a37e07.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_4965357b8b34b61fba773ddb93a37e07.jpg saved to cache
2026-03-30 07:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb0a979a-46d4-5ea3-b933-f5995402facf
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2125290>
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a06a52-b3f0-5bb2-b212-c84f0121206a/08a06a52-b3f0-5bb2-b212-c84f0121206a_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F25%252F4c25c998474c02dbfeb3ceec13327c37%252Fpa%252FPV47102_97fb0d38c83adff6baf4f9613c7b9a5e.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_97fb0d38c83adff6baf4f9613c7b9a5e.jpg saved to cache
2026-03-30 07:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 08a06a52-b3f0-5bb2-b212-c84f0121206a
2026-03-30 07:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_0e132b30eb02552e325deba65870f767.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:34 [auto1.de] INFO: Found listing with ID: ZY45638
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY45638%27 HTTP/1.1" 200 None
2026-03-30 07:39:34 [auto1.de] INFO: Scrape type for ZY45638: 2
2026-03-30 07:39:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff956c0e-1102-5c89-be06-511093c220e4 with identifier: ZY45638
2026-03-30 07:39:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff956c0e-1102-5c89-be06-511093c220e4 with scrape type 2
2026-03-30 07:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ff956c0e-1102-5c89-be06-511093c220e4 with scrape type 2
2026-03-30 07:39:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ff956c0e-1102-5c89-be06-511093c220e4, identifier: ZY45638
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_ab28bef27a73cb159ea69ad343c02fb8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_ab28bef27a73cb159ea69ad343c02fb8.jpg not downloaded yet
2026-03-30 07:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_07936b7749f17a9162c07402bb3d46d1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_369367569b9de78bdb7b3a44dbc14fd8.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_07b6b834f50d90c71716fc909c4b9861.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_1ad420b7cb612d62533ccbccd7cf845c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ff956c0e-1102-5c89-be06-511093c220e4 with identifier: ZY45638
2026-03-30 07:39:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ff956c0e-1102-5c89-be06-511093c220e4 with identifier: ZY45638
2026-03-30 07:39:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ff956c0e-1102-5c89-be06-511093c220e4 with identifier: ZY45638 to the API
2026-03-30 07:39:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:59:39Z',
 'fuel_type': 'diesel',
 'id': 'ff956c0e-1102-5c89-be06-511093c220e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY45638',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 156434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-29',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Trend & Fun BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2013}
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY45638%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Saving data for ZY45638: {'auction_closing_time': 1774972779.0, 'created_time': 1774262555.422859, 'last_price_update_time': 1774856375.241684}
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY45638') HTTP/1.1" 204 0
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: ZS74444
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: ET18482
2026-03-30 07:39:35 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV36392%27 HTTP/1.1" 200 None
2026-03-30 07:39:35 [auto1.de] INFO: Scrape type for SV36392: 2
2026-03-30 07:39:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8e2f5a1-2291-5405-a3d3-88671be8f99b with identifier: SV36392
2026-03-30 07:39:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8e2f5a1-2291-5405-a3d3-88671be8f99b with scrape type 2
2026-03-30 07:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8e2f5a1-2291-5405-a3d3-88671be8f99b with scrape type 2
2026-03-30 07:39:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8e2f5a1-2291-5405-a3d3-88671be8f99b, identifier: SV36392
2026-03-30 07:39:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22c8390>
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_2802ea5f4e0908fe9e82e7bc8633b21f.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_2802ea5f4e0908fe9e82e7bc8633b21f.jpg saved to cache
2026-03-30 07:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5
2026-03-30 07:39:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2394b10>
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_bf29e7698b8ea476022c4701205a4afd.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_bf29e7698b8ea476022c4701205a4afd.jpg saved to cache
2026-03-30 07:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5
2026-03-30 07:39:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24b94d0>
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_3c166f180cd06cbd6d8b185068671990.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_3c166f180cd06cbd6d8b185068671990.jpg saved to cache
2026-03-30 07:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2dac450>
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_2721a0cafed2efb5760c2da3b06a6d4e.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2721a0cafed2efb5760c2da3b06a6d4e.jpg saved to cache
2026-03-30 07:39:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb0a979a-46d4-5ea3-b933-f5995402facf
2026-03-30 07:39:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8e2f5a1-2291-5405-a3d3-88671be8f99b with identifier: SV36392
2026-03-30 07:39:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8e2f5a1-2291-5405-a3d3-88671be8f99b with identifier: SV36392
2026-03-30 07:39:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8e2f5a1-2291-5405-a3d3-88671be8f99b with identifier: SV36392 to the API
2026-03-30 07:39:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-31T15:51:43Z',
 'fuel_type': 'diesel',
 'id': 'f8e2f5a1-2291-5405-a3d3-88671be8f99b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV36392',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 217958,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-17',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 290 L1 Trend',
 'transmission': 'manual',
 'trim': '290 L1 Trend',
 'year': 2015}
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV36392%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Saving data for SV36392: {'auction_closing_time': 1774972303.0, 'created_time': 1773304696.029236, 'last_price_update_time': 1774856376.166002}
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV36392') HTTP/1.1" 204 0
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: AV80430
2026-03-30 07:39:36 [auto1.de] INFO: Found listing with ID: EK76620
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK76620%27 HTTP/1.1" 200 None
2026-03-30 07:39:36 [auto1.de] INFO: Scrape type for EK76620: 2
2026-03-30 07:39:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98dcfa9d-bad6-5bdb-b9db-c9240585fa56 with identifier: EK76620
2026-03-30 07:39:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98dcfa9d-bad6-5bdb-b9db-c9240585fa56 with scrape type 2
2026-03-30 07:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98dcfa9d-bad6-5bdb-b9db-c9240585fa56 with scrape type 2
2026-03-30 07:39:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98dcfa9d-bad6-5bdb-b9db-c9240585fa56, identifier: EK76620
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d8507f50>
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_0e132b30eb02552e325deba65870f767.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_0e132b30eb02552e325deba65870f767.jpg saved to cache
2026-03-30 07:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eb0a979a-46d4-5ea3-b933-f5995402facf
2026-03-30 07:39:36 [auto1.de] INFO: Channel: 24h | Page: 27 | totalHits: 7879 | hits on page: 40
2026-03-30 07:39:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23f5990>
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_07936b7749f17a9162c07402bb3d46d1.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_07936b7749f17a9162c07402bb3d46d1.jpg saved to cache
2026-03-30 07:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e42710>
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_369367569b9de78bdb7b3a44dbc14fd8.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_369367569b9de78bdb7b3a44dbc14fd8.jpg saved to cache
2026-03-30 07:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eb0a979a-46d4-5ea3-b933-f5995402facf
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2dcd610>
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a06a52-b3f0-5bb2-b212-c84f0121206a/08a06a52-b3f0-5bb2-b212-c84f0121206a_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F25%252F4c25c998474c02dbfeb3ceec13327c37%252Fpa%252FPV47102_07b6b834f50d90c71716fc909c4b9861.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_07b6b834f50d90c71716fc909c4b9861.jpg saved to cache
2026-03-30 07:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 08a06a52-b3f0-5bb2-b212-c84f0121206a
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d3e110>
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_1ad420b7cb612d62533ccbccd7cf845c.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_1ad420b7cb612d62533ccbccd7cf845c.jpg saved to cache
2026-03-30 07:39:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eb0a979a-46d4-5ea3-b933-f5995402facf
2026-03-30 07:39:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98dcfa9d-bad6-5bdb-b9db-c9240585fa56 with identifier: EK76620
2026-03-30 07:39:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98dcfa9d-bad6-5bdb-b9db-c9240585fa56 with identifier: EK76620
2026-03-30 07:39:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98dcfa9d-bad6-5bdb-b9db-c9240585fa56 with identifier: EK76620 to the API
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:53:11Z',
 'fuel_type': 'petrol',
 'id': '98dcfa9d-bad6-5bdb-b9db-c9240585fa56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK76620',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'forfour',
 'odometer': 72325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-03',
 'seller_name': None,
 'title': 'Smart forfour 1.0 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2015}
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK76620%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Saving data for EK76620: {'auction_closing_time': 1774972391.0, 'created_time': 1773429481.886109, 'last_price_update_time': 1774856377.054443}
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK76620') HTTP/1.1" 204 0
2026-03-30 07:39:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: GX57450
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX57450%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for GX57450: 2
2026-03-30 07:39:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8b550bd-80a1-55f6-b49d-23eda67e67f2 with identifier: GX57450
2026-03-30 07:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8b550bd-80a1-55f6-b49d-23eda67e67f2 with scrape type 2
2026-03-30 07:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8b550bd-80a1-55f6-b49d-23eda67e67f2 with scrape type 2
2026-03-30 07:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8b550bd-80a1-55f6-b49d-23eda67e67f2, identifier: GX57450
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: SV36392
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV36392%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for SV36392: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: AV80430
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: EK76620
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK76620%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for EK76620: 0
2026-03-30 07:39:37 [auto1.de] INFO: Found listing with ID: GX57450
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX57450%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Scrape type for GX57450: 2
2026-03-30 07:39:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8b550bd-80a1-55f6-b49d-23eda67e67f2 with scrape type 2
2026-03-30 07:39:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8b550bd-80a1-55f6-b49d-23eda67e67f2 with scrape type 2
2026-03-30 07:39:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8b550bd-80a1-55f6-b49d-23eda67e67f2, identifier: GX57450
2026-03-30 07:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF40953> (referer: https://www.auto1.com/v1/car-details-view/AF40953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT29379/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8b550bd-80a1-55f6-b49d-23eda67e67f2 with identifier: GX57450
2026-03-30 07:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8b550bd-80a1-55f6-b49d-23eda67e67f2 with identifier: GX57450
2026-03-30 07:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8b550bd-80a1-55f6-b49d-23eda67e67f2 with identifier: GX57450 to the API
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:33:29Z',
 'fuel_type': 'diesel',
 'id': 'f8b550bd-80a1-55f6-b49d-23eda67e67f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX57450',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 128924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-01',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX57450%27 HTTP/1.1" 200 None
2026-03-30 07:39:37 [auto1.de] INFO: Saving data for GX57450: {'auction_closing_time': 1774971209.0, 'created_time': 1774350790.675138, 'last_price_update_time': 1774856377.817977}
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX57450') HTTP/1.1" 204 0
2026-03-30 07:39:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8b550bd-80a1-55f6-b49d-23eda67e67f2 with identifier: GX57450
2026-03-30 07:39:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8b550bd-80a1-55f6-b49d-23eda67e67f2 with identifier: GX57450
2026-03-30 07:39:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8b550bd-80a1-55f6-b49d-23eda67e67f2 with identifier: GX57450 to the API
2026-03-30 07:39:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-31T15:33:29Z',
 'fuel_type': 'diesel',
 'id': 'f8b550bd-80a1-55f6-b49d-23eda67e67f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX57450',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 128924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-01',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX57450%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [auto1.de] INFO: Saving data for GX57450: {'auction_closing_time': 1774971209.0, 'created_time': 1774350790.675138, 'last_price_update_time': 1774856378.136267}
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX57450') HTTP/1.1" 204 0
2026-03-30 07:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC76519> (referer: https://www.auto1.com/v1/car-details-view/VC76519/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: ZW22441
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22441%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [auto1.de] INFO: Scrape type for ZW22441: 1
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: ZW22441
2026-03-30 07:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_c1732b8a3438176ce1ee9149891d90f3.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_ab28bef27a73cb159ea69ad343c02fb8.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2e8e947724f2014f7491d1092e03b0be.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_ff2e133c598a4a56621678408b6ee220.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: VS99519
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: FR72780
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR72780%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [auto1.de] INFO: Scrape type for FR72780: 2
2026-03-30 07:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95f5ba30-c955-51c1-8002-569a7b5664c9 with identifier: FR72780
2026-03-30 07:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95f5ba30-c955-51c1-8002-569a7b5664c9 with scrape type 2
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95f5ba30-c955-51c1-8002-569a7b5664c9 with scrape type 2
2026-03-30 07:39:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95f5ba30-c955-51c1-8002-569a7b5664c9, identifier: FR72780
2026-03-30 07:39:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95f5ba30-c955-51c1-8002-569a7b5664c9 with identifier: FR72780
2026-03-30 07:39:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95f5ba30-c955-51c1-8002-569a7b5664c9 with identifier: FR72780
2026-03-30 07:39:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95f5ba30-c955-51c1-8002-569a7b5664c9 with identifier: FR72780 to the API
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:49:57Z',
 'fuel_type': 'diesel',
 'id': '95f5ba30-c955-51c1-8002-569a7b5664c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR72780',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 279557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-10',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 316 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR72780%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [auto1.de] INFO: Saving data for FR72780: {'auction_closing_time': 1774972197.0, 'created_time': 1774381207.235093, 'last_price_update_time': 1774856378.62222}
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR72780') HTTP/1.1" 204 0
2026-03-30 07:39:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 358ceb06-d387-54f2-b8fb-529a39adc924 with identifier: AF40953
2026-03-30 07:39:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 358ceb06-d387-54f2-b8fb-529a39adc924 with scrape type 1
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 358ceb06-d387-54f2-b8fb-529a39adc924
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fd8%252F2dd81cd33337e7234c5468e44a72425c%252Fpa%252FAF40953_7aa3a2eab9896ae81137809681308051.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_7aa3a2eab9896ae81137809681308051.jpg already downloaded
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fd8%252F2dd81cd33337e7234c5468e44a72425c%252Fpa%252FAF40953_28f14bc7bf5f594750ebb19a28dbe4b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_28f14bc7bf5f594750ebb19a28dbe4b6.jpg already downloaded
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fd8%252F2dd81cd33337e7234c5468e44a72425c%252Fpa%252FAF40953_23c908186d72dfde1996588e85ecab1b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_23c908186d72dfde1996588e85ecab1b.jpg already downloaded
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fd8%252F2dd81cd33337e7234c5468e44a72425c%252Fpa%252FAF40953_2c3fd38f823738ff0d80200dee5e3c81.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_2c3fd38f823738ff0d80200dee5e3c81.jpg already downloaded
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fd8%252F2dd81cd33337e7234c5468e44a72425c%252Fpa%252FAF40953_4dd8cb3b4ef88237b281f4d71517ab33.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_4dd8cb3b4ef88237b281f4d71517ab33.jpg already downloaded
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fd8%252F2dd81cd33337e7234c5468e44a72425c%252Fpa%252FAF40953_88cfa698fd2117c0ca3489ac3624d074.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_88cfa698fd2117c0ca3489ac3624d074.jpg already downloaded
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fd8%252F2dd81cd33337e7234c5468e44a72425c%252Fpa%252FAF40953_8d60d535a7c13b16d9f650aee93d37c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_8d60d535a7c13b16d9f650aee93d37c1.jpg already downloaded
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fd8%252F2dd81cd33337e7234c5468e44a72425c%252Fpa%252FAF40953_30d89cdb71cb666afb11fd6960d02e27.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_30d89cdb71cb666afb11fd6960d02e27.jpg already downloaded
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fd8%252F2dd81cd33337e7234c5468e44a72425c%252Fpa%252FAF40953_daf46b56123fdfb6f87f519fe91342e8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_daf46b56123fdfb6f87f519fe91342e8.jpg already downloaded
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg2d%252Fd8%252F2dd81cd33337e7234c5468e44a72425c%252Fpa%252FAF40953_3f144554409b26acc73cae31867ebe9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_3f144554409b26acc73cae31867ebe9f.jpg already downloaded
2026-03-30 07:39:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 358ceb06-d387-54f2-b8fb-529a39adc924, identifier: AF40953
2026-03-30 07:39:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_475d7df922815037328629445aad8c2c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: ZS81921
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: YR18351
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: BP99192
2026-03-30 07:39:38 [auto1.de] INFO: Found listing with ID: TK82535
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK82535%27 HTTP/1.1" 200 None
2026-03-30 07:39:38 [auto1.de] INFO: Scrape type for TK82535: 1
2026-03-30 07:39:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 358ceb06-d387-54f2-b8fb-529a39adc924 with identifier: AF40953
2026-03-30 07:39:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 358ceb06-d387-54f2-b8fb-529a39adc924 with identifier: AF40953
2026-03-30 07:39:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 358ceb06-d387-54f2-b8fb-529a39adc924 with identifier: AF40953 to the API
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AF40953>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:02:13Z',
 'fuel_type': 'petrol',
 'id': '358ceb06-d387-54f2-b8fb-529a39adc924',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF40953',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 143900,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_7aa3a2eab9896ae81137809681308051.jpg',
                'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_28f14bc7bf5f594750ebb19a28dbe4b6.jpg',
                'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_23c908186d72dfde1996588e85ecab1b.jpg',
                'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_2c3fd38f823738ff0d80200dee5e3c81.jpg',
                'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_4dd8cb3b4ef88237b281f4d71517ab33.jpg',
                'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_88cfa698fd2117c0ca3489ac3624d074.jpg',
                'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_8d60d535a7c13b16d9f650aee93d37c1.jpg',
                'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_30d89cdb71cb666afb11fd6960d02e27.jpg',
                'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_daf46b56123fdfb6f87f519fe91342e8.jpg',
                'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_3f144554409b26acc73cae31867ebe9f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358ceb06-d387-54f2-b8fb-529a39adc924/358ceb06-d387-54f2-b8fb-529a39adc924_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69223,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_7aa3a2eab9896ae81137809681308051.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358ceb06-d387-54f2-b8fb-529a39adc924/358ceb06-d387-54f2-b8fb-529a39adc924_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2353357,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_28f14bc7bf5f594750ebb19a28dbe4b6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358ceb06-d387-54f2-b8fb-529a39adc924/358ceb06-d387-54f2-b8fb-529a39adc924_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66966,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_23c908186d72dfde1996588e85ecab1b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358ceb06-d387-54f2-b8fb-529a39adc924/358ceb06-d387-54f2-b8fb-529a39adc924_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2279974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_2c3fd38f823738ff0d80200dee5e3c81.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358ceb06-d387-54f2-b8fb-529a39adc924/358ceb06-d387-54f2-b8fb-529a39adc924_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_4dd8cb3b4ef88237b281f4d71517ab33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358ceb06-d387-54f2-b8fb-529a39adc924/358ceb06-d387-54f2-b8fb-529a39adc924_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469780,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_88cfa698fd2117c0ca3489ac3624d074.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358ceb06-d387-54f2-b8fb-529a39adc924/358ceb06-d387-54f2-b8fb-529a39adc924_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2401805,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_8d60d535a7c13b16d9f650aee93d37c1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358ceb06-d387-54f2-b8fb-529a39adc924/358ceb06-d387-54f2-b8fb-529a39adc924_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522757,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_30d89cdb71cb666afb11fd6960d02e27.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358ceb06-d387-54f2-b8fb-529a39adc924/358ceb06-d387-54f2-b8fb-529a39adc924_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_daf46b56123fdfb6f87f519fe91342e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_358ceb06-d387-54f2-b8fb-529a39adc924/358ceb06-d387-54f2-b8fb-529a39adc924_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74726,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img2d/d8/2dd81cd33337e7234c5468e44a72425c/pa/AF40953_3f144554409b26acc73cae31867ebe9f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-04-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF40953%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [auto1.de] INFO: Saving data for AF40953: {'created_time': 1774856379.29796, 'last_price_update_time': 1774856379.29797, 'auction_closing_time': 1774969333.0}
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF40953') HTTP/1.1" 204 0
2026-03-30 07:39:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b7d2c33-f438-54e4-b1c9-3230407850c6 with identifier: VC76519
2026-03-30 07:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b7d2c33-f438-54e4-b1c9-3230407850c6 with scrape type 1
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b7d2c33-f438-54e4-b1c9-3230407850c6
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc0%252Fcfc07eca8f61351f32c3baa3662ef7a3%252Fpa%252FVC76519_2d49f454afb7f544076301a63c26ad3a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_2d49f454afb7f544076301a63c26ad3a.jpg already downloaded
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc0%252Fcfc07eca8f61351f32c3baa3662ef7a3%252Fpa%252FVC76519_96f15affa15faa1a87871344999684c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_96f15affa15faa1a87871344999684c6.jpg already downloaded
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc0%252Fcfc07eca8f61351f32c3baa3662ef7a3%252Fpa%252FVC76519_9a79154e0124d7c9d3af24d277979214.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_9a79154e0124d7c9d3af24d277979214.jpg already downloaded
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc0%252Fcfc07eca8f61351f32c3baa3662ef7a3%252Fpa%252FVC76519_f2ae8988a027a0afc7be7027f264da5a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_f2ae8988a027a0afc7be7027f264da5a.jpg already downloaded
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc0%252Fcfc07eca8f61351f32c3baa3662ef7a3%252Fpa%252FVC76519_41a7e4b9555cd29ac6fb12d7c414057e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_41a7e4b9555cd29ac6fb12d7c414057e.jpg already downloaded
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc0%252Fcfc07eca8f61351f32c3baa3662ef7a3%252Fpa%252FVC76519_9cddc0428c22b7aff292624acdfd2958.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_9cddc0428c22b7aff292624acdfd2958.jpg already downloaded
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc0%252Fcfc07eca8f61351f32c3baa3662ef7a3%252Fpa%252FVC76519_d6dc1daf084fd752de054f3a964fde8d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_d6dc1daf084fd752de054f3a964fde8d.jpg already downloaded
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc0%252Fcfc07eca8f61351f32c3baa3662ef7a3%252Fpa%252FVC76519_587074bba6ef07ef9ba75c3c002995ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_587074bba6ef07ef9ba75c3c002995ef.jpg already downloaded
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc0%252Fcfc07eca8f61351f32c3baa3662ef7a3%252Fpa%252FVC76519_a5b5bf857d5f0ea2ba129986f2dd1352.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_a5b5bf857d5f0ea2ba129986f2dd1352.jpg already downloaded
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252Fc0%252Fcfc07eca8f61351f32c3baa3662ef7a3%252Fpa%252FVC76519_3c7f6d8a8ee3f9e76c4107350146fba3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_3c7f6d8a8ee3f9e76c4107350146fba3.jpg already downloaded
2026-03-30 07:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b7d2c33-f438-54e4-b1c9-3230407850c6, identifier: VC76519
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d210c290>
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_08a06a52-b3f0-5bb2-b212-c84f0121206a/08a06a52-b3f0-5bb2-b212-c84f0121206a_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F25%252F4c25c998474c02dbfeb3ceec13327c37%252Fpa%252FPV47102_c1732b8a3438176ce1ee9149891d90f3.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_c1732b8a3438176ce1ee9149891d90f3.jpg saved to cache
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 08a06a52-b3f0-5bb2-b212-c84f0121206a
2026-03-30 07:39:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 08a06a52-b3f0-5bb2-b212-c84f0121206a, skipping ID generation
2026-03-30 07:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a06a52-b3f0-5bb2-b212-c84f0121206a with scrape type 1
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 08a06a52-b3f0-5bb2-b212-c84f0121206a sending to next pipeline
2026-03-30 07:39:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 08a06a52-b3f0-5bb2-b212-c84f0121206a, identifier: PV47102
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22f9d10>
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_ab28bef27a73cb159ea69ad343c02fb8.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_ab28bef27a73cb159ea69ad343c02fb8.jpg saved to cache
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item eb0a979a-46d4-5ea3-b933-f5995402facf
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d22f8390>
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_2e8e947724f2014f7491d1092e03b0be.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2e8e947724f2014f7491d1092e03b0be.jpg saved to cache
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eb0a979a-46d4-5ea3-b933-f5995402facf
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2127990>
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252Fda%252F52dac410ff7beab10e28b871f8b0395e%252Fpa%252FRS49275_ff2e133c598a4a56621678408b6ee220.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_ff2e133c598a4a56621678408b6ee220.jpg saved to cache
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item eb0a979a-46d4-5ea3-b933-f5995402facf
2026-03-30 07:39:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb0a979a-46d4-5ea3-b933-f5995402facf, skipping ID generation
2026-03-30 07:39:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb0a979a-46d4-5ea3-b933-f5995402facf with scrape type 1
2026-03-30 07:39:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb0a979a-46d4-5ea3-b933-f5995402facf sending to next pipeline
2026-03-30 07:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb0a979a-46d4-5ea3-b933-f5995402facf, identifier: RS49275
2026-03-30 07:39:40 [auto1.de] INFO: Found listing with ID: SR73766
2026-03-30 07:39:40 [auto1.de] INFO: Found listing with ID: NR41937
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR41937%27 HTTP/1.1" 200 None
2026-03-30 07:39:40 [auto1.de] INFO: Scrape type for NR41937: 2
2026-03-30 07:39:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44c7ca41-da53-5562-9f1d-0a6ae6d7e885 with identifier: NR41937
2026-03-30 07:39:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c7ca41-da53-5562-9f1d-0a6ae6d7e885 with scrape type 2
2026-03-30 07:39:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44c7ca41-da53-5562-9f1d-0a6ae6d7e885 with scrape type 2
2026-03-30 07:39:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44c7ca41-da53-5562-9f1d-0a6ae6d7e885, identifier: NR41937
2026-03-30 07:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b7d2c33-f438-54e4-b1c9-3230407850c6 with identifier: VC76519
2026-03-30 07:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b7d2c33-f438-54e4-b1c9-3230407850c6 with identifier: VC76519
2026-03-30 07:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b7d2c33-f438-54e4-b1c9-3230407850c6 with identifier: VC76519 to the API
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VC76519>
{'auction_title': '',
 'c_o_2_emission_value': 192,
 'category': 'Rental',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:43:07Z',
 'fuel_type': 'petrol',
 'id': '0b7d2c33-f438-54e4-b1c9-3230407850c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC76519',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 40333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_2d49f454afb7f544076301a63c26ad3a.jpg',
                'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_96f15affa15faa1a87871344999684c6.jpg',
                'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_9a79154e0124d7c9d3af24d277979214.jpg',
                'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_f2ae8988a027a0afc7be7027f264da5a.jpg',
                'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_41a7e4b9555cd29ac6fb12d7c414057e.jpg',
                'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_9cddc0428c22b7aff292624acdfd2958.jpg',
                'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_d6dc1daf084fd752de054f3a964fde8d.jpg',
                'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_587074bba6ef07ef9ba75c3c002995ef.jpg',
                'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_a5b5bf857d5f0ea2ba129986f2dd1352.jpg',
                'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_3c7f6d8a8ee3f9e76c4107350146fba3.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7d2c33-f438-54e4-b1c9-3230407850c6/0b7d2c33-f438-54e4-b1c9-3230407850c6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_2d49f454afb7f544076301a63c26ad3a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7d2c33-f438-54e4-b1c9-3230407850c6/0b7d2c33-f438-54e4-b1c9-3230407850c6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65059,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_96f15affa15faa1a87871344999684c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7d2c33-f438-54e4-b1c9-3230407850c6/0b7d2c33-f438-54e4-b1c9-3230407850c6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_9a79154e0124d7c9d3af24d277979214.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7d2c33-f438-54e4-b1c9-3230407850c6/0b7d2c33-f438-54e4-b1c9-3230407850c6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_f2ae8988a027a0afc7be7027f264da5a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7d2c33-f438-54e4-b1c9-3230407850c6/0b7d2c33-f438-54e4-b1c9-3230407850c6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_41a7e4b9555cd29ac6fb12d7c414057e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7d2c33-f438-54e4-b1c9-3230407850c6/0b7d2c33-f438-54e4-b1c9-3230407850c6_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_9cddc0428c22b7aff292624acdfd2958.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7d2c33-f438-54e4-b1c9-3230407850c6/0b7d2c33-f438-54e4-b1c9-3230407850c6_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63741,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_d6dc1daf084fd752de054f3a964fde8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7d2c33-f438-54e4-b1c9-3230407850c6/0b7d2c33-f438-54e4-b1c9-3230407850c6_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65659,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_587074bba6ef07ef9ba75c3c002995ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7d2c33-f438-54e4-b1c9-3230407850c6/0b7d2c33-f438-54e4-b1c9-3230407850c6_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_a5b5bf857d5f0ea2ba129986f2dd1352.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b7d2c33-f438-54e4-b1c9-3230407850c6/0b7d2c33-f438-54e4-b1c9-3230407850c6_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78455,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/c0/cfc07eca8f61351f32c3baa3662ef7a3/pa/VC76519_3c7f6d8a8ee3f9e76c4107350146fba3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-07',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TSI Xperience 4Drive',
 'transmission': 'automatic',
 'trim': 'Xperience 4Drive',
 'year': 2023}
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC76519%27 HTTP/1.1" 200 None
2026-03-30 07:39:40 [auto1.de] INFO: Saving data for VC76519: {'created_time': 1774856380.535752, 'last_price_update_time': 1774856380.535769, 'auction_closing_time': 1774971787.0}
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC76519') HTTP/1.1" 204 0
2026-03-30 07:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 08a06a52-b3f0-5bb2-b212-c84f0121206a with identifier: PV47102
2026-03-30 07:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 08a06a52-b3f0-5bb2-b212-c84f0121206a with identifier: PV47102
2026-03-30 07:39:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 08a06a52-b3f0-5bb2-b212-c84f0121206a with identifier: PV47102 to the API
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_c1732b8a3438176ce1ee9149891d90f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:08:57Z',
 'fuel_type': 'petrol',
 'id': '08a06a52-b3f0-5bb2-b212-c84f0121206a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV47102',
 'listing': 'auction',
 'location': 'DE, Leipzig',
 'make': 'Mitsubishi',
 'model': 'Colt',
 'odometer': 68146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a06a52-b3f0-5bb2-b212-c84f0121206a/08a06a52-b3f0-5bb2-b212-c84f0121206a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_13cb6cab7266d48437c70162b4765a14.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a06a52-b3f0-5bb2-b212-c84f0121206a/08a06a52-b3f0-5bb2-b212-c84f0121206a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_97fb0d38c83adff6baf4f9613c7b9a5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a06a52-b3f0-5bb2-b212-c84f0121206a/08a06a52-b3f0-5bb2-b212-c84f0121206a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79935,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_767f9bbfcc84fb8feb1a065d08a8417f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a06a52-b3f0-5bb2-b212-c84f0121206a/08a06a52-b3f0-5bb2-b212-c84f0121206a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68683,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_c1732b8a3438176ce1ee9149891d90f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_08a06a52-b3f0-5bb2-b212-c84f0121206a/08a06a52-b3f0-5bb2-b212-c84f0121206a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/25/4c25c998474c02dbfeb3ceec13327c37/pa/PV47102_07b6b834f50d90c71716fc909c4b9861.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Colt 1.3 Inform',
 'transmission': 'manual',
 'trim': 'Inform',
 'year': 2005}
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV47102%27 HTTP/1.1" 200 None
2026-03-30 07:39:40 [auto1.de] INFO: Saving data for PV47102: {'created_time': 1774856380.960294, 'last_price_update_time': 1774856380.96031, 'auction_closing_time': 1774969737.0}
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV47102') HTTP/1.1" 204 0
2026-03-30 07:39:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb0a979a-46d4-5ea3-b933-f5995402facf with identifier: RS49275
2026-03-30 07:39:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb0a979a-46d4-5ea3-b933-f5995402facf with identifier: RS49275
2026-03-30 07:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb0a979a-46d4-5ea3-b933-f5995402facf with identifier: RS49275 to the API
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_ff2e133c598a4a56621678408b6ee220.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:14:13Z',
 'fuel_type': 'diesel',
 'id': 'eb0a979a-46d4-5ea3-b933-f5995402facf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS49275',
 'listing': 'auction',
 'location': 'DE, Kassel',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 193383,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81014,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_e5f5216625d436623bc318a386f0a762.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83214,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2a1fe766f51bf499a17621b6d8b26615.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_4965357b8b34b61fba773ddb93a37e07.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2721a0cafed2efb5760c2da3b06a6d4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69914,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_0e132b30eb02552e325deba65870f767.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_1ad420b7cb612d62533ccbccd7cf845c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_369367569b9de78bdb7b3a44dbc14fd8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_2e8e947724f2014f7491d1092e03b0be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82696,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_ff2e133c598a4a56621678408b6ee220.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb0a979a-46d4-5ea3-b933-f5995402facf/eb0a979a-46d4-5ea3-b933-f5995402facf_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66518,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/da/52dac410ff7beab10e28b871f8b0395e/pa/RS49275_ab28bef27a73cb159ea69ad343c02fb8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-07-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 R-Design',
 'transmission': 'automatic',
 'trim': 'R-Design',
 'year': 2019}
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS49275%27 HTTP/1.1" 200 None
2026-03-30 07:39:41 [auto1.de] INFO: Saving data for RS49275: {'created_time': 1774856381.392982, 'last_price_update_time': 1774856381.392992, 'auction_closing_time': 1774970053.0}
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS49275') HTTP/1.1" 204 0
2026-03-30 07:39:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44c7ca41-da53-5562-9f1d-0a6ae6d7e885 with identifier: NR41937
2026-03-30 07:39:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44c7ca41-da53-5562-9f1d-0a6ae6d7e885 with identifier: NR41937
2026-03-30 07:39:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44c7ca41-da53-5562-9f1d-0a6ae6d7e885 with identifier: NR41937 to the API
2026-03-30 07:39:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-31T15:24:02Z',
 'fuel_type': 'petrol',
 'id': '44c7ca41-da53-5562-9f1d-0a6ae6d7e885',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR41937',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 21151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-13',
 'seller_name': None,
 'title': 'MINI Cooper S Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2023}
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR41937%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Saving data for NR41937: {'auction_closing_time': 1774970642.0, 'created_time': 1774349527.094226, 'last_price_update_time': 1774856382.251558}
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR41937') HTTP/1.1" 204 0
2026-03-30 07:39:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-30 07:39:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:39:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d21236d0>
2026-03-30 07:39:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:39:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F47%252Fd547c26d95f95dfc47f7fe7ec04a5cdf%252Fpa%252FGG93073_475d7df922815037328629445aad8c2c.jpg') HTTP/1.1" 204 0
2026-03-30 07:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_475d7df922815037328629445aad8c2c.jpg saved to cache
2026-03-30 07:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5
2026-03-30 07:39:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc9ec621-6506-5aae-9037-bc7cb6a4f2d5, skipping ID generation
2026-03-30 07:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5 with scrape type 1
2026-03-30 07:39:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc9ec621-6506-5aae-9037-bc7cb6a4f2d5 sending to next pipeline
2026-03-30 07:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc9ec621-6506-5aae-9037-bc7cb6a4f2d5, identifier: GG93073
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: JD16678
2026-03-30 07:39:42 [auto1.de] INFO: Found listing with ID: DP71871
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP71871%27 HTTP/1.1" 200 None
2026-03-30 07:39:42 [auto1.de] INFO: Scrape type for DP71871: 2
2026-03-30 07:39:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0e10c74-5b13-503e-8bce-b8752bbf4f18 with identifier: DP71871
2026-03-30 07:39:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0e10c74-5b13-503e-8bce-b8752bbf4f18 with scrape type 2
2026-03-30 07:39:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0e10c74-5b13-503e-8bce-b8752bbf4f18 with scrape type 2
2026-03-30 07:39:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0e10c74-5b13-503e-8bce-b8752bbf4f18, identifier: DP71871
2026-03-30 07:39:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc9ec621-6506-5aae-9037-bc7cb6a4f2d5 with identifier: GG93073
2026-03-30 07:39:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc9ec621-6506-5aae-9037-bc7cb6a4f2d5 with identifier: GG93073
2026-03-30 07:39:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc9ec621-6506-5aae-9037-bc7cb6a4f2d5 with identifier: GG93073 to the API
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_475d7df922815037328629445aad8c2c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'engine_horse_power': 286,
 'expiration_date': '2026-03-31T15:34:50Z',
 'fuel_type': 'diesel',
 'id': 'cc9ec621-6506-5aae-9037-bc7cb6a4f2d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG93073',
 'listing': 'auction',
 'location': 'DE, Kiel',
 'make': 'BMW',
 'model': '5er',
 'odometer': 23714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100697,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_286f5f4bbdf943b771ca9684e3e3cac5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_56b54346a7fc1000d2eb7fd96dcbb4f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3134172,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_2802ea5f4e0908fe9e82e7bc8633b21f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3250154,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_07936b7749f17a9162c07402bb3d46d1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99232,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_f152e36e4ccc72cef4a8ee35f601a2f0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2682844,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_bf29e7698b8ea476022c4701205a4afd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_520b43b9a0386255e33456a95d394d6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2594564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_3c166f180cd06cbd6d8b185068671990.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_0fc35b1666070a1e9886670f1da3258f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc9ec621-6506-5aae-9037-bc7cb6a4f2d5/cc9ec621-6506-5aae-9037-bc7cb6a4f2d5_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3180328,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/47/d547c26d95f95dfc47f7fe7ec04a5cdf/pa/GG93073_475d7df922815037328629445aad8c2c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2023-08-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530d Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2023}
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG93073%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Saving data for GG93073: {'created_time': 1774856383.033391, 'last_price_update_time': 1774856383.033405, 'auction_closing_time': 1774971290.0}
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG93073') HTTP/1.1" 204 0
2026-03-30 07:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0e10c74-5b13-503e-8bce-b8752bbf4f18 with identifier: DP71871
2026-03-30 07:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0e10c74-5b13-503e-8bce-b8752bbf4f18 with identifier: DP71871
2026-03-30 07:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0e10c74-5b13-503e-8bce-b8752bbf4f18 with identifier: DP71871 to the API
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:23:51Z',
 'fuel_type': 'diesel',
 'id': 'c0e10c74-5b13-503e-8bce-b8752bbf4f18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP71871',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 330216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-25',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP71871%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Saving data for DP71871: {'auction_closing_time': 1774970631.0, 'created_time': 1774349308.009549, 'last_price_update_time': 1774856383.400193}
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP71871') HTTP/1.1" 204 0
2026-03-30 07:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZM27094> (referer: https://www.auto1.com/v1/car-details-view/ZM27094/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST24513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VV18496> (referer: https://www.auto1.com/v1/car-details-view/VV18496/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: PC52157
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: YL08953
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL08953%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for YL08953: 1
2026-03-30 07:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS05467> (referer: https://www.auto1.com/v1/car-details-view/SS05467/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: RS18612
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS18612%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for RS18612: 1
2026-03-30 07:39:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: AB94973
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: VL32137
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL32137%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for VL32137: 2
2026-03-30 07:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43048aa0-cb7e-5568-9893-2b17be137692 with identifier: VL32137
2026-03-30 07:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43048aa0-cb7e-5568-9893-2b17be137692 with scrape type 2
2026-03-30 07:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43048aa0-cb7e-5568-9893-2b17be137692 with scrape type 2
2026-03-30 07:39:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43048aa0-cb7e-5568-9893-2b17be137692, identifier: VL32137
2026-03-30 07:39:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43048aa0-cb7e-5568-9893-2b17be137692 with identifier: VL32137
2026-03-30 07:39:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43048aa0-cb7e-5568-9893-2b17be137692 with identifier: VL32137
2026-03-30 07:39:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43048aa0-cb7e-5568-9893-2b17be137692 with identifier: VL32137 to the API
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:55:47Z',
 'fuel_type': 'diesel',
 'id': '43048aa0-cb7e-5568-9893-2b17be137692',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL32137',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 201922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-26',
 'seller_name': None,
 'title': 'Citroen C3 1.6 Blue-HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL32137%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Saving data for VL32137: {'auction_closing_time': 1774972547.0, 'created_time': 1773429385.673649, 'last_price_update_time': 1774856383.914119}
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL32137') HTTP/1.1" 204 0
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: DB97906
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB97906%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for DB97906: 1
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: DZ46114
2026-03-30 07:39:43 [auto1.de] INFO: Found listing with ID: ZL58365
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL58365%27 HTTP/1.1" 200 None
2026-03-30 07:39:43 [auto1.de] INFO: Scrape type for ZL58365: 2
2026-03-30 07:39:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 979998c2-e9d6-58b8-b5e6-e06ac85b7056 with identifier: ZL58365
2026-03-30 07:39:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 979998c2-e9d6-58b8-b5e6-e06ac85b7056 with scrape type 2
2026-03-30 07:39:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 979998c2-e9d6-58b8-b5e6-e06ac85b7056 with scrape type 2
2026-03-30 07:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 979998c2-e9d6-58b8-b5e6-e06ac85b7056, identifier: ZL58365
2026-03-30 07:39:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 979998c2-e9d6-58b8-b5e6-e06ac85b7056 with identifier: ZL58365
2026-03-30 07:39:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 979998c2-e9d6-58b8-b5e6-e06ac85b7056 with identifier: ZL58365
2026-03-30 07:39:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 979998c2-e9d6-58b8-b5e6-e06ac85b7056 with identifier: ZL58365 to the API
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 99,
 'expiration_date': '2026-03-31T15:44:03Z',
 'fuel_type': 'petrol',
 'id': '979998c2-e9d6-58b8-b5e6-e06ac85b7056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL58365',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 82386,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-31',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 YES!',
 'transmission': 'manual',
 'trim': 'YES!',
 'year': 2020}
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL58365%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [auto1.de] INFO: Saving data for ZL58365: {'auction_closing_time': 1774971843.0, 'created_time': 1774637269.305047, 'last_price_update_time': 1774856384.446853}
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZL58365') HTTP/1.1" 204 0
2026-03-30 07:39:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5231ddac-58b5-5009-905f-54e686940b71 with identifier: ZM27094
2026-03-30 07:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5231ddac-58b5-5009-905f-54e686940b71 with scrape type 1
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5231ddac-58b5-5009-905f-54e686940b71
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F72%252F4c7232d257ef58e98360d81c97383d79%252Fpa%252FZM27094_0df6ddbaf1b30fb27d5fad21fde53978.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_0df6ddbaf1b30fb27d5fad21fde53978.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F72%252F4c7232d257ef58e98360d81c97383d79%252Fpa%252FZM27094_cdec8de38c30d5a2b275b403d3f0ec04.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_cdec8de38c30d5a2b275b403d3f0ec04.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F72%252F4c7232d257ef58e98360d81c97383d79%252Fpa%252FZM27094_170e417c287de7a8ef947532a142cbc9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_170e417c287de7a8ef947532a142cbc9.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F72%252F4c7232d257ef58e98360d81c97383d79%252Fpa%252FZM27094_d7ecdfe1422410dcff4fd0742594f12a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_d7ecdfe1422410dcff4fd0742594f12a.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F72%252F4c7232d257ef58e98360d81c97383d79%252Fpa%252FZM27094_4de79befe6bc9c3c69bcfbd16722ed2b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_4de79befe6bc9c3c69bcfbd16722ed2b.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F72%252F4c7232d257ef58e98360d81c97383d79%252Fpa%252FZM27094_40f9d54b354dfa6a0b8600fa6f8e8bdf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_40f9d54b354dfa6a0b8600fa6f8e8bdf.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F72%252F4c7232d257ef58e98360d81c97383d79%252Fpa%252FZM27094_24a6f811c86639051ce9c29e7ac952d3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_24a6f811c86639051ce9c29e7ac952d3.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F72%252F4c7232d257ef58e98360d81c97383d79%252Fpa%252FZM27094_265af7bc8d9790ebd3c7b9350bac7685.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_265af7bc8d9790ebd3c7b9350bac7685.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F72%252F4c7232d257ef58e98360d81c97383d79%252Fpa%252FZM27094_0e17a0380d514fd1661c0624f6fee10f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_0e17a0380d514fd1661c0624f6fee10f.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4c%252F72%252F4c7232d257ef58e98360d81c97383d79%252Fpa%252FZM27094_b04cb8bd52d01439f510036ef0426bd4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_b04cb8bd52d01439f510036ef0426bd4.jpg already downloaded
2026-03-30 07:39:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5231ddac-58b5-5009-905f-54e686940b71, identifier: ZM27094
2026-03-30 07:39:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7 with identifier: VV18496
2026-03-30 07:39:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7 with scrape type 1
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F35%252Ff2350cb195463f573ef0fa8637e43844%252Fpa%252FVV18496_ce01312d7169c9db76d0df3751f37f83.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_ce01312d7169c9db76d0df3751f37f83.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F35%252Ff2350cb195463f573ef0fa8637e43844%252Fpa%252FVV18496_31c0cab169155e4bffb87a46fe689df6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_31c0cab169155e4bffb87a46fe689df6.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F35%252Ff2350cb195463f573ef0fa8637e43844%252Fpa%252FVV18496_3c9a93d3d5e550f934bc7c6c2a69accd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_3c9a93d3d5e550f934bc7c6c2a69accd.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F35%252Ff2350cb195463f573ef0fa8637e43844%252Fpa%252FVV18496_4b9001e0977022c8447dc58377fb11fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_4b9001e0977022c8447dc58377fb11fb.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F35%252Ff2350cb195463f573ef0fa8637e43844%252Fpa%252FVV18496_971f1e22cba8ea059eeba6668f8411f6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_971f1e22cba8ea059eeba6668f8411f6.jpg already downloaded
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf2%252F35%252Ff2350cb195463f573ef0fa8637e43844%252Fpa%252FVV18496_9dba0bffb2f352161eaae1179794d232.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_9dba0bffb2f352161eaae1179794d232.jpg already downloaded
2026-03-30 07:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7, identifier: VV18496
2026-03-30 07:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a4c8d7b-1793-5f03-bc7b-84f19bb99d43 with identifier: SS05467
2026-03-30 07:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a4c8d7b-1793-5f03-bc7b-84f19bb99d43 with scrape type 1
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2a4c8d7b-1793-5f03-bc7b-84f19bb99d43
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F7b%252Fda7b5fa4f9c930e47b80e251fa0cd9cc%252Fpa%252FSS05467_6ee45e4a276d28817517f979bf514cdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_6ee45e4a276d28817517f979bf514cdc.jpg already downloaded
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F7b%252Fda7b5fa4f9c930e47b80e251fa0cd9cc%252Fpa%252FSS05467_6c3dbcdf950d667ab1faaa4dbead4b58.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_6c3dbcdf950d667ab1faaa4dbead4b58.jpg already downloaded
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F7b%252Fda7b5fa4f9c930e47b80e251fa0cd9cc%252Fpa%252FSS05467_a0a77310f9b3bb3d55a953a2a5ab99fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_a0a77310f9b3bb3d55a953a2a5ab99fe.jpg already downloaded
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F7b%252Fda7b5fa4f9c930e47b80e251fa0cd9cc%252Fpa%252FSS05467_508a8a04aa7fa4726e3e07e76e941abb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_508a8a04aa7fa4726e3e07e76e941abb.jpg already downloaded
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F7b%252Fda7b5fa4f9c930e47b80e251fa0cd9cc%252Fpa%252FSS05467_f862cbca42e488df72952dcee1f706a0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_f862cbca42e488df72952dcee1f706a0.jpg already downloaded
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F7b%252Fda7b5fa4f9c930e47b80e251fa0cd9cc%252Fpa%252FSS05467_31442c0d5aa14abd62fa33070a6c43e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_31442c0d5aa14abd62fa33070a6c43e6.jpg already downloaded
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F7b%252Fda7b5fa4f9c930e47b80e251fa0cd9cc%252Fpa%252FSS05467_de0ee71d4965ee979f616519350a1f76.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_de0ee71d4965ee979f616519350a1f76.jpg already downloaded
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F7b%252Fda7b5fa4f9c930e47b80e251fa0cd9cc%252Fpa%252FSS05467_2ff5b9b835b4303cfff3126b942c4c05.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_2ff5b9b835b4303cfff3126b942c4c05.jpg already downloaded
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F7b%252Fda7b5fa4f9c930e47b80e251fa0cd9cc%252Fpa%252FSS05467_514115eb939d131ce92e74d4f7f7c950.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_514115eb939d131ce92e74d4f7f7c950.jpg already downloaded
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgda%252F7b%252Fda7b5fa4f9c930e47b80e251fa0cd9cc%252Fpa%252FSS05467_22882273f86de6113cffc0dd7c0f3656.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_22882273f86de6113cffc0dd7c0f3656.jpg already downloaded
2026-03-30 07:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a4c8d7b-1793-5f03-bc7b-84f19bb99d43, identifier: SS05467
2026-03-30 07:39:45 [auto1.de] INFO: Channel: 24h | Page: 28 | totalHits: 7891 | hits on page: 40
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: SH12390
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: ED21052
2026-03-30 07:39:45 [auto1.de] INFO: Found listing with ID: KB70594
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB70594%27 HTTP/1.1" 200 None
2026-03-30 07:39:45 [auto1.de] INFO: Scrape type for KB70594: 2
2026-03-30 07:39:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ceaf9f5-b28d-5506-bc7e-8bd49ee6aa5f with identifier: KB70594
2026-03-30 07:39:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ceaf9f5-b28d-5506-bc7e-8bd49ee6aa5f with scrape type 2
2026-03-30 07:39:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ceaf9f5-b28d-5506-bc7e-8bd49ee6aa5f with scrape type 2
2026-03-30 07:39:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ceaf9f5-b28d-5506-bc7e-8bd49ee6aa5f, identifier: KB70594
2026-03-30 07:39:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5231ddac-58b5-5009-905f-54e686940b71 with identifier: ZM27094
2026-03-30 07:39:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5231ddac-58b5-5009-905f-54e686940b71 with identifier: ZM27094
2026-03-30 07:39:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5231ddac-58b5-5009-905f-54e686940b71 with identifier: ZM27094 to the API
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZM27094>
{'auction_title': '',
 'c_o_2_emission_value': 167,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:56:56Z',
 'fuel_type': 'petrol',
 'id': '5231ddac-58b5-5009-905f-54e686940b71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM27094',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Volkswagen',
 'model': 'Eos',
 'odometer': 164347,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_0df6ddbaf1b30fb27d5fad21fde53978.jpg',
                'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_cdec8de38c30d5a2b275b403d3f0ec04.jpg',
                'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_170e417c287de7a8ef947532a142cbc9.jpg',
                'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_d7ecdfe1422410dcff4fd0742594f12a.jpg',
                'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_4de79befe6bc9c3c69bcfbd16722ed2b.jpg',
                'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_40f9d54b354dfa6a0b8600fa6f8e8bdf.jpg',
                'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_24a6f811c86639051ce9c29e7ac952d3.jpg',
                'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_265af7bc8d9790ebd3c7b9350bac7685.jpg',
                'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_0e17a0380d514fd1661c0624f6fee10f.jpg',
                'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_b04cb8bd52d01439f510036ef0426bd4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5231ddac-58b5-5009-905f-54e686940b71/5231ddac-58b5-5009-905f-54e686940b71_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2742866,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_0df6ddbaf1b30fb27d5fad21fde53978.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5231ddac-58b5-5009-905f-54e686940b71/5231ddac-58b5-5009-905f-54e686940b71_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3060876,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_cdec8de38c30d5a2b275b403d3f0ec04.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5231ddac-58b5-5009-905f-54e686940b71/5231ddac-58b5-5009-905f-54e686940b71_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3082144,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_170e417c287de7a8ef947532a142cbc9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5231ddac-58b5-5009-905f-54e686940b71/5231ddac-58b5-5009-905f-54e686940b71_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3241033,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_d7ecdfe1422410dcff4fd0742594f12a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5231ddac-58b5-5009-905f-54e686940b71/5231ddac-58b5-5009-905f-54e686940b71_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3013648,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_4de79befe6bc9c3c69bcfbd16722ed2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5231ddac-58b5-5009-905f-54e686940b71/5231ddac-58b5-5009-905f-54e686940b71_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72255,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_40f9d54b354dfa6a0b8600fa6f8e8bdf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5231ddac-58b5-5009-905f-54e686940b71/5231ddac-58b5-5009-905f-54e686940b71_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62433,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_24a6f811c86639051ce9c29e7ac952d3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5231ddac-58b5-5009-905f-54e686940b71/5231ddac-58b5-5009-905f-54e686940b71_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_265af7bc8d9790ebd3c7b9350bac7685.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5231ddac-58b5-5009-905f-54e686940b71/5231ddac-58b5-5009-905f-54e686940b71_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68506,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_0e17a0380d514fd1661c0624f6fee10f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5231ddac-58b5-5009-905f-54e686940b71/5231ddac-58b5-5009-905f-54e686940b71_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4c/72/4c7232d257ef58e98360d81c97383d79/pa/ZM27094_b04cb8bd52d01439f510036ef0426bd4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-05-31',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volkswagen Eos 2.0 TSI Turbo',
 'transmission': 'automatic',
 'trim': 'Turbo',
 'year': 2010}
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM27094%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Saving data for ZM27094: {'created_time': 1774856386.083936, 'last_price_update_time': 1774856386.083953, 'auction_closing_time': 1774972616.0}
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM27094') HTTP/1.1" 204 0
2026-03-30 07:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7 with identifier: VV18496
2026-03-30 07:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7 with identifier: VV18496
2026-03-30 07:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7 with identifier: VV18496 to the API
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VV18496>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:34:39Z',
 'fuel_type': 'petrol',
 'id': '2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV18496',
 'listing': 'auction',
 'location': 'DE, Lüdersfeld',
 'make': 'Mazda',
 'model': '5',
 'odometer': 181993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 6,
 'photo_urls': ['https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_ce01312d7169c9db76d0df3751f37f83.jpg',
                'https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_31c0cab169155e4bffb87a46fe689df6.jpg',
                'https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_3c9a93d3d5e550f934bc7c6c2a69accd.jpg',
                'https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_4b9001e0977022c8447dc58377fb11fb.jpg',
                'https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_971f1e22cba8ea059eeba6668f8411f6.jpg',
                'https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_9dba0bffb2f352161eaae1179794d232.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7/2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_ce01312d7169c9db76d0df3751f37f83.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7/2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_31c0cab169155e4bffb87a46fe689df6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7/2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_3c9a93d3d5e550f934bc7c6c2a69accd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7/2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68765,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_4b9001e0977022c8447dc58377fb11fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7/2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_971f1e22cba8ea059eeba6668f8411f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7/2df3e3ad-e0bf-5ba8-b03d-4444c1c154e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf2/35/f2350cb195463f573ef0fa8637e43844/pa/VV18496_9dba0bffb2f352161eaae1179794d232.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-20',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Mazda 5 1.8 Kenko',
 'transmission': 'manual',
 'trim': 'Kenko',
 'year': 2014}
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV18496%27 HTTP/1.1" 200 None
2026-03-30 07:39:46 [auto1.de] INFO: Saving data for VV18496: {'created_time': 1774856386.6568, 'last_price_update_time': 1774856386.656812, 'auction_closing_time': 1774971279.0}
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV18496') HTTP/1.1" 204 0
2026-03-30 07:39:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a4c8d7b-1793-5f03-bc7b-84f19bb99d43 with identifier: SS05467
2026-03-30 07:39:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a4c8d7b-1793-5f03-bc7b-84f19bb99d43 with identifier: SS05467
2026-03-30 07:39:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a4c8d7b-1793-5f03-bc7b-84f19bb99d43 with identifier: SS05467 to the API
2026-03-30 07:39:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SS05467>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:46:09Z',
 'fuel_type': 'petrol',
 'id': '2a4c8d7b-1793-5f03-bc7b-84f19bb99d43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS05467',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 129749,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_6ee45e4a276d28817517f979bf514cdc.jpg',
                'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_6c3dbcdf950d667ab1faaa4dbead4b58.jpg',
                'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_a0a77310f9b3bb3d55a953a2a5ab99fe.jpg',
                'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_508a8a04aa7fa4726e3e07e76e941abb.jpg',
                'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_f862cbca42e488df72952dcee1f706a0.jpg',
                'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_31442c0d5aa14abd62fa33070a6c43e6.jpg',
                'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_de0ee71d4965ee979f616519350a1f76.jpg',
                'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_2ff5b9b835b4303cfff3126b942c4c05.jpg',
                'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_514115eb939d131ce92e74d4f7f7c950.jpg',
                'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_22882273f86de6113cffc0dd7c0f3656.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4c8d7b-1793-5f03-bc7b-84f19bb99d43/2a4c8d7b-1793-5f03-bc7b-84f19bb99d43_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2390238,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_6ee45e4a276d28817517f979bf514cdc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4c8d7b-1793-5f03-bc7b-84f19bb99d43/2a4c8d7b-1793-5f03-bc7b-84f19bb99d43_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2709917,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_6c3dbcdf950d667ab1faaa4dbead4b58.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4c8d7b-1793-5f03-bc7b-84f19bb99d43/2a4c8d7b-1793-5f03-bc7b-84f19bb99d43_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2192237,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_a0a77310f9b3bb3d55a953a2a5ab99fe.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4c8d7b-1793-5f03-bc7b-84f19bb99d43/2a4c8d7b-1793-5f03-bc7b-84f19bb99d43_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_508a8a04aa7fa4726e3e07e76e941abb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4c8d7b-1793-5f03-bc7b-84f19bb99d43/2a4c8d7b-1793-5f03-bc7b-84f19bb99d43_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49648,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_f862cbca42e488df72952dcee1f706a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4c8d7b-1793-5f03-bc7b-84f19bb99d43/2a4c8d7b-1793-5f03-bc7b-84f19bb99d43_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2246402,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_31442c0d5aa14abd62fa33070a6c43e6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4c8d7b-1793-5f03-bc7b-84f19bb99d43/2a4c8d7b-1793-5f03-bc7b-84f19bb99d43_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2060687,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_de0ee71d4965ee979f616519350a1f76.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4c8d7b-1793-5f03-bc7b-84f19bb99d43/2a4c8d7b-1793-5f03-bc7b-84f19bb99d43_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2416665,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_2ff5b9b835b4303cfff3126b942c4c05.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4c8d7b-1793-5f03-bc7b-84f19bb99d43/2a4c8d7b-1793-5f03-bc7b-84f19bb99d43_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_514115eb939d131ce92e74d4f7f7c950.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2a4c8d7b-1793-5f03-bc7b-84f19bb99d43/2a4c8d7b-1793-5f03-bc7b-84f19bb99d43_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2260971,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgda/7b/da7b5fa4f9c930e47b80e251fa0cd9cc/pa/SS05467_22882273f86de6113cffc0dd7c0f3656.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2015}
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS05467%27 HTTP/1.1" 200 None
2026-03-30 07:39:47 [auto1.de] INFO: Saving data for SS05467: {'created_time': 1774856387.269702, 'last_price_update_time': 1774856387.269714, 'auction_closing_time': 1774971969.0}
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS05467') HTTP/1.1" 204 0
2026-03-30 07:39:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ceaf9f5-b28d-5506-bc7e-8bd49ee6aa5f with identifier: KB70594
2026-03-30 07:39:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ceaf9f5-b28d-5506-bc7e-8bd49ee6aa5f with identifier: KB70594
2026-03-30 07:39:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ceaf9f5-b28d-5506-bc7e-8bd49ee6aa5f with identifier: KB70594 to the API
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-31T15:18:11Z',
 'fuel_type': 'diesel',
 'id': '9ceaf9f5-b28d-5506-bc7e-8bd49ee6aa5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB70594',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 265417,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-29',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 3.0 CDI lang Ambiente',
 'transmission': 'automatic',
 'trim': 'lang Ambiente',
 'year': 2009}
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB70594%27 HTTP/1.1" 200 None
2026-03-30 07:39:47 [auto1.de] INFO: Saving data for KB70594: {'auction_closing_time': 1774970291.0, 'created_time': 1773428856.646939, 'last_price_update_time': 1774856387.844553}
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KB70594') HTTP/1.1" 204 0
2026-03-30 07:39:47 [auto1.de] INFO: Found listing with ID: ZS93402
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS93402%27 HTTP/1.1" 200 None
2026-03-30 07:39:47 [auto1.de] INFO: Scrape type for ZS93402: 2
2026-03-30 07:39:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a13915ec-fb0f-5ebf-9b40-6d87dbbd1c18 with identifier: ZS93402
2026-03-30 07:39:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a13915ec-fb0f-5ebf-9b40-6d87dbbd1c18 with scrape type 2
2026-03-30 07:39:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a13915ec-fb0f-5ebf-9b40-6d87dbbd1c18 with scrape type 2
2026-03-30 07:39:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a13915ec-fb0f-5ebf-9b40-6d87dbbd1c18, identifier: ZS93402
2026-03-30 07:39:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:47 [auto1.de] INFO: Found listing with ID: JF05487
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF05487%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Scrape type for JF05487: 2
2026-03-30 07:39:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7f95bfe-3559-526f-959d-7b99edcf8a86 with identifier: JF05487
2026-03-30 07:39:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7f95bfe-3559-526f-959d-7b99edcf8a86 with scrape type 2
2026-03-30 07:39:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7f95bfe-3559-526f-959d-7b99edcf8a86 with scrape type 2
2026-03-30 07:39:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7f95bfe-3559-526f-959d-7b99edcf8a86, identifier: JF05487
2026-03-30 07:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a13915ec-fb0f-5ebf-9b40-6d87dbbd1c18 with identifier: ZS93402
2026-03-30 07:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a13915ec-fb0f-5ebf-9b40-6d87dbbd1c18 with identifier: ZS93402
2026-03-30 07:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a13915ec-fb0f-5ebf-9b40-6d87dbbd1c18 with identifier: ZS93402 to the API
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 174,
 'expiration_date': '2026-03-31T15:28:43Z',
 'fuel_type': 'diesel',
 'id': 'a13915ec-fb0f-5ebf-9b40-6d87dbbd1c18',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS93402',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 142479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-06',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2021}
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS93402%27 HTTP/1.1" 200 None
2026-03-30 07:39:48 [auto1.de] INFO: Saving data for ZS93402: {'auction_closing_time': 1774970923.0, 'created_time': 1773305211.193075, 'last_price_update_time': 1774856388.523719}
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS93402') HTTP/1.1" 204 0
2026-03-30 07:39:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT29379> (referer: https://www.auto1.com/v1/car-details-view/DT29379/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7f95bfe-3559-526f-959d-7b99edcf8a86 with identifier: JF05487
2026-03-30 07:39:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7f95bfe-3559-526f-959d-7b99edcf8a86 with identifier: JF05487
2026-03-30 07:39:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7f95bfe-3559-526f-959d-7b99edcf8a86 with identifier: JF05487 to the API
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:56:49Z',
 'fuel_type': 'diesel',
 'id': 'a7f95bfe-3559-526f-959d-7b99edcf8a86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF05487',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 210162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-03',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Spirit 4WD',
 'transmission': 'automatic',
 'trim': 'Spirit 4WD',
 'year': 2012}
2026-03-30 07:39:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF05487%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Saving data for JF05487: {'auction_closing_time': 1774972609.0, 'created_time': 1774265043.264919, 'last_price_update_time': 1774856389.002421}
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF05487') HTTP/1.1" 204 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: TS21217
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS21217%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for TS21217: 2
2026-03-30 07:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69cf12bc-16be-5106-844e-e3608d2c26a2 with identifier: TS21217
2026-03-30 07:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69cf12bc-16be-5106-844e-e3608d2c26a2 with scrape type 2
2026-03-30 07:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69cf12bc-16be-5106-844e-e3608d2c26a2 with scrape type 2
2026-03-30 07:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69cf12bc-16be-5106-844e-e3608d2c26a2, identifier: TS21217
2026-03-30 07:39:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: XE53561
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE53561%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for XE53561: 2
2026-03-30 07:39:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f28a3b0-6b0f-50e4-a35b-b2028bccf248 with identifier: XE53561
2026-03-30 07:39:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f28a3b0-6b0f-50e4-a35b-b2028bccf248 with scrape type 2
2026-03-30 07:39:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f28a3b0-6b0f-50e4-a35b-b2028bccf248 with scrape type 2
2026-03-30 07:39:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f28a3b0-6b0f-50e4-a35b-b2028bccf248, identifier: XE53561
2026-03-30 07:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69cf12bc-16be-5106-844e-e3608d2c26a2 with identifier: TS21217
2026-03-30 07:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69cf12bc-16be-5106-844e-e3608d2c26a2 with identifier: TS21217
2026-03-30 07:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69cf12bc-16be-5106-844e-e3608d2c26a2 with identifier: TS21217 to the API
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:33:41Z',
 'fuel_type': 'petrol',
 'id': '69cf12bc-16be-5106-844e-e3608d2c26a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS21217',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Primera',
 'odometer': 51829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-30',
 'seller_name': None,
 'title': 'Nissan Primera 1.8 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2002}
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS21217%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Saving data for TS21217: {'auction_closing_time': 1774971221.0, 'created_time': 1774118698.664086, 'last_price_update_time': 1774856389.587913}
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS21217') HTTP/1.1" 204 0
2026-03-30 07:39:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW22441/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f28a3b0-6b0f-50e4-a35b-b2028bccf248 with identifier: XE53561
2026-03-30 07:39:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f28a3b0-6b0f-50e4-a35b-b2028bccf248 with identifier: XE53561
2026-03-30 07:39:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f28a3b0-6b0f-50e4-a35b-b2028bccf248 with identifier: XE53561 to the API
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-31T15:53:18Z',
 'fuel_type': 'petrol',
 'id': '9f28a3b0-6b0f-50e4-a35b-b2028bccf248',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE53561',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 93872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-21',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 Comfort Plus',
 'transmission': 'automatic',
 'trim': 'Comfort Plus',
 'year': 2015}
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE53561%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Saving data for XE53561: {'auction_closing_time': 1774972398.0, 'created_time': 1773775974.800753, 'last_price_update_time': 1774856389.946577}
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE53561') HTTP/1.1" 204 0
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: VC14600
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: EN27989
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: BP13198
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: PV48618
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV48618%27 HTTP/1.1" 200 None
2026-03-30 07:39:49 [auto1.de] INFO: Scrape type for PV48618: 1
2026-03-30 07:39:49 [auto1.de] INFO: Found listing with ID: ZS93402
2026-03-30 07:39:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS93402%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [auto1.de] INFO: Scrape type for ZS93402: 0
2026-03-30 07:39:50 [auto1.de] INFO: Found listing with ID: TS21217
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS21217%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [auto1.de] INFO: Scrape type for TS21217: 0
2026-03-30 07:39:50 [auto1.de] INFO: Found listing with ID: VC14600
2026-03-30 07:39:50 [auto1.de] INFO: Found listing with ID: EN27989
2026-03-30 07:39:50 [auto1.de] INFO: Found listing with ID: BP13198
2026-03-30 07:39:50 [auto1.de] INFO: Found listing with ID: PV48618
2026-03-30 07:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL08953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4fc8267-6077-59cd-bf73-3e32366c29b7 with identifier: DT29379
2026-03-30 07:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4fc8267-6077-59cd-bf73-3e32366c29b7 with scrape type 1
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4fc8267-6077-59cd-bf73-3e32366c29b7
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fd8%252F6ad8a500de3b7c71594419583246eeb5%252Fpa%252FDT29379_00dca84f6308a3e7943cbd5e01bb131a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_00dca84f6308a3e7943cbd5e01bb131a.jpg already downloaded
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fd8%252F6ad8a500de3b7c71594419583246eeb5%252Fpa%252FDT29379_34caee83a14053c5983718db40857961.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_34caee83a14053c5983718db40857961.jpg already downloaded
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fd8%252F6ad8a500de3b7c71594419583246eeb5%252Fpa%252FDT29379_60126d034dc05586f359aeb9088ad5f2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_60126d034dc05586f359aeb9088ad5f2.jpg already downloaded
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fd8%252F6ad8a500de3b7c71594419583246eeb5%252Fpa%252FDT29379_2b500e4676b1a87ab8250a7836d98a4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_2b500e4676b1a87ab8250a7836d98a4a.jpg already downloaded
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fd8%252F6ad8a500de3b7c71594419583246eeb5%252Fpa%252FDT29379_acd6114468a3209b544eefe6e033fcbc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_acd6114468a3209b544eefe6e033fcbc.jpg already downloaded
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fd8%252F6ad8a500de3b7c71594419583246eeb5%252Fpa%252FDT29379_471b07ce914a46ac9c1a8df14fb0cd1d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_471b07ce914a46ac9c1a8df14fb0cd1d.jpg already downloaded
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fd8%252F6ad8a500de3b7c71594419583246eeb5%252Fpa%252FDT29379_f8d15de00a1c8307fc58cc0c1dbe3b61.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_f8d15de00a1c8307fc58cc0c1dbe3b61.jpg already downloaded
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fd8%252F6ad8a500de3b7c71594419583246eeb5%252Fpa%252FDT29379_7a94eac96a4d5928c736a257044be4c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_7a94eac96a4d5928c736a257044be4c0.jpg already downloaded
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fd8%252F6ad8a500de3b7c71594419583246eeb5%252Fpa%252FDT29379_df1986a5f6130d946270f96eef7751ef.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_df1986a5f6130d946270f96eef7751ef.jpg already downloaded
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6a%252Fd8%252F6ad8a500de3b7c71594419583246eeb5%252Fpa%252FDT29379_c315dd3f06e09327a862f2b0dae30401.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_c315dd3f06e09327a862f2b0dae30401.jpg already downloaded
2026-03-30 07:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4fc8267-6077-59cd-bf73-3e32366c29b7, identifier: DT29379
2026-03-30 07:39:50 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91773%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [auto1.de] INFO: Scrape type for WM91773: 2
2026-03-30 07:39:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8f7075b-5dd6-542e-9425-2824bdcd3a69 with identifier: WM91773
2026-03-30 07:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f7075b-5dd6-542e-9425-2824bdcd3a69 with scrape type 2
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8f7075b-5dd6-542e-9425-2824bdcd3a69 with scrape type 2
2026-03-30 07:39:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8f7075b-5dd6-542e-9425-2824bdcd3a69, identifier: WM91773
2026-03-30 07:39:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK82535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4fc8267-6077-59cd-bf73-3e32366c29b7 with identifier: DT29379
2026-03-30 07:39:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4fc8267-6077-59cd-bf73-3e32366c29b7 with identifier: DT29379
2026-03-30 07:39:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4fc8267-6077-59cd-bf73-3e32366c29b7 with identifier: DT29379 to the API
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DT29379>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:33:31Z',
 'fuel_type': 'diesel',
 'id': 'e4fc8267-6077-59cd-bf73-3e32366c29b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT29379',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 230801,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_00dca84f6308a3e7943cbd5e01bb131a.jpg',
                'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_34caee83a14053c5983718db40857961.jpg',
                'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_60126d034dc05586f359aeb9088ad5f2.jpg',
                'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_2b500e4676b1a87ab8250a7836d98a4a.jpg',
                'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_acd6114468a3209b544eefe6e033fcbc.jpg',
                'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_471b07ce914a46ac9c1a8df14fb0cd1d.jpg',
                'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_f8d15de00a1c8307fc58cc0c1dbe3b61.jpg',
                'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_7a94eac96a4d5928c736a257044be4c0.jpg',
                'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_df1986a5f6130d946270f96eef7751ef.jpg',
                'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_c315dd3f06e09327a862f2b0dae30401.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc8267-6077-59cd-bf73-3e32366c29b7/e4fc8267-6077-59cd-bf73-3e32366c29b7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_00dca84f6308a3e7943cbd5e01bb131a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc8267-6077-59cd-bf73-3e32366c29b7/e4fc8267-6077-59cd-bf73-3e32366c29b7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2541231,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_34caee83a14053c5983718db40857961.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc8267-6077-59cd-bf73-3e32366c29b7/e4fc8267-6077-59cd-bf73-3e32366c29b7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2499095,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_60126d034dc05586f359aeb9088ad5f2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc8267-6077-59cd-bf73-3e32366c29b7/e4fc8267-6077-59cd-bf73-3e32366c29b7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62107,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_2b500e4676b1a87ab8250a7836d98a4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc8267-6077-59cd-bf73-3e32366c29b7/e4fc8267-6077-59cd-bf73-3e32366c29b7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2487004,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_acd6114468a3209b544eefe6e033fcbc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc8267-6077-59cd-bf73-3e32366c29b7/e4fc8267-6077-59cd-bf73-3e32366c29b7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75843,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_471b07ce914a46ac9c1a8df14fb0cd1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc8267-6077-59cd-bf73-3e32366c29b7/e4fc8267-6077-59cd-bf73-3e32366c29b7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71403,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_f8d15de00a1c8307fc58cc0c1dbe3b61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc8267-6077-59cd-bf73-3e32366c29b7/e4fc8267-6077-59cd-bf73-3e32366c29b7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2695420,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_7a94eac96a4d5928c736a257044be4c0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc8267-6077-59cd-bf73-3e32366c29b7/e4fc8267-6077-59cd-bf73-3e32366c29b7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_df1986a5f6130d946270f96eef7751ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4fc8267-6077-59cd-bf73-3e32366c29b7/e4fc8267-6077-59cd-bf73-3e32366c29b7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2743732,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img6a/d8/6ad8a500de3b7c71594419583246eeb5/pa/DT29379_c315dd3f06e09327a862f2b0dae30401.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Sound',
 'transmission': 'manual',
 'trim': 'Sound',
 'year': 2017}
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT29379%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [auto1.de] INFO: Saving data for DT29379: {'created_time': 1774856390.792211, 'last_price_update_time': 1774856390.792221, 'auction_closing_time': 1774971211.0}
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT29379') HTTP/1.1" 204 0
2026-03-30 07:39:50 [auto1.de] INFO: Found listing with ID: WM91773
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91773%27 HTTP/1.1" 200 None
2026-03-30 07:39:50 [auto1.de] INFO: Scrape type for WM91773: 2
2026-03-30 07:39:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f7075b-5dd6-542e-9425-2824bdcd3a69 with scrape type 2
2026-03-30 07:39:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8f7075b-5dd6-542e-9425-2824bdcd3a69 with scrape type 2
2026-03-30 07:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8f7075b-5dd6-542e-9425-2824bdcd3a69, identifier: WM91773
2026-03-30 07:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8f7075b-5dd6-542e-9425-2824bdcd3a69 with identifier: WM91773
2026-03-30 07:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8f7075b-5dd6-542e-9425-2824bdcd3a69 with identifier: WM91773
2026-03-30 07:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8f7075b-5dd6-542e-9425-2824bdcd3a69 with identifier: WM91773 to the API
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:59:17Z',
 'fuel_type': 'petrol',
 'id': 'd8f7075b-5dd6-542e-9425-2824bdcd3a69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM91773',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 123101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-30',
 'seller_name': None,
 'title': 'Ford Focus 1.8 Flexifuel Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91773%27 HTTP/1.1" 200 None
2026-03-30 07:39:51 [auto1.de] INFO: Saving data for WM91773: {'auction_closing_time': 1774972757.0, 'created_time': 1773132170.149881, 'last_price_update_time': 1774856391.309451}
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM91773') HTTP/1.1" 204 0
2026-03-30 07:39:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8f7075b-5dd6-542e-9425-2824bdcd3a69 with identifier: WM91773
2026-03-30 07:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8f7075b-5dd6-542e-9425-2824bdcd3a69 with identifier: WM91773
2026-03-30 07:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8f7075b-5dd6-542e-9425-2824bdcd3a69 with identifier: WM91773 to the API
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:59:17Z',
 'fuel_type': 'petrol',
 'id': 'd8f7075b-5dd6-542e-9425-2824bdcd3a69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM91773',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 123101,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-30',
 'seller_name': None,
 'title': 'Ford Focus 1.8 Flexifuel Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM91773%27 HTTP/1.1" 200 None
2026-03-30 07:39:51 [auto1.de] INFO: Saving data for WM91773: {'auction_closing_time': 1774972757.0, 'created_time': 1773132170.149881, 'last_price_update_time': 1774856391.619896}
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM91773') HTTP/1.1" 204 0
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: JB80786
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: MJ09553
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: JA13261
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: FV55966
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV55966%27 HTTP/1.1" 200 None
2026-03-30 07:39:51 [auto1.de] INFO: Scrape type for FV55966: 2
2026-03-30 07:39:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a2afd2d-4da5-51ca-b235-72555001021a with identifier: FV55966
2026-03-30 07:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a2afd2d-4da5-51ca-b235-72555001021a with scrape type 2
2026-03-30 07:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a2afd2d-4da5-51ca-b235-72555001021a with scrape type 2
2026-03-30 07:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a2afd2d-4da5-51ca-b235-72555001021a, identifier: FV55966
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: JB80786
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: MJ09553
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: JA13261
2026-03-30 07:39:51 [auto1.de] INFO: Found listing with ID: FV55966
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV55966%27 HTTP/1.1" 200 None
2026-03-30 07:39:51 [auto1.de] INFO: Scrape type for FV55966: 2
2026-03-30 07:39:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a2afd2d-4da5-51ca-b235-72555001021a with scrape type 2
2026-03-30 07:39:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a2afd2d-4da5-51ca-b235-72555001021a with scrape type 2
2026-03-30 07:39:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a2afd2d-4da5-51ca-b235-72555001021a, identifier: FV55966
2026-03-30 07:39:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a2afd2d-4da5-51ca-b235-72555001021a with identifier: FV55966
2026-03-30 07:39:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a2afd2d-4da5-51ca-b235-72555001021a with identifier: FV55966
2026-03-30 07:39:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a2afd2d-4da5-51ca-b235-72555001021a with identifier: FV55966 to the API
2026-03-30 07:39:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:07:34Z',
 'fuel_type': 'petrol',
 'id': '5a2afd2d-4da5-51ca-b235-72555001021a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV55966',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 99146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-18',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV55966%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Saving data for FV55966: {'auction_closing_time': 1774969654.0, 'created_time': 1774379363.137676, 'last_price_update_time': 1774856392.326209}
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV55966') HTTP/1.1" 204 0
2026-03-30 07:39:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a2afd2d-4da5-51ca-b235-72555001021a with identifier: FV55966
2026-03-30 07:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a2afd2d-4da5-51ca-b235-72555001021a with identifier: FV55966
2026-03-30 07:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a2afd2d-4da5-51ca-b235-72555001021a with identifier: FV55966 to the API
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-31T15:07:34Z',
 'fuel_type': 'petrol',
 'id': '5a2afd2d-4da5-51ca-b235-72555001021a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV55966',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 99146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-18',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.6 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2015}
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV55966%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Saving data for FV55966: {'auction_closing_time': 1774969654.0, 'created_time': 1774379363.137676, 'last_price_update_time': 1774856392.63023}
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV55966') HTTP/1.1" 204 0
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: SY32033
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY32033%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Scrape type for SY32033: 1
2026-03-30 07:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB97906/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RS18612/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: SY32033
2026-03-30 07:39:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:52 [auto1.de] INFO: Found listing with ID: FY66164
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY66164%27 HTTP/1.1" 200 None
2026-03-30 07:39:52 [auto1.de] INFO: Scrape type for FY66164: 2
2026-03-30 07:39:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73ed6e47-ffec-5843-8a88-a51deac04895 with identifier: FY66164
2026-03-30 07:39:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73ed6e47-ffec-5843-8a88-a51deac04895 with scrape type 2
2026-03-30 07:39:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73ed6e47-ffec-5843-8a88-a51deac04895 with scrape type 2
2026-03-30 07:39:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 73ed6e47-ffec-5843-8a88-a51deac04895, identifier: FY66164
2026-03-30 07:39:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 73ed6e47-ffec-5843-8a88-a51deac04895 with identifier: FY66164
2026-03-30 07:39:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 73ed6e47-ffec-5843-8a88-a51deac04895 with identifier: FY66164
2026-03-30 07:39:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 73ed6e47-ffec-5843-8a88-a51deac04895 with identifier: FY66164 to the API
2026-03-30 07:39:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-31T15:34:57Z',
 'fuel_type': 'petrol',
 'id': '73ed6e47-ffec-5843-8a88-a51deac04895',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY66164',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 5',
 'odometer': 138415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-30',
 'seller_name': None,
 'title': 'Audi RS 5 4.2 V8 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY66164%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Saving data for FY66164: {'auction_closing_time': 1774971297.0, 'created_time': 1774118675.54463, 'last_price_update_time': 1774856393.25423}
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY66164') HTTP/1.1" 204 0
2026-03-30 07:39:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: FG89265
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG89265%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for FG89265: 2
2026-03-30 07:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09506232-ce8e-57d9-bac0-bb9da640ae57 with identifier: FG89265
2026-03-30 07:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09506232-ce8e-57d9-bac0-bb9da640ae57 with scrape type 2
2026-03-30 07:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09506232-ce8e-57d9-bac0-bb9da640ae57 with scrape type 2
2026-03-30 07:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 09506232-ce8e-57d9-bac0-bb9da640ae57, identifier: FG89265
2026-03-30 07:39:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 09506232-ce8e-57d9-bac0-bb9da640ae57 with identifier: FG89265
2026-03-30 07:39:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 09506232-ce8e-57d9-bac0-bb9da640ae57 with identifier: FG89265
2026-03-30 07:39:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 09506232-ce8e-57d9-bac0-bb9da640ae57 with identifier: FG89265 to the API
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-31T15:48:08Z',
 'fuel_type': 'petrol',
 'id': '09506232-ce8e-57d9-bac0-bb9da640ae57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG89265',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 66032,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2017}
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG89265%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Saving data for FG89265: {'auction_closing_time': 1774972088.0, 'created_time': 1774264836.624882, 'last_price_update_time': 1774856393.834397}
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG89265') HTTP/1.1" 204 0
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: NJ23402
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: VM87282
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: SJ00642
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: KP36820
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP36820%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for KP36820: 1
2026-03-30 07:39:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST24513> (referer: https://www.auto1.com/v1/car-details-view/ST24513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:53 [auto1.de] INFO: Channel: 24h | Page: 29 | totalHits: 7905 | hits on page: 40
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: SN63221
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN63221%27 HTTP/1.1" 200 None
2026-03-30 07:39:53 [auto1.de] INFO: Scrape type for SN63221: 2
2026-03-30 07:39:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c72e347-a9dc-5c3f-ac92-9283f9ab4b53 with identifier: SN63221
2026-03-30 07:39:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c72e347-a9dc-5c3f-ac92-9283f9ab4b53 with scrape type 2
2026-03-30 07:39:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c72e347-a9dc-5c3f-ac92-9283f9ab4b53 with scrape type 2
2026-03-30 07:39:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c72e347-a9dc-5c3f-ac92-9283f9ab4b53, identifier: SN63221
2026-03-30 07:39:53 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF22355%27 HTTP/1.1" 200 None
2026-03-30 07:39:54 [auto1.de] INFO: Scrape type for GF22355: 2
2026-03-30 07:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edb78511-0c26-52d0-8d27-fec6274b8337 with identifier: GF22355
2026-03-30 07:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edb78511-0c26-52d0-8d27-fec6274b8337 with scrape type 2
2026-03-30 07:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edb78511-0c26-52d0-8d27-fec6274b8337 with scrape type 2
2026-03-30 07:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edb78511-0c26-52d0-8d27-fec6274b8337, identifier: GF22355
2026-03-30 07:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c72e347-a9dc-5c3f-ac92-9283f9ab4b53 with identifier: SN63221
2026-03-30 07:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c72e347-a9dc-5c3f-ac92-9283f9ab4b53 with identifier: SN63221
2026-03-30 07:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c72e347-a9dc-5c3f-ac92-9283f9ab4b53 with identifier: SN63221 to the API
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-31T15:37:23Z',
 'fuel_type': 'hybrid',
 'id': '6c72e347-a9dc-5c3f-ac92-9283f9ab4b53',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN63221',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 118887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350de 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN63221%27 HTTP/1.1" 200 None
2026-03-30 07:39:54 [auto1.de] INFO: Saving data for SN63221: {'auction_closing_time': 1774971443.0, 'created_time': 1774380027.199461, 'last_price_update_time': 1774856394.445575}
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN63221') HTTP/1.1" 204 0
2026-03-30 07:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edb78511-0c26-52d0-8d27-fec6274b8337 with identifier: GF22355
2026-03-30 07:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edb78511-0c26-52d0-8d27-fec6274b8337 with identifier: GF22355
2026-03-30 07:39:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edb78511-0c26-52d0-8d27-fec6274b8337 with identifier: GF22355 to the API
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:39:32Z',
 'fuel_type': 'petrol',
 'id': 'edb78511-0c26-52d0-8d27-fec6274b8337',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF22355',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 98008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-20',
 'seller_name': None,
 'title': 'Seat Leon 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2020}
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF22355%27 HTTP/1.1" 200 None
2026-03-30 07:39:54 [auto1.de] INFO: Saving data for GF22355: {'auction_closing_time': 1774971572.0, 'created_time': 1773302775.974224, 'last_price_update_time': 1774856394.792249}
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF22355') HTTP/1.1" 204 0
2026-03-30 07:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:54 [auto1.de] INFO: Found listing with ID: EM09093
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM09093%27 HTTP/1.1" 200 None
2026-03-30 07:39:54 [auto1.de] INFO: Scrape type for EM09093: 2
2026-03-30 07:39:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f77eaab7-c495-5649-b06d-cda820820704 with identifier: EM09093
2026-03-30 07:39:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f77eaab7-c495-5649-b06d-cda820820704 with scrape type 2
2026-03-30 07:39:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f77eaab7-c495-5649-b06d-cda820820704 with scrape type 2
2026-03-30 07:39:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f77eaab7-c495-5649-b06d-cda820820704, identifier: EM09093
2026-03-30 07:39:54 [auto1.de] INFO: Found listing with ID: VX60164
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX60164%27 HTTP/1.1" 200 None
2026-03-30 07:39:54 [auto1.de] INFO: Scrape type for VX60164: 1
2026-03-30 07:39:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f77eaab7-c495-5649-b06d-cda820820704 with identifier: EM09093
2026-03-30 07:39:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f77eaab7-c495-5649-b06d-cda820820704 with identifier: EM09093
2026-03-30 07:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f77eaab7-c495-5649-b06d-cda820820704 with identifier: EM09093 to the API
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-31T15:29:21Z',
 'fuel_type': 'petrol',
 'id': 'f77eaab7-c495-5649-b06d-cda820820704',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EM09093',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 106588,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM09093%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Saving data for EM09093: {'auction_closing_time': 1774970961.0, 'created_time': 1774381183.062383, 'last_price_update_time': 1774856395.278869}
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EM09093') HTTP/1.1" 204 0
2026-03-30 07:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93194db3-6ec3-514b-97b3-58678fda2597 with identifier: ST24513
2026-03-30 07:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93194db3-6ec3-514b-97b3-58678fda2597 with scrape type 1
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93194db3-6ec3-514b-97b3-58678fda2597
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F4b%252F7c4b4c01e0e88d4974183bf824e5aca0%252Fpa%252FST24513_b76ae131f271f8b73fad1f246ad0c786.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_b76ae131f271f8b73fad1f246ad0c786.jpg already downloaded
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F4b%252F7c4b4c01e0e88d4974183bf824e5aca0%252Fpa%252FST24513_c0885abfc6d43faa29d08888313931e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_c0885abfc6d43faa29d08888313931e1.jpg already downloaded
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F4b%252F7c4b4c01e0e88d4974183bf824e5aca0%252Fpa%252FST24513_53d6446f7e0b0dc4e55b75bcc607e59f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_53d6446f7e0b0dc4e55b75bcc607e59f.jpg already downloaded
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F4b%252F7c4b4c01e0e88d4974183bf824e5aca0%252Fpa%252FST24513_40e50fbeb574e7931cb1d87083995720.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_40e50fbeb574e7931cb1d87083995720.jpg already downloaded
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F4b%252F7c4b4c01e0e88d4974183bf824e5aca0%252Fpa%252FST24513_a8597a0ba1d5deff8d9e54f68ba4fbe6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_a8597a0ba1d5deff8d9e54f68ba4fbe6.jpg already downloaded
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F4b%252F7c4b4c01e0e88d4974183bf824e5aca0%252Fpa%252FST24513_cfcba59e973f0d6a314a4d3afed710e3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_cfcba59e973f0d6a314a4d3afed710e3.jpg already downloaded
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F4b%252F7c4b4c01e0e88d4974183bf824e5aca0%252Fpa%252FST24513_7c90081d3542022b272a1881e0cf48bc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_7c90081d3542022b272a1881e0cf48bc.jpg already downloaded
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F4b%252F7c4b4c01e0e88d4974183bf824e5aca0%252Fpa%252FST24513_01f110554491388f3fbcd0437f1c3eaa.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_01f110554491388f3fbcd0437f1c3eaa.jpg already downloaded
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F4b%252F7c4b4c01e0e88d4974183bf824e5aca0%252Fpa%252FST24513_467f47133331495fb2a55fe356746cc0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_467f47133331495fb2a55fe356746cc0.jpg already downloaded
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7c%252F4b%252F7c4b4c01e0e88d4974183bf824e5aca0%252Fpa%252FST24513_e0efb369d45203344f280b09c25a498d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_e0efb369d45203344f280b09c25a498d.jpg already downloaded
2026-03-30 07:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93194db3-6ec3-514b-97b3-58678fda2597, identifier: ST24513
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: GH85781
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: LV95619
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: HT22196
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: XY36888
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY36888%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for XY36888: 1
2026-03-30 07:39:55 [auto1.de] INFO: Found listing with ID: VV62637
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV62637%27 HTTP/1.1" 200 None
2026-03-30 07:39:55 [auto1.de] INFO: Scrape type for VV62637: 2
2026-03-30 07:39:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efd27e0a-3a5b-520e-8225-eb46a073c3d0 with identifier: VV62637
2026-03-30 07:39:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd27e0a-3a5b-520e-8225-eb46a073c3d0 with scrape type 2
2026-03-30 07:39:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efd27e0a-3a5b-520e-8225-eb46a073c3d0 with scrape type 2
2026-03-30 07:39:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: efd27e0a-3a5b-520e-8225-eb46a073c3d0, identifier: VV62637
2026-03-30 07:39:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93194db3-6ec3-514b-97b3-58678fda2597 with identifier: ST24513
2026-03-30 07:39:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93194db3-6ec3-514b-97b3-58678fda2597 with identifier: ST24513
2026-03-30 07:39:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93194db3-6ec3-514b-97b3-58678fda2597 with identifier: ST24513 to the API
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ST24513>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-31T15:25:11Z',
 'fuel_type': 'petrol',
 'id': '93194db3-6ec3-514b-97b3-58678fda2597',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST24513',
 'listing': 'auction',
 'location': 'DE, Kerpen',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 129775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_b76ae131f271f8b73fad1f246ad0c786.jpg',
                'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_c0885abfc6d43faa29d08888313931e1.jpg',
                'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_53d6446f7e0b0dc4e55b75bcc607e59f.jpg',
                'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_40e50fbeb574e7931cb1d87083995720.jpg',
                'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_a8597a0ba1d5deff8d9e54f68ba4fbe6.jpg',
                'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_cfcba59e973f0d6a314a4d3afed710e3.jpg',
                'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_7c90081d3542022b272a1881e0cf48bc.jpg',
                'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_01f110554491388f3fbcd0437f1c3eaa.jpg',
                'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_467f47133331495fb2a55fe356746cc0.jpg',
                'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_e0efb369d45203344f280b09c25a498d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93194db3-6ec3-514b-97b3-58678fda2597/93194db3-6ec3-514b-97b3-58678fda2597_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_b76ae131f271f8b73fad1f246ad0c786.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93194db3-6ec3-514b-97b3-58678fda2597/93194db3-6ec3-514b-97b3-58678fda2597_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60142,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_c0885abfc6d43faa29d08888313931e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93194db3-6ec3-514b-97b3-58678fda2597/93194db3-6ec3-514b-97b3-58678fda2597_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73764,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_53d6446f7e0b0dc4e55b75bcc607e59f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93194db3-6ec3-514b-97b3-58678fda2597/93194db3-6ec3-514b-97b3-58678fda2597_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_40e50fbeb574e7931cb1d87083995720.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93194db3-6ec3-514b-97b3-58678fda2597/93194db3-6ec3-514b-97b3-58678fda2597_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79278,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_a8597a0ba1d5deff8d9e54f68ba4fbe6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93194db3-6ec3-514b-97b3-58678fda2597/93194db3-6ec3-514b-97b3-58678fda2597_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_cfcba59e973f0d6a314a4d3afed710e3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93194db3-6ec3-514b-97b3-58678fda2597/93194db3-6ec3-514b-97b3-58678fda2597_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_7c90081d3542022b272a1881e0cf48bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93194db3-6ec3-514b-97b3-58678fda2597/93194db3-6ec3-514b-97b3-58678fda2597_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_01f110554491388f3fbcd0437f1c3eaa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93194db3-6ec3-514b-97b3-58678fda2597/93194db3-6ec3-514b-97b3-58678fda2597_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84870,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_467f47133331495fb2a55fe356746cc0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93194db3-6ec3-514b-97b3-58678fda2597/93194db3-6ec3-514b-97b3-58678fda2597_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70816,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b4c01e0e88d4974183bf824e5aca0/pa/ST24513_e0efb369d45203344f280b09c25a498d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Experience',
 'transmission': 'manual',
 'trim': 'Experience',
 'year': 2018}
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST24513%27 HTTP/1.1" 200 None
2026-03-30 07:39:56 [auto1.de] INFO: Saving data for ST24513: {'created_time': 1774856396.089248, 'last_price_update_time': 1774856396.08926, 'auction_closing_time': 1774970711.0}
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST24513') HTTP/1.1" 204 0
2026-03-30 07:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: efd27e0a-3a5b-520e-8225-eb46a073c3d0 with identifier: VV62637
2026-03-30 07:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: efd27e0a-3a5b-520e-8225-eb46a073c3d0 with identifier: VV62637
2026-03-30 07:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: efd27e0a-3a5b-520e-8225-eb46a073c3d0 with identifier: VV62637 to the API
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:07:23Z',
 'fuel_type': 'diesel',
 'id': 'efd27e0a-3a5b-520e-8225-eb46a073c3d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV62637',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 236205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-12',
 'seller_name': None,
 'title': 'Volvo V50 1.6 D2 Business Edition',
 'transmission': 'manual',
 'trim': 'Business Edition',
 'year': 2012}
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV62637%27 HTTP/1.1" 200 None
2026-03-30 07:39:56 [auto1.de] INFO: Saving data for VV62637: {'auction_closing_time': 1774969643.0, 'created_time': 1774293678.131575, 'last_price_update_time': 1774856396.533639}
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV62637') HTTP/1.1" 204 0
2026-03-30 07:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW22441> (referer: https://www.auto1.com/v1/car-details-view/ZW22441/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:56 [auto1.de] INFO: Found listing with ID: ZS85717
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85717%27 HTTP/1.1" 200 None
2026-03-30 07:39:56 [auto1.de] INFO: Scrape type for ZS85717: 2
2026-03-30 07:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fbf86e2-007d-5bf0-a3e7-681934187302 with identifier: ZS85717
2026-03-30 07:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fbf86e2-007d-5bf0-a3e7-681934187302 with scrape type 2
2026-03-30 07:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fbf86e2-007d-5bf0-a3e7-681934187302 with scrape type 2
2026-03-30 07:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fbf86e2-007d-5bf0-a3e7-681934187302, identifier: ZS85717
2026-03-30 07:39:56 [auto1.de] INFO: Found listing with ID: BY75346
2026-03-30 07:39:56 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-30 07:39:56 [auto1.de] INFO: Found listing with ID: HT72839
2026-03-30 07:39:56 [auto1.de] INFO: Found listing with ID: SW78620
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW78620%27 HTTP/1.1" 200 None
2026-03-30 07:39:56 [auto1.de] INFO: Scrape type for SW78620: 2
2026-03-30 07:39:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c3043ea-393e-5f71-90ba-8812d9a2da14 with identifier: SW78620
2026-03-30 07:39:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c3043ea-393e-5f71-90ba-8812d9a2da14 with scrape type 2
2026-03-30 07:39:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c3043ea-393e-5f71-90ba-8812d9a2da14 with scrape type 2
2026-03-30 07:39:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c3043ea-393e-5f71-90ba-8812d9a2da14, identifier: SW78620
2026-03-30 07:39:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV48618/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fbf86e2-007d-5bf0-a3e7-681934187302 with identifier: ZS85717
2026-03-30 07:39:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fbf86e2-007d-5bf0-a3e7-681934187302 with identifier: ZS85717
2026-03-30 07:39:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fbf86e2-007d-5bf0-a3e7-681934187302 with identifier: ZS85717 to the API
2026-03-30 07:39:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:04:15Z',
 'fuel_type': 'petrol',
 'id': '2fbf86e2-007d-5bf0-a3e7-681934187302',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS85717',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 17650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-02',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Vision',
 'transmission': 'automatic',
 'trim': 'Vision',
 'year': 2024}
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85717%27 HTTP/1.1" 200 None
2026-03-30 07:39:57 [auto1.de] INFO: Saving data for ZS85717: {'auction_closing_time': 1774969455.0, 'created_time': 1773657923.867449, 'last_price_update_time': 1774856397.198822}
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS85717') HTTP/1.1" 204 0
2026-03-30 07:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c3043ea-393e-5f71-90ba-8812d9a2da14 with identifier: SW78620
2026-03-30 07:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c3043ea-393e-5f71-90ba-8812d9a2da14 with identifier: SW78620
2026-03-30 07:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c3043ea-393e-5f71-90ba-8812d9a2da14 with identifier: SW78620 to the API
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-31T15:57:52Z',
 'fuel_type': 'diesel',
 'id': '4c3043ea-393e-5f71-90ba-8812d9a2da14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW78620',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 303536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-01',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW78620%27 HTTP/1.1" 200 None
2026-03-30 07:39:57 [auto1.de] INFO: Saving data for SW78620: {'auction_closing_time': 1774972672.0, 'created_time': 1773775759.039679, 'last_price_update_time': 1774856397.567225}
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW78620') HTTP/1.1" 204 0
2026-03-30 07:39:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:57 [auto1.de] INFO: Found listing with ID: KC21551
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC21551%27 HTTP/1.1" 200 None
2026-03-30 07:39:57 [auto1.de] INFO: Scrape type for KC21551: 2
2026-03-30 07:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bc0f917-2a1a-56ca-b91c-8c13cfba2458 with identifier: KC21551
2026-03-30 07:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc0f917-2a1a-56ca-b91c-8c13cfba2458 with scrape type 2
2026-03-30 07:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bc0f917-2a1a-56ca-b91c-8c13cfba2458 with scrape type 2
2026-03-30 07:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bc0f917-2a1a-56ca-b91c-8c13cfba2458, identifier: KC21551
2026-03-30 07:39:57 [auto1.de] INFO: Found listing with ID: XC84450
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC84450%27 HTTP/1.1" 200 None
2026-03-30 07:39:57 [auto1.de] INFO: Scrape type for XC84450: 2
2026-03-30 07:39:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d28cce24-20b5-5467-bbdd-28a98711f3d8 with identifier: XC84450
2026-03-30 07:39:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d28cce24-20b5-5467-bbdd-28a98711f3d8 with scrape type 2
2026-03-30 07:39:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d28cce24-20b5-5467-bbdd-28a98711f3d8 with scrape type 2
2026-03-30 07:39:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d28cce24-20b5-5467-bbdd-28a98711f3d8, identifier: XC84450
2026-03-30 07:39:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY32033/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:39:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bc0f917-2a1a-56ca-b91c-8c13cfba2458 with identifier: KC21551
2026-03-30 07:39:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bc0f917-2a1a-56ca-b91c-8c13cfba2458 with identifier: KC21551
2026-03-30 07:39:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bc0f917-2a1a-56ca-b91c-8c13cfba2458 with identifier: KC21551 to the API
2026-03-30 07:39:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-31T15:13:30Z',
 'fuel_type': 'petrol',
 'id': '4bc0f917-2a1a-56ca-b91c-8c13cfba2458',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC21551',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'TT',
 'odometer': 91499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-20',
 'seller_name': None,
 'title': 'Audi TT 1.8 TFSI Coupe',
 'transmission': 'manual',
 'trim': 'Coupe',
 'year': 2011}
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC21551%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Saving data for KC21551: {'auction_closing_time': 1774970010.0, 'created_time': 1774637472.472212, 'last_price_update_time': 1774856398.192611}
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC21551') HTTP/1.1" 204 0
2026-03-30 07:39:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d28cce24-20b5-5467-bbdd-28a98711f3d8 with identifier: XC84450
2026-03-30 07:39:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d28cce24-20b5-5467-bbdd-28a98711f3d8 with identifier: XC84450
2026-03-30 07:39:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d28cce24-20b5-5467-bbdd-28a98711f3d8 with identifier: XC84450 to the API
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-31T15:49:06Z',
 'fuel_type': 'petrol',
 'id': 'd28cce24-20b5-5467-bbdd-28a98711f3d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC84450',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 73098,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC84450%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Saving data for XC84450: {'auction_closing_time': 1774972146.0, 'created_time': 1774292283.401043, 'last_price_update_time': 1774856398.58627}
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC84450') HTTP/1.1" 204 0
2026-03-30 07:39:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: GF22355
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF22355%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for GF22355: 0
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: VX60164
2026-03-30 07:39:58 [auto1.de] INFO: Found listing with ID: LT35519
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT35519%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [auto1.de] INFO: Scrape type for LT35519: 2
2026-03-30 07:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cacac532-6b13-524f-a7c6-1abda97d8836 with identifier: LT35519
2026-03-30 07:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cacac532-6b13-524f-a7c6-1abda97d8836 with scrape type 2
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cacac532-6b13-524f-a7c6-1abda97d8836 with scrape type 2
2026-03-30 07:39:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cacac532-6b13-524f-a7c6-1abda97d8836, identifier: LT35519
2026-03-30 07:39:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62219c2d-a724-5edc-af52-24fbd3ac52d4 with identifier: ZW22441
2026-03-30 07:39:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62219c2d-a724-5edc-af52-24fbd3ac52d4 with scrape type 1
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 62219c2d-a724-5edc-af52-24fbd3ac52d4
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F83%252Fe483af783838e93898eb50143fb7447b%252Fpa%252FZW22441_5476c674b1e111f3c4dc7d5a07197316.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_5476c674b1e111f3c4dc7d5a07197316.jpg already downloaded
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F83%252Fe483af783838e93898eb50143fb7447b%252Fpa%252FZW22441_a355f1b15e0dfa09f850e2fe3d64d2f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_a355f1b15e0dfa09f850e2fe3d64d2f1.jpg already downloaded
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F83%252Fe483af783838e93898eb50143fb7447b%252Fpa%252FZW22441_0856d6ebfc12007a4c15c2daf09ab3ea.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_0856d6ebfc12007a4c15c2daf09ab3ea.jpg already downloaded
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F83%252Fe483af783838e93898eb50143fb7447b%252Fpa%252FZW22441_9205644f1b98ceda1914623e54c5d430.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_9205644f1b98ceda1914623e54c5d430.jpg already downloaded
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F83%252Fe483af783838e93898eb50143fb7447b%252Fpa%252FZW22441_e7c62f20c95613b20cdadbfd7ba559f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_e7c62f20c95613b20cdadbfd7ba559f1.jpg already downloaded
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F83%252Fe483af783838e93898eb50143fb7447b%252Fpa%252FZW22441_2d0fae78bbcbc557980247e3301c1903.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_2d0fae78bbcbc557980247e3301c1903.jpg already downloaded
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F83%252Fe483af783838e93898eb50143fb7447b%252Fpa%252FZW22441_2b4a926272258edbd1afdddb1c7345a7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_2b4a926272258edbd1afdddb1c7345a7.jpg already downloaded
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F83%252Fe483af783838e93898eb50143fb7447b%252Fpa%252FZW22441_7453836e37fe56d872738712390d0f7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_7453836e37fe56d872738712390d0f7f.jpg already downloaded
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F83%252Fe483af783838e93898eb50143fb7447b%252Fpa%252FZW22441_254c768ce5b5b32ea56146656f029b1f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_254c768ce5b5b32ea56146656f029b1f.jpg already downloaded
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge4%252F83%252Fe483af783838e93898eb50143fb7447b%252Fpa%252FZW22441_4749a2fa1fb8ac648b2d93fa076c5116.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:39:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_4749a2fa1fb8ac648b2d93fa076c5116.jpg already downloaded
2026-03-30 07:39:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62219c2d-a724-5edc-af52-24fbd3ac52d4, identifier: ZW22441
2026-03-30 07:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cacac532-6b13-524f-a7c6-1abda97d8836 with identifier: LT35519
2026-03-30 07:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cacac532-6b13-524f-a7c6-1abda97d8836 with identifier: LT35519
2026-03-30 07:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cacac532-6b13-524f-a7c6-1abda97d8836 with identifier: LT35519 to the API
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:39:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:27:51Z',
 'fuel_type': 'petrol',
 'id': 'cacac532-6b13-524f-a7c6-1abda97d8836',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT35519',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 251319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-26',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2012}
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT35519%27 HTTP/1.1" 200 None
2026-03-30 07:39:59 [auto1.de] INFO: Saving data for LT35519: {'auction_closing_time': 1774970871.0, 'created_time': 1773303651.166553, 'last_price_update_time': 1774856399.376534}
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT35519') HTTP/1.1" 204 0
2026-03-30 07:39:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62219c2d-a724-5edc-af52-24fbd3ac52d4 with identifier: ZW22441
2026-03-30 07:39:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62219c2d-a724-5edc-af52-24fbd3ac52d4 with identifier: ZW22441
2026-03-30 07:39:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62219c2d-a724-5edc-af52-24fbd3ac52d4 with identifier: ZW22441 to the API
2026-03-30 07:39:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZW22441>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:27:45Z',
 'fuel_type': 'petrol',
 'id': '62219c2d-a724-5edc-af52-24fbd3ac52d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW22441',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'BMW',
 'model': '1er',
 'odometer': 120603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_5476c674b1e111f3c4dc7d5a07197316.jpg',
                'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_a355f1b15e0dfa09f850e2fe3d64d2f1.jpg',
                'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_0856d6ebfc12007a4c15c2daf09ab3ea.jpg',
                'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_9205644f1b98ceda1914623e54c5d430.jpg',
                'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_e7c62f20c95613b20cdadbfd7ba559f1.jpg',
                'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_2d0fae78bbcbc557980247e3301c1903.jpg',
                'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_2b4a926272258edbd1afdddb1c7345a7.jpg',
                'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_7453836e37fe56d872738712390d0f7f.jpg',
                'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_254c768ce5b5b32ea56146656f029b1f.jpg',
                'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_4749a2fa1fb8ac648b2d93fa076c5116.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62219c2d-a724-5edc-af52-24fbd3ac52d4/62219c2d-a724-5edc-af52-24fbd3ac52d4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2099957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_5476c674b1e111f3c4dc7d5a07197316.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62219c2d-a724-5edc-af52-24fbd3ac52d4/62219c2d-a724-5edc-af52-24fbd3ac52d4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57922,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_a355f1b15e0dfa09f850e2fe3d64d2f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62219c2d-a724-5edc-af52-24fbd3ac52d4/62219c2d-a724-5edc-af52-24fbd3ac52d4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2131974,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_0856d6ebfc12007a4c15c2daf09ab3ea.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62219c2d-a724-5edc-af52-24fbd3ac52d4/62219c2d-a724-5edc-af52-24fbd3ac52d4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2410844,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_9205644f1b98ceda1914623e54c5d430.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62219c2d-a724-5edc-af52-24fbd3ac52d4/62219c2d-a724-5edc-af52-24fbd3ac52d4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2233961,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_e7c62f20c95613b20cdadbfd7ba559f1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62219c2d-a724-5edc-af52-24fbd3ac52d4/62219c2d-a724-5edc-af52-24fbd3ac52d4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60084,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_2d0fae78bbcbc557980247e3301c1903.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62219c2d-a724-5edc-af52-24fbd3ac52d4/62219c2d-a724-5edc-af52-24fbd3ac52d4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_2b4a926272258edbd1afdddb1c7345a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62219c2d-a724-5edc-af52-24fbd3ac52d4/62219c2d-a724-5edc-af52-24fbd3ac52d4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_7453836e37fe56d872738712390d0f7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62219c2d-a724-5edc-af52-24fbd3ac52d4/62219c2d-a724-5edc-af52-24fbd3ac52d4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_254c768ce5b5b32ea56146656f029b1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_62219c2d-a724-5edc-af52-24fbd3ac52d4/62219c2d-a724-5edc-af52-24fbd3ac52d4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge4/83/e483af783838e93898eb50143fb7447b/pa/ZW22441_4749a2fa1fb8ac648b2d93fa076c5116.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW22441%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Saving data for ZW22441: {'created_time': 1774856400.452831, 'last_price_update_time': 1774856400.452843, 'auction_closing_time': 1774970865.0}
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW22441') HTTP/1.1" 204 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: VV62637
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV62637%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for VV62637: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: BY75346
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: CC27418
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: HT72839
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: SW78620
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW78620%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for SW78620: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: XC84450
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC84450%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for XC84450: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: LT35519
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT35519%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for LT35519: 0
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: DF54938
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: UY47574
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY47574%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for UY47574: 2
2026-03-30 07:40:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8119016e-a41f-5ff9-be96-66a6c543ed25 with identifier: UY47574
2026-03-30 07:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8119016e-a41f-5ff9-be96-66a6c543ed25 with scrape type 2
2026-03-30 07:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8119016e-a41f-5ff9-be96-66a6c543ed25 with scrape type 2
2026-03-30 07:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8119016e-a41f-5ff9-be96-66a6c543ed25, identifier: UY47574
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: DF54938
2026-03-30 07:40:00 [auto1.de] INFO: Found listing with ID: UY47574
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY47574%27 HTTP/1.1" 200 None
2026-03-30 07:40:00 [auto1.de] INFO: Scrape type for UY47574: 2
2026-03-30 07:40:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8119016e-a41f-5ff9-be96-66a6c543ed25 with scrape type 2
2026-03-30 07:40:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8119016e-a41f-5ff9-be96-66a6c543ed25 with scrape type 2
2026-03-30 07:40:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8119016e-a41f-5ff9-be96-66a6c543ed25, identifier: UY47574
2026-03-30 07:40:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK82535> (referer: https://www.auto1.com/v1/car-details-view/TK82535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8119016e-a41f-5ff9-be96-66a6c543ed25 with identifier: UY47574
2026-03-30 07:40:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8119016e-a41f-5ff9-be96-66a6c543ed25 with identifier: UY47574
2026-03-30 07:40:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8119016e-a41f-5ff9-be96-66a6c543ed25 with identifier: UY47574 to the API
2026-03-30 07:40:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:05:23Z',
 'fuel_type': 'petrol',
 'id': '8119016e-a41f-5ff9-be96-66a6c543ed25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY47574',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 112624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-29',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Vision 2WD',
 'transmission': 'manual',
 'trim': 'Vision 2WD',
 'year': 2013}
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY47574%27 HTTP/1.1" 200 None
2026-03-30 07:40:01 [auto1.de] INFO: Saving data for UY47574: {'auction_closing_time': 1774969523.0, 'created_time': 1773686645.697949, 'last_price_update_time': 1774856401.281191}
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY47574') HTTP/1.1" 204 0
2026-03-30 07:40:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8119016e-a41f-5ff9-be96-66a6c543ed25 with identifier: UY47574
2026-03-30 07:40:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8119016e-a41f-5ff9-be96-66a6c543ed25 with identifier: UY47574
2026-03-30 07:40:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8119016e-a41f-5ff9-be96-66a6c543ed25 with identifier: UY47574 to the API
2026-03-30 07:40:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-31T15:05:23Z',
 'fuel_type': 'petrol',
 'id': '8119016e-a41f-5ff9-be96-66a6c543ed25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY47574',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 112624,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-29',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Vision 2WD',
 'transmission': 'manual',
 'trim': 'Vision 2WD',
 'year': 2013}
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY47574%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Saving data for UY47574: {'auction_closing_time': 1774969523.0, 'created_time': 1773686645.697949, 'last_price_update_time': 1774856402.401431}
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY47574') HTTP/1.1" 204 0
2026-03-30 07:40:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: RC64435
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64435%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for RC64435: 2
2026-03-30 07:40:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc450807-e39b-524c-ad40-9ecf4824cb1e with identifier: RC64435
2026-03-30 07:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc450807-e39b-524c-ad40-9ecf4824cb1e with scrape type 2
2026-03-30 07:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc450807-e39b-524c-ad40-9ecf4824cb1e with scrape type 2
2026-03-30 07:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc450807-e39b-524c-ad40-9ecf4824cb1e, identifier: RC64435
2026-03-30 07:40:02 [auto1.de] INFO: Found listing with ID: RC64435
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64435%27 HTTP/1.1" 200 None
2026-03-30 07:40:02 [auto1.de] INFO: Scrape type for RC64435: 2
2026-03-30 07:40:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc450807-e39b-524c-ad40-9ecf4824cb1e with scrape type 2
2026-03-30 07:40:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc450807-e39b-524c-ad40-9ecf4824cb1e with scrape type 2
2026-03-30 07:40:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc450807-e39b-524c-ad40-9ecf4824cb1e, identifier: RC64435
2026-03-30 07:40:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc450807-e39b-524c-ad40-9ecf4824cb1e with identifier: RC64435
2026-03-30 07:40:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc450807-e39b-524c-ad40-9ecf4824cb1e with identifier: RC64435
2026-03-30 07:40:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc450807-e39b-524c-ad40-9ecf4824cb1e with identifier: RC64435 to the API
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:08:39Z',
 'fuel_type': 'petrol',
 'id': 'bc450807-e39b-524c-ad40-9ecf4824cb1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC64435',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 155246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64435%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [auto1.de] INFO: Saving data for RC64435: {'auction_closing_time': 1774969719.0, 'created_time': 1773304775.005991, 'last_price_update_time': 1774856403.052562}
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC64435') HTTP/1.1" 204 0
2026-03-30 07:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc450807-e39b-524c-ad40-9ecf4824cb1e with identifier: RC64435
2026-03-30 07:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc450807-e39b-524c-ad40-9ecf4824cb1e with identifier: RC64435
2026-03-30 07:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc450807-e39b-524c-ad40-9ecf4824cb1e with identifier: RC64435 to the API
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-31T15:08:39Z',
 'fuel_type': 'petrol',
 'id': 'bc450807-e39b-524c-ad40-9ecf4824cb1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC64435',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 155246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-05',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64435%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [auto1.de] INFO: Saving data for RC64435: {'auction_closing_time': 1774969719.0, 'created_time': 1773304775.005991, 'last_price_update_time': 1774856403.371578}
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC64435') HTTP/1.1" 204 0
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: KU11171
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU11171%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [auto1.de] INFO: Scrape type for KU11171: 1
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: KU11171
2026-03-30 07:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AU31378> (referer: https://www.auto1.com/v1/car-details-view/AU31378/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d961b23c-8afd-5824-aff6-22772e70f39e with identifier: TK82535
2026-03-30 07:40:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d961b23c-8afd-5824-aff6-22772e70f39e with scrape type 1
2026-03-30 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d961b23c-8afd-5824-aff6-22772e70f39e
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4807ff6895eaf184f6512ae133e873%252Fpa%252FTK82535_c8316e7dd815cbfc9ab0582854d84a7b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_c8316e7dd815cbfc9ab0582854d84a7b.jpg already downloaded
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4807ff6895eaf184f6512ae133e873%252Fpa%252FTK82535_ed5b3db4fe0b6a593c6e289ea107f431.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_ed5b3db4fe0b6a593c6e289ea107f431.jpg already downloaded
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4807ff6895eaf184f6512ae133e873%252Fpa%252FTK82535_a8d66375c052e4f7d3e2efcf5d361e3f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_a8d66375c052e4f7d3e2efcf5d361e3f.jpg already downloaded
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4807ff6895eaf184f6512ae133e873%252Fpa%252FTK82535_4607e076e4f8fb15b1403547dd5755b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_4607e076e4f8fb15b1403547dd5755b4.jpg already downloaded
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4807ff6895eaf184f6512ae133e873%252Fpa%252FTK82535_f78dc8cbd2e0785f4b471b09dfda8d6b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_f78dc8cbd2e0785f4b471b09dfda8d6b.jpg already downloaded
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4807ff6895eaf184f6512ae133e873%252Fpa%252FTK82535_af7132d28c9889c4b0a8e5748f743803.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_af7132d28c9889c4b0a8e5748f743803.jpg already downloaded
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4807ff6895eaf184f6512ae133e873%252Fpa%252FTK82535_3780aabbfd791f58cbb5c1e4ee0a6e79.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_3780aabbfd791f58cbb5c1e4ee0a6e79.jpg already downloaded
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4807ff6895eaf184f6512ae133e873%252Fpa%252FTK82535_337dd0c1e80793bb6c831931e5e4b9c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_337dd0c1e80793bb6c831931e5e4b9c4.jpg already downloaded
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4807ff6895eaf184f6512ae133e873%252Fpa%252FTK82535_3bcc84e04d7705365aac6b49b5ba7797.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_3bcc84e04d7705365aac6b49b5ba7797.jpg already downloaded
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252F48%252F0c4807ff6895eaf184f6512ae133e873%252Fpa%252FTK82535_b66f95fe1d8d3f58823b5475e4417e87.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_b66f95fe1d8d3f58823b5475e4417e87.jpg already downloaded
2026-03-30 07:40:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d961b23c-8afd-5824-aff6-22772e70f39e, identifier: TK82535
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: JB30434
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB30434%27 HTTP/1.1" 200 None
2026-03-30 07:40:03 [auto1.de] INFO: Scrape type for JB30434: 1
2026-03-30 07:40:03 [auto1.de] INFO: Found listing with ID: JB30434
2026-03-30 07:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB97906> (referer: https://www.auto1.com/v1/car-details-view/DB97906/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d961b23c-8afd-5824-aff6-22772e70f39e with identifier: TK82535
2026-03-30 07:40:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d961b23c-8afd-5824-aff6-22772e70f39e with identifier: TK82535
2026-03-30 07:40:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d961b23c-8afd-5824-aff6-22772e70f39e with identifier: TK82535 to the API
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TK82535>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:50:34Z',
 'fuel_type': 'diesel',
 'id': 'd961b23c-8afd-5824-aff6-22772e70f39e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK82535',
 'listing': 'auction',
 'location': 'DE, Korbach',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 173819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_c8316e7dd815cbfc9ab0582854d84a7b.jpg',
                'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_ed5b3db4fe0b6a593c6e289ea107f431.jpg',
                'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_a8d66375c052e4f7d3e2efcf5d361e3f.jpg',
                'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_4607e076e4f8fb15b1403547dd5755b4.jpg',
                'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_f78dc8cbd2e0785f4b471b09dfda8d6b.jpg',
                'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_af7132d28c9889c4b0a8e5748f743803.jpg',
                'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_3780aabbfd791f58cbb5c1e4ee0a6e79.jpg',
                'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_337dd0c1e80793bb6c831931e5e4b9c4.jpg',
                'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_3bcc84e04d7705365aac6b49b5ba7797.jpg',
                'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_b66f95fe1d8d3f58823b5475e4417e87.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d961b23c-8afd-5824-aff6-22772e70f39e/d961b23c-8afd-5824-aff6-22772e70f39e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75400,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_c8316e7dd815cbfc9ab0582854d84a7b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d961b23c-8afd-5824-aff6-22772e70f39e/d961b23c-8afd-5824-aff6-22772e70f39e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79459,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_ed5b3db4fe0b6a593c6e289ea107f431.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d961b23c-8afd-5824-aff6-22772e70f39e/d961b23c-8afd-5824-aff6-22772e70f39e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68341,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_a8d66375c052e4f7d3e2efcf5d361e3f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d961b23c-8afd-5824-aff6-22772e70f39e/d961b23c-8afd-5824-aff6-22772e70f39e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59410,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_4607e076e4f8fb15b1403547dd5755b4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d961b23c-8afd-5824-aff6-22772e70f39e/d961b23c-8afd-5824-aff6-22772e70f39e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64838,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_f78dc8cbd2e0785f4b471b09dfda8d6b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d961b23c-8afd-5824-aff6-22772e70f39e/d961b23c-8afd-5824-aff6-22772e70f39e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2236275,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_af7132d28c9889c4b0a8e5748f743803.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d961b23c-8afd-5824-aff6-22772e70f39e/d961b23c-8afd-5824-aff6-22772e70f39e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2228437,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_3780aabbfd791f58cbb5c1e4ee0a6e79.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d961b23c-8afd-5824-aff6-22772e70f39e/d961b23c-8afd-5824-aff6-22772e70f39e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2253426,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_337dd0c1e80793bb6c831931e5e4b9c4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d961b23c-8afd-5824-aff6-22772e70f39e/d961b23c-8afd-5824-aff6-22772e70f39e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_3bcc84e04d7705365aac6b49b5ba7797.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d961b23c-8afd-5824-aff6-22772e70f39e/d961b23c-8afd-5824-aff6-22772e70f39e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/48/0c4807ff6895eaf184f6512ae133e873/pa/TK82535_b66f95fe1d8d3f58823b5475e4417e87.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-10-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2013}
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK82535%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Saving data for TK82535: {'created_time': 1774856404.119845, 'last_price_update_time': 1774856404.119861, 'auction_closing_time': 1774972234.0}
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK82535') HTTP/1.1" 204 0
2026-03-30 07:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:04 [auto1.de] INFO: Found listing with ID: MP54327
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP54327%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Scrape type for MP54327: 2
2026-03-30 07:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4164345e-b6bd-58ba-8871-947c27967632 with identifier: MP54327
2026-03-30 07:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4164345e-b6bd-58ba-8871-947c27967632 with scrape type 2
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4164345e-b6bd-58ba-8871-947c27967632 with scrape type 2
2026-03-30 07:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4164345e-b6bd-58ba-8871-947c27967632, identifier: MP54327
2026-03-30 07:40:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4164345e-b6bd-58ba-8871-947c27967632 with identifier: MP54327
2026-03-30 07:40:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4164345e-b6bd-58ba-8871-947c27967632 with identifier: MP54327
2026-03-30 07:40:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4164345e-b6bd-58ba-8871-947c27967632 with identifier: MP54327 to the API
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-31T15:42:21Z',
 'fuel_type': 'petrol',
 'id': '4164345e-b6bd-58ba-8871-947c27967632',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP54327',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 150999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP54327%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [auto1.de] INFO: Saving data for MP54327: {'auction_closing_time': 1774971741.0, 'created_time': 1774293858.425818, 'last_price_update_time': 1774856404.637463}
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP54327') HTTP/1.1" 204 0
2026-03-30 07:40:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL08953> (referer: https://www.auto1.com/v1/car-details-view/YL08953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1 with identifier: AU31378
2026-03-30 07:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1 with scrape type 1
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F1d%252F671d39a5881c16a453b139388428f903%252Fpa%252FAU31378_02c1d1f8f30559e6d1c25f901ca2c11d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_02c1d1f8f30559e6d1c25f901ca2c11d.jpg already downloaded
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F1d%252F671d39a5881c16a453b139388428f903%252Fpa%252FAU31378_416dd41a17735ad63b3cae0381798488.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_416dd41a17735ad63b3cae0381798488.jpg already downloaded
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F1d%252F671d39a5881c16a453b139388428f903%252Fpa%252FAU31378_1885258bb56f3e9126103cb6bbbf2b78.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_1885258bb56f3e9126103cb6bbbf2b78.jpg already downloaded
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F1d%252F671d39a5881c16a453b139388428f903%252Fpa%252FAU31378_6436ce73c2224e89490adaf6fe539ce0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_6436ce73c2224e89490adaf6fe539ce0.jpg already downloaded
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F1d%252F671d39a5881c16a453b139388428f903%252Fpa%252FAU31378_b2928d79bc55b082e665d101341f46fe.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_b2928d79bc55b082e665d101341f46fe.jpg already downloaded
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F1d%252F671d39a5881c16a453b139388428f903%252Fpa%252FAU31378_f5b72d4e1b4e22e94cfa76e564e9312b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_f5b72d4e1b4e22e94cfa76e564e9312b.jpg already downloaded
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F1d%252F671d39a5881c16a453b139388428f903%252Fpa%252FAU31378_3782d18b3660b59814889c01124490cf.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_3782d18b3660b59814889c01124490cf.jpg already downloaded
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F1d%252F671d39a5881c16a453b139388428f903%252Fpa%252FAU31378_f84a9abca5d5f8fa3cf809e4cac125c4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_f84a9abca5d5f8fa3cf809e4cac125c4.jpg already downloaded
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F1d%252F671d39a5881c16a453b139388428f903%252Fpa%252FAU31378_25d72e68ca7a0bf2d91a45b595caf4c0.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_25d72e68ca7a0bf2d91a45b595caf4c0.jpg already downloaded
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F1d%252F671d39a5881c16a453b139388428f903%252Fpa%252FAU31378_12dc453e69f9b11a5a47cc707416337b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_12dc453e69f9b11a5a47cc707416337b.jpg already downloaded
2026-03-30 07:40:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1, identifier: AU31378
2026-03-30 07:40:04 [auto1.de] INFO: Channel: 24h | Page: 30 | totalHits: 7918 | hits on page: 40
2026-03-30 07:40:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 430b6825-cb6e-5afb-b495-3872ce577826 with identifier: DB97906
2026-03-30 07:40:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 430b6825-cb6e-5afb-b495-3872ce577826 with scrape type 1
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 430b6825-cb6e-5afb-b495-3872ce577826
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F0e%252F000e0e144bb8e14b3ef25cb0184bfff0%252Fpa%252FDB97906_06d52ebb201f0dacd91279a7c4f96918.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_06d52ebb201f0dacd91279a7c4f96918.jpg already downloaded
2026-03-30 07:40:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F0e%252F000e0e144bb8e14b3ef25cb0184bfff0%252Fpa%252FDB97906_1f9fa583f075ea0807513e328578c3bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_1f9fa583f075ea0807513e328578c3bb.jpg already downloaded
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F0e%252F000e0e144bb8e14b3ef25cb0184bfff0%252Fpa%252FDB97906_be2d55ca3bbe9e67c324021aa1a29a4c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_be2d55ca3bbe9e67c324021aa1a29a4c.jpg already downloaded
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F0e%252F000e0e144bb8e14b3ef25cb0184bfff0%252Fpa%252FDB97906_5c5010a496b2807549f76805ec2aef85.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_5c5010a496b2807549f76805ec2aef85.jpg already downloaded
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F0e%252F000e0e144bb8e14b3ef25cb0184bfff0%252Fpa%252FDB97906_b418be5c95f387651fa3a7de67991fc8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_b418be5c95f387651fa3a7de67991fc8.jpg already downloaded
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F0e%252F000e0e144bb8e14b3ef25cb0184bfff0%252Fpa%252FDB97906_abc60f05394ae1238a137b5c6444be9f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_abc60f05394ae1238a137b5c6444be9f.jpg already downloaded
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F0e%252F000e0e144bb8e14b3ef25cb0184bfff0%252Fpa%252FDB97906_36980b18c74568ae99b58cfee7e98b0f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_36980b18c74568ae99b58cfee7e98b0f.jpg already downloaded
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F0e%252F000e0e144bb8e14b3ef25cb0184bfff0%252Fpa%252FDB97906_42ec50a332d9be8750351721e40ccc1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_42ec50a332d9be8750351721e40ccc1c.jpg already downloaded
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F0e%252F000e0e144bb8e14b3ef25cb0184bfff0%252Fpa%252FDB97906_f6a4e267881bb695aeb3365e7b8b519b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_f6a4e267881bb695aeb3365e7b8b519b.jpg already downloaded
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg00%252F0e%252F000e0e144bb8e14b3ef25cb0184bfff0%252Fpa%252FDB97906_7e3dfe83a4de8836aa5c6dc35623e24d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_7e3dfe83a4de8836aa5c6dc35623e24d.jpg already downloaded
2026-03-30 07:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 430b6825-cb6e-5afb-b495-3872ce577826, identifier: DB97906
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: KG86059
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: FZ65862
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: XU97028
2026-03-30 07:40:05 [auto1.de] INFO: Found listing with ID: TF75057
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF75057%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Scrape type for TF75057: 2
2026-03-30 07:40:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 629ea8b2-619e-5ae7-a3f5-494646ebc1ca with identifier: TF75057
2026-03-30 07:40:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 629ea8b2-619e-5ae7-a3f5-494646ebc1ca with scrape type 2
2026-03-30 07:40:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 629ea8b2-619e-5ae7-a3f5-494646ebc1ca with scrape type 2
2026-03-30 07:40:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 629ea8b2-619e-5ae7-a3f5-494646ebc1ca, identifier: TF75057
2026-03-30 07:40:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1 with identifier: AU31378
2026-03-30 07:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1 with identifier: AU31378
2026-03-30 07:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1 with identifier: AU31378 to the API
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/AU31378>
{'auction_title': '',
 'c_o_2_emission_value': 170,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:28:31Z',
 'fuel_type': 'petrol',
 'id': '2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU31378',
 'listing': 'auction',
 'location': 'DE, Seddiner See',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 69087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_02c1d1f8f30559e6d1c25f901ca2c11d.jpg',
                'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_416dd41a17735ad63b3cae0381798488.jpg',
                'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_1885258bb56f3e9126103cb6bbbf2b78.jpg',
                'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_6436ce73c2224e89490adaf6fe539ce0.jpg',
                'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_b2928d79bc55b082e665d101341f46fe.jpg',
                'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_f5b72d4e1b4e22e94cfa76e564e9312b.jpg',
                'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_3782d18b3660b59814889c01124490cf.jpg',
                'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_f84a9abca5d5f8fa3cf809e4cac125c4.jpg',
                'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_25d72e68ca7a0bf2d91a45b595caf4c0.jpg',
                'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_12dc453e69f9b11a5a47cc707416337b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1/2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84567,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_02c1d1f8f30559e6d1c25f901ca2c11d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1/2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_416dd41a17735ad63b3cae0381798488.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1/2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75932,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_1885258bb56f3e9126103cb6bbbf2b78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1/2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57670,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_6436ce73c2224e89490adaf6fe539ce0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1/2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67144,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_b2928d79bc55b082e665d101341f46fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1/2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79146,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_f5b72d4e1b4e22e94cfa76e564e9312b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1/2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71427,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_3782d18b3660b59814889c01124490cf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1/2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73980,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_f84a9abca5d5f8fa3cf809e4cac125c4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1/2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77251,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_25d72e68ca7a0bf2d91a45b595caf4c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1/2e1d65f7-3ba2-580b-ba0d-4c6e2a5f71e1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/1d/671d39a5881c16a453b139388428f903/pa/AU31378_12dc453e69f9b11a5a47cc707416337b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2017}
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU31378%27 HTTP/1.1" 200 None
2026-03-30 07:40:05 [auto1.de] INFO: Saving data for AU31378: {'created_time': 1774856405.715411, 'last_price_update_time': 1774856405.715429, 'auction_closing_time': 1774970911.0}
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU31378') HTTP/1.1" 204 0
2026-03-30 07:40:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 430b6825-cb6e-5afb-b495-3872ce577826 with identifier: DB97906
2026-03-30 07:40:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 430b6825-cb6e-5afb-b495-3872ce577826 with identifier: DB97906
2026-03-30 07:40:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 430b6825-cb6e-5afb-b495-3872ce577826 with identifier: DB97906 to the API
2026-03-30 07:40:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DB97906>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 200,
 'expiration_date': '2026-03-31T15:55:38Z',
 'fuel_type': 'petrol',
 'id': '430b6825-cb6e-5afb-b495-3872ce577826',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB97906',
 'listing': 'auction',
 'location': 'DE, Kitzingen',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 129227,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_06d52ebb201f0dacd91279a7c4f96918.jpg',
                'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_1f9fa583f075ea0807513e328578c3bb.jpg',
                'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_be2d55ca3bbe9e67c324021aa1a29a4c.jpg',
                'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_5c5010a496b2807549f76805ec2aef85.jpg',
                'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_b418be5c95f387651fa3a7de67991fc8.jpg',
                'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_abc60f05394ae1238a137b5c6444be9f.jpg',
                'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_36980b18c74568ae99b58cfee7e98b0f.jpg',
                'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_42ec50a332d9be8750351721e40ccc1c.jpg',
                'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_f6a4e267881bb695aeb3365e7b8b519b.jpg',
                'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_7e3dfe83a4de8836aa5c6dc35623e24d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430b6825-cb6e-5afb-b495-3872ce577826/430b6825-cb6e-5afb-b495-3872ce577826_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_06d52ebb201f0dacd91279a7c4f96918.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430b6825-cb6e-5afb-b495-3872ce577826/430b6825-cb6e-5afb-b495-3872ce577826_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81254,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_1f9fa583f075ea0807513e328578c3bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430b6825-cb6e-5afb-b495-3872ce577826/430b6825-cb6e-5afb-b495-3872ce577826_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91062,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_be2d55ca3bbe9e67c324021aa1a29a4c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430b6825-cb6e-5afb-b495-3872ce577826/430b6825-cb6e-5afb-b495-3872ce577826_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74504,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_5c5010a496b2807549f76805ec2aef85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430b6825-cb6e-5afb-b495-3872ce577826/430b6825-cb6e-5afb-b495-3872ce577826_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84020,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_b418be5c95f387651fa3a7de67991fc8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430b6825-cb6e-5afb-b495-3872ce577826/430b6825-cb6e-5afb-b495-3872ce577826_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_abc60f05394ae1238a137b5c6444be9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430b6825-cb6e-5afb-b495-3872ce577826/430b6825-cb6e-5afb-b495-3872ce577826_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829542,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_36980b18c74568ae99b58cfee7e98b0f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430b6825-cb6e-5afb-b495-3872ce577826/430b6825-cb6e-5afb-b495-3872ce577826_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3001069,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_42ec50a332d9be8750351721e40ccc1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430b6825-cb6e-5afb-b495-3872ce577826/430b6825-cb6e-5afb-b495-3872ce577826_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91673,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_f6a4e267881bb695aeb3365e7b8b519b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_430b6825-cb6e-5afb-b495-3872ce577826/430b6825-cb6e-5afb-b495-3872ce577826_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img00/0e/000e0e144bb8e14b3ef25cb0184bfff0/pa/DB97906_7e3dfe83a4de8836aa5c6dc35623e24d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-12-18',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.6 THP GTi',
 'transmission': 'manual',
 'trim': 'GTi',
 'year': 2013}
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB97906%27 HTTP/1.1" 200 None
2026-03-30 07:40:06 [auto1.de] INFO: Saving data for DB97906: {'created_time': 1774856406.135332, 'last_price_update_time': 1774856406.135349, 'auction_closing_time': 1774972538.0}
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB97906') HTTP/1.1" 204 0
2026-03-30 07:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 629ea8b2-619e-5ae7-a3f5-494646ebc1ca with identifier: TF75057
2026-03-30 07:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 629ea8b2-619e-5ae7-a3f5-494646ebc1ca with identifier: TF75057
2026-03-30 07:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 629ea8b2-619e-5ae7-a3f5-494646ebc1ca with identifier: TF75057 to the API
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:09:49Z',
 'fuel_type': 'petrol',
 'id': '629ea8b2-619e-5ae7-a3f5-494646ebc1ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF75057',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 55247,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-29',
 'seller_name': None,
 'title': 'Mazda 5 2.0 Sendo',
 'transmission': 'manual',
 'trim': 'Sendo',
 'year': 2015}
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF75057%27 HTTP/1.1" 200 None
2026-03-30 07:40:06 [auto1.de] INFO: Saving data for TF75057: {'auction_closing_time': 1774969789.0, 'created_time': 1774380178.8505, 'last_price_update_time': 1774856406.464312}
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TF75057') HTTP/1.1" 204 0
2026-03-30 07:40:06 [auto1.de] INFO: Found listing with ID: HW52746
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW52746%27 HTTP/1.1" 200 None
2026-03-30 07:40:06 [auto1.de] INFO: Scrape type for HW52746: 1
2026-03-30 07:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XY36888/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:06 [auto1.de] INFO: Found listing with ID: TG66732
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG66732%27 HTTP/1.1" 200 None
2026-03-30 07:40:06 [auto1.de] INFO: Scrape type for TG66732: 2
2026-03-30 07:40:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3335f77b-8454-5f65-a8e1-c31558853734 with identifier: TG66732
2026-03-30 07:40:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3335f77b-8454-5f65-a8e1-c31558853734 with scrape type 2
2026-03-30 07:40:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3335f77b-8454-5f65-a8e1-c31558853734 with scrape type 2
2026-03-30 07:40:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3335f77b-8454-5f65-a8e1-c31558853734, identifier: TG66732
2026-03-30 07:40:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RS18612> (referer: https://www.auto1.com/v1/car-details-view/RS18612/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX60164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:06 [scrapy.extensions.logstats] INFO: Crawled 202 pages (at 46 pages/min), scraped 437 items (at 86 items/min)
2026-03-30 07:40:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:40:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3335f77b-8454-5f65-a8e1-c31558853734 with identifier: TG66732
2026-03-30 07:40:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3335f77b-8454-5f65-a8e1-c31558853734 with identifier: TG66732
2026-03-30 07:40:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3335f77b-8454-5f65-a8e1-c31558853734 with identifier: TG66732 to the API
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:38:49Z',
 'fuel_type': 'diesel',
 'id': '3335f77b-8454-5f65-a8e1-c31558853734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG66732',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 114013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-05',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 Blue-HDi Business M',
 'transmission': 'manual',
 'trim': 'Business M',
 'year': 2016}
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG66732%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [auto1.de] INFO: Saving data for TG66732: {'auction_closing_time': 1774971529.0, 'created_time': 1774294771.686511, 'last_price_update_time': 1774856407.082586}
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG66732') HTTP/1.1" 204 0
2026-03-30 07:40:07 [auto1.de] INFO: Found listing with ID: PX20909
2026-03-30 07:40:07 [auto1.de] INFO: Found listing with ID: CL67420
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67420%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [auto1.de] INFO: Scrape type for CL67420: 2
2026-03-30 07:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a43f07b-5983-50c6-b4e1-11444013dcca with identifier: CL67420
2026-03-30 07:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a43f07b-5983-50c6-b4e1-11444013dcca with scrape type 2
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a43f07b-5983-50c6-b4e1-11444013dcca with scrape type 2
2026-03-30 07:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a43f07b-5983-50c6-b4e1-11444013dcca, identifier: CL67420
2026-03-30 07:40:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79d8cb70-03d2-5424-bf77-c886d05a32dd with identifier: YL08953
2026-03-30 07:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79d8cb70-03d2-5424-bf77-c886d05a32dd with scrape type 1
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79d8cb70-03d2-5424-bf77-c886d05a32dd
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fcc%252F53cc7b61988f730f274fe1b12ebcb336%252Fpa%252FYL08953_3b6072c59bb309ed96e29daaecc0ca45.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_3b6072c59bb309ed96e29daaecc0ca45.jpg already downloaded
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fcc%252F53cc7b61988f730f274fe1b12ebcb336%252Fpa%252FYL08953_06b292dd52d31a0ffee151909bc50d40.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_06b292dd52d31a0ffee151909bc50d40.jpg already downloaded
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fcc%252F53cc7b61988f730f274fe1b12ebcb336%252Fpa%252FYL08953_12037b0f75aa4afd4d983b2a5c6ca431.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_12037b0f75aa4afd4d983b2a5c6ca431.jpg already downloaded
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fcc%252F53cc7b61988f730f274fe1b12ebcb336%252Fpa%252FYL08953_80abc6ee7dbb99bbaddb38003a091661.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_80abc6ee7dbb99bbaddb38003a091661.jpg already downloaded
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fcc%252F53cc7b61988f730f274fe1b12ebcb336%252Fpa%252FYL08953_df764a3c1269970d00ff1a8d04e4b0f4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_df764a3c1269970d00ff1a8d04e4b0f4.jpg already downloaded
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fcc%252F53cc7b61988f730f274fe1b12ebcb336%252Fpa%252FYL08953_222691870fc81ad36f88fe159ae98f72.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_222691870fc81ad36f88fe159ae98f72.jpg already downloaded
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fcc%252F53cc7b61988f730f274fe1b12ebcb336%252Fpa%252FYL08953_eafd9cf9b963400a751b9e6fb1680683.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_eafd9cf9b963400a751b9e6fb1680683.jpg already downloaded
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fcc%252F53cc7b61988f730f274fe1b12ebcb336%252Fpa%252FYL08953_38e69e64deeae84626fbd8fab260b4b3.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_38e69e64deeae84626fbd8fab260b4b3.jpg already downloaded
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fcc%252F53cc7b61988f730f274fe1b12ebcb336%252Fpa%252FYL08953_c249437d6bf50bbd4d65dd504fad86b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_c249437d6bf50bbd4d65dd504fad86b4.jpg already downloaded
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg53%252Fcc%252F53cc7b61988f730f274fe1b12ebcb336%252Fpa%252FYL08953_64afbf04c2f6bf78d4f7e626f3cd1603.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_64afbf04c2f6bf78d4f7e626f3cd1603.jpg already downloaded
2026-03-30 07:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79d8cb70-03d2-5424-bf77-c886d05a32dd, identifier: YL08953
2026-03-30 07:40:07 [auto1.de] INFO: Found listing with ID: KX83375
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83375%27 HTTP/1.1" 200 None
2026-03-30 07:40:07 [auto1.de] INFO: Scrape type for KX83375: 2
2026-03-30 07:40:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1dd91c5c-7498-5389-b526-f43d289fff3b with identifier: KX83375
2026-03-30 07:40:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1dd91c5c-7498-5389-b526-f43d289fff3b with scrape type 2
2026-03-30 07:40:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1dd91c5c-7498-5389-b526-f43d289fff3b with scrape type 2
2026-03-30 07:40:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1dd91c5c-7498-5389-b526-f43d289fff3b, identifier: KX83375
2026-03-30 07:40:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a43f07b-5983-50c6-b4e1-11444013dcca with identifier: CL67420
2026-03-30 07:40:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a43f07b-5983-50c6-b4e1-11444013dcca with identifier: CL67420
2026-03-30 07:40:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a43f07b-5983-50c6-b4e1-11444013dcca with identifier: CL67420 to the API
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:17:32Z',
 'fuel_type': 'petrol',
 'id': '8a43f07b-5983-50c6-b4e1-11444013dcca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL67420',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 182742,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2017}
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67420%27 HTTP/1.1" 200 None
2026-03-30 07:40:08 [auto1.de] INFO: Saving data for CL67420: {'auction_closing_time': 1774970252.0, 'created_time': 1774264687.480533, 'last_price_update_time': 1774856408.089395}
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL67420') HTTP/1.1" 204 0
2026-03-30 07:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79d8cb70-03d2-5424-bf77-c886d05a32dd with identifier: YL08953
2026-03-30 07:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79d8cb70-03d2-5424-bf77-c886d05a32dd with identifier: YL08953
2026-03-30 07:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79d8cb70-03d2-5424-bf77-c886d05a32dd with identifier: YL08953 to the API
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YL08953>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:05:37Z',
 'fuel_type': 'petrol',
 'id': '79d8cb70-03d2-5424-bf77-c886d05a32dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL08953',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 68473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_3b6072c59bb309ed96e29daaecc0ca45.jpg',
                'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_06b292dd52d31a0ffee151909bc50d40.jpg',
                'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_12037b0f75aa4afd4d983b2a5c6ca431.jpg',
                'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_80abc6ee7dbb99bbaddb38003a091661.jpg',
                'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_df764a3c1269970d00ff1a8d04e4b0f4.jpg',
                'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_222691870fc81ad36f88fe159ae98f72.jpg',
                'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_eafd9cf9b963400a751b9e6fb1680683.jpg',
                'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_38e69e64deeae84626fbd8fab260b4b3.jpg',
                'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_c249437d6bf50bbd4d65dd504fad86b4.jpg',
                'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_64afbf04c2f6bf78d4f7e626f3cd1603.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d8cb70-03d2-5424-bf77-c886d05a32dd/79d8cb70-03d2-5424-bf77-c886d05a32dd_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2596472,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_3b6072c59bb309ed96e29daaecc0ca45.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d8cb70-03d2-5424-bf77-c886d05a32dd/79d8cb70-03d2-5424-bf77-c886d05a32dd_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2503491,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_06b292dd52d31a0ffee151909bc50d40.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d8cb70-03d2-5424-bf77-c886d05a32dd/79d8cb70-03d2-5424-bf77-c886d05a32dd_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2486265,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_12037b0f75aa4afd4d983b2a5c6ca431.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d8cb70-03d2-5424-bf77-c886d05a32dd/79d8cb70-03d2-5424-bf77-c886d05a32dd_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2095081,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_80abc6ee7dbb99bbaddb38003a091661.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d8cb70-03d2-5424-bf77-c886d05a32dd/79d8cb70-03d2-5424-bf77-c886d05a32dd_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2560245,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_df764a3c1269970d00ff1a8d04e4b0f4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d8cb70-03d2-5424-bf77-c886d05a32dd/79d8cb70-03d2-5424-bf77-c886d05a32dd_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2605264,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_222691870fc81ad36f88fe159ae98f72.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d8cb70-03d2-5424-bf77-c886d05a32dd/79d8cb70-03d2-5424-bf77-c886d05a32dd_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2100882,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_eafd9cf9b963400a751b9e6fb1680683.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d8cb70-03d2-5424-bf77-c886d05a32dd/79d8cb70-03d2-5424-bf77-c886d05a32dd_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2258213,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_38e69e64deeae84626fbd8fab260b4b3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d8cb70-03d2-5424-bf77-c886d05a32dd/79d8cb70-03d2-5424-bf77-c886d05a32dd_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2612405,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_c249437d6bf50bbd4d65dd504fad86b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79d8cb70-03d2-5424-bf77-c886d05a32dd/79d8cb70-03d2-5424-bf77-c886d05a32dd_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2739759,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img53/cc/53cc7b61988f730f274fe1b12ebcb336/pa/YL08953_64afbf04c2f6bf78d4f7e626f3cd1603.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Design',
 'transmission': 'manual',
 'trim': 'Design',
 'year': 2017}
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL08953%27 HTTP/1.1" 200 None
2026-03-30 07:40:08 [auto1.de] INFO: Saving data for YL08953: {'created_time': 1774856408.474026, 'last_price_update_time': 1774856408.474036, 'auction_closing_time': 1774969537.0}
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL08953') HTTP/1.1" 204 0
2026-03-30 07:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1dd91c5c-7498-5389-b526-f43d289fff3b with identifier: KX83375
2026-03-30 07:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1dd91c5c-7498-5389-b526-f43d289fff3b with identifier: KX83375
2026-03-30 07:40:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1dd91c5c-7498-5389-b526-f43d289fff3b with identifier: KX83375 to the API
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:54:57Z',
 'fuel_type': 'diesel',
 'id': '1dd91c5c-7498-5389-b526-f43d289fff3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX83375',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 176807,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-06',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83375%27 HTTP/1.1" 200 None
2026-03-30 07:40:08 [auto1.de] INFO: Saving data for KX83375: {'auction_closing_time': 1774972497.0, 'created_time': 1773308320.404477, 'last_price_update_time': 1774856408.834609}
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX83375') HTTP/1.1" 204 0
2026-03-30 07:40:08 [auto1.de] INFO: Found listing with ID: CC87438
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC87438%27 HTTP/1.1" 200 None
2026-03-30 07:40:08 [auto1.de] INFO: Scrape type for CC87438: 2
2026-03-30 07:40:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b664e277-c8b7-5168-84f2-84e46d3f2522 with identifier: CC87438
2026-03-30 07:40:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b664e277-c8b7-5168-84f2-84e46d3f2522 with scrape type 2
2026-03-30 07:40:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b664e277-c8b7-5168-84f2-84e46d3f2522 with scrape type 2
2026-03-30 07:40:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b664e277-c8b7-5168-84f2-84e46d3f2522, identifier: CC87438
2026-03-30 07:40:08 [auto1.de] INFO: Found listing with ID: DM93215
2026-03-30 07:40:08 [auto1.de] INFO: Found listing with ID: EK40849
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK40849%27 HTTP/1.1" 200 None
2026-03-30 07:40:08 [auto1.de] INFO: Scrape type for EK40849: 1
2026-03-30 07:40:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b664e277-c8b7-5168-84f2-84e46d3f2522 with identifier: CC87438
2026-03-30 07:40:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b664e277-c8b7-5168-84f2-84e46d3f2522 with identifier: CC87438
2026-03-30 07:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b664e277-c8b7-5168-84f2-84e46d3f2522 with identifier: CC87438 to the API
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-31T15:58:07Z',
 'fuel_type': 'diesel',
 'id': 'b664e277-c8b7-5168-84f2-84e46d3f2522',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC87438',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'L 200',
 'odometer': 141580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-08',
 'seller_name': None,
 'title': 'Mitsubishi L 200 2.4 DI-D Top Doppelkabine 4WD',
 'transmission': 'automatic',
 'trim': 'Top Doppelkabine 4WD',
 'year': 2016}
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC87438%27 HTTP/1.1" 200 None
2026-03-30 07:40:09 [auto1.de] INFO: Saving data for CC87438: {'auction_closing_time': 1774972687.0, 'created_time': 1773307307.046583, 'last_price_update_time': 1774856409.300649}
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC87438') HTTP/1.1" 204 0
2026-03-30 07:40:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV48618> (referer: https://www.auto1.com/v1/car-details-view/PV48618/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba with identifier: RS18612
2026-03-30 07:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba with scrape type 1
2026-03-30 07:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F57%252Ff3571bee04728e6d4260d17ae2332c56%252Fpa%252FRS18612_9f3f39caad93e28735b5d69cdab4a060.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_9f3f39caad93e28735b5d69cdab4a060.jpg already downloaded
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F57%252Ff3571bee04728e6d4260d17ae2332c56%252Fpa%252FRS18612_a4f1c5742641d4ae9392e3ade5855dc2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_a4f1c5742641d4ae9392e3ade5855dc2.jpg already downloaded
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F57%252Ff3571bee04728e6d4260d17ae2332c56%252Fpa%252FRS18612_dbd89fbe0ed13bfb574a8e7174124338.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_dbd89fbe0ed13bfb574a8e7174124338.jpg already downloaded
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F57%252Ff3571bee04728e6d4260d17ae2332c56%252Fpa%252FRS18612_299be20bc04eeba1d4390a5570a34d34.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_299be20bc04eeba1d4390a5570a34d34.jpg already downloaded
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf3%252F57%252Ff3571bee04728e6d4260d17ae2332c56%252Fpa%252FRS18612_28c180e1d8b44a7dc293c776a5d19952.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_28c180e1d8b44a7dc293c776a5d19952.jpg already downloaded
2026-03-30 07:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba, identifier: RS18612
2026-03-30 07:40:09 [auto1.de] INFO: Found listing with ID: KA69379
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69379%27 HTTP/1.1" 200 None
2026-03-30 07:40:09 [auto1.de] INFO: Scrape type for KA69379: 2
2026-03-30 07:40:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6b93beb-ad22-5fe6-b463-c26f52032aea with identifier: KA69379
2026-03-30 07:40:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6b93beb-ad22-5fe6-b463-c26f52032aea with scrape type 2
2026-03-30 07:40:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6b93beb-ad22-5fe6-b463-c26f52032aea with scrape type 2
2026-03-30 07:40:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6b93beb-ad22-5fe6-b463-c26f52032aea, identifier: KA69379
2026-03-30 07:40:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba with identifier: RS18612
2026-03-30 07:40:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba with identifier: RS18612
2026-03-30 07:40:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba with identifier: RS18612 to the API
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RS18612>
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:18:17Z',
 'fuel_type': 'petrol',
 'id': 'c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS18612',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 215735,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_9f3f39caad93e28735b5d69cdab4a060.jpg',
                'https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_a4f1c5742641d4ae9392e3ade5855dc2.jpg',
                'https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_dbd89fbe0ed13bfb574a8e7174124338.jpg',
                'https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_299be20bc04eeba1d4390a5570a34d34.jpg',
                'https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_28c180e1d8b44a7dc293c776a5d19952.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba/c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103414,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_9f3f39caad93e28735b5d69cdab4a060.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba/c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85887,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_a4f1c5742641d4ae9392e3ade5855dc2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba/c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88750,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_dbd89fbe0ed13bfb574a8e7174124338.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba/c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80194,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_299be20bc04eeba1d4390a5570a34d34.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba/c4d0e2e4-f53f-59b1-8f4a-99a86ac69eba_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 174104,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf3/57/f3571bee04728e6d4260d17ae2332c56/pa/RS18612_28c180e1d8b44a7dc293c776a5d19952.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-29',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Opel Zafira 1.6 Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS18612%27 HTTP/1.1" 200 None
2026-03-30 07:40:09 [auto1.de] INFO: Saving data for RS18612: {'created_time': 1774856409.993667, 'last_price_update_time': 1774856409.99368, 'auction_closing_time': 1774970297.0}
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS18612') HTTP/1.1" 204 0
2026-03-30 07:40:10 [auto1.de] INFO: Found listing with ID: PU51927
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU51927%27 HTTP/1.1" 200 None
2026-03-30 07:40:10 [auto1.de] INFO: Scrape type for PU51927: 2
2026-03-30 07:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b3b53a1-9563-55da-b63b-8a9c65f5f718 with identifier: PU51927
2026-03-30 07:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b3b53a1-9563-55da-b63b-8a9c65f5f718 with scrape type 2
2026-03-30 07:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b3b53a1-9563-55da-b63b-8a9c65f5f718 with scrape type 2
2026-03-30 07:40:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b3b53a1-9563-55da-b63b-8a9c65f5f718, identifier: PU51927
2026-03-30 07:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6b93beb-ad22-5fe6-b463-c26f52032aea with identifier: KA69379
2026-03-30 07:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6b93beb-ad22-5fe6-b463-c26f52032aea with identifier: KA69379
2026-03-30 07:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6b93beb-ad22-5fe6-b463-c26f52032aea with identifier: KA69379 to the API
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-31T15:13:34Z',
 'fuel_type': 'petrol',
 'id': 'f6b93beb-ad22-5fe6-b463-c26f52032aea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA69379',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 140239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-29',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2016}
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69379%27 HTTP/1.1" 200 None
2026-03-30 07:40:10 [auto1.de] INFO: Saving data for KA69379: {'auction_closing_time': 1774970014.0, 'created_time': 1773302779.11839, 'last_price_update_time': 1774856410.53165}
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA69379') HTTP/1.1" 204 0
2026-03-30 07:40:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b3b53a1-9563-55da-b63b-8a9c65f5f718 with identifier: PU51927
2026-03-30 07:40:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b3b53a1-9563-55da-b63b-8a9c65f5f718 with identifier: PU51927
2026-03-30 07:40:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b3b53a1-9563-55da-b63b-8a9c65f5f718 with identifier: PU51927 to the API
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-31T15:13:36Z',
 'fuel_type': 'diesel',
 'id': '2b3b53a1-9563-55da-b63b-8a9c65f5f718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU51927',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 240479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-27',
 'seller_name': None,
 'title': 'BMW X4 xDrive 30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU51927%27 HTTP/1.1" 200 None
2026-03-30 07:40:10 [auto1.de] INFO: Saving data for PU51927: {'auction_closing_time': 1774970016.0, 'created_time': 1773687141.844171, 'last_price_update_time': 1774856410.920297}
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PU51927') HTTP/1.1" 204 0
2026-03-30 07:40:10 [auto1.de] INFO: Found listing with ID: WM40779
2026-03-30 07:40:10 [auto1.de] INFO: Found listing with ID: CJ14168
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ14168%27 HTTP/1.1" 200 None
2026-03-30 07:40:10 [auto1.de] INFO: Scrape type for CJ14168: 2
2026-03-30 07:40:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b872817c-8bb6-5d9d-be18-07484ffc75f5 with identifier: CJ14168
2026-03-30 07:40:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b872817c-8bb6-5d9d-be18-07484ffc75f5 with scrape type 2
2026-03-30 07:40:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b872817c-8bb6-5d9d-be18-07484ffc75f5 with scrape type 2
2026-03-30 07:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b872817c-8bb6-5d9d-be18-07484ffc75f5, identifier: CJ14168
2026-03-30 07:40:11 [auto1.de] INFO: Found listing with ID: PL78548
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78548%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [auto1.de] INFO: Scrape type for PL78548: 1
2026-03-30 07:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b872817c-8bb6-5d9d-be18-07484ffc75f5 with identifier: CJ14168
2026-03-30 07:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b872817c-8bb6-5d9d-be18-07484ffc75f5 with identifier: CJ14168
2026-03-30 07:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b872817c-8bb6-5d9d-be18-07484ffc75f5 with identifier: CJ14168 to the API
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-31T15:46:51Z',
 'fuel_type': 'petrol',
 'id': 'b872817c-8bb6-5d9d-be18-07484ffc75f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ14168',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 188020,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.0 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ14168%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [auto1.de] INFO: Saving data for CJ14168: {'auction_closing_time': 1774972011.0, 'created_time': 1774263823.782666, 'last_price_update_time': 1774856411.398238}
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ14168') HTTP/1.1" 204 0
2026-03-30 07:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KP36820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KU11171/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY32033> (referer: https://www.auto1.com/v1/car-details-view/SY32033/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB30434/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecb44b39-d11c-5dc0-94b3-a29f41e4e22a with identifier: PV48618
2026-03-30 07:40:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecb44b39-d11c-5dc0-94b3-a29f41e4e22a with scrape type 1
2026-03-30 07:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecb44b39-d11c-5dc0-94b3-a29f41e4e22a
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc1%252F50c163893cea63fd8a3ca54fa71af49d%252Fpa%252FPV48618_53dbe799444910ecd43b25b1fc271d16.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_53dbe799444910ecd43b25b1fc271d16.jpg already downloaded
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc1%252F50c163893cea63fd8a3ca54fa71af49d%252Fpa%252FPV48618_29636976e61205e161baa36cc456d345.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_29636976e61205e161baa36cc456d345.jpg already downloaded
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc1%252F50c163893cea63fd8a3ca54fa71af49d%252Fpa%252FPV48618_46b97d9798faf42e04b242f8e8d366a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_46b97d9798faf42e04b242f8e8d366a2.jpg already downloaded
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc1%252F50c163893cea63fd8a3ca54fa71af49d%252Fpa%252FPV48618_cd5794bd3baeab2726a5964124727853.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_cd5794bd3baeab2726a5964124727853.jpg already downloaded
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc1%252F50c163893cea63fd8a3ca54fa71af49d%252Fpa%252FPV48618_21e2f313558106c91efd94d40161a892.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_21e2f313558106c91efd94d40161a892.jpg already downloaded
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc1%252F50c163893cea63fd8a3ca54fa71af49d%252Fpa%252FPV48618_cb07ed441f852b80f6a74c4315db3dd6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_cb07ed441f852b80f6a74c4315db3dd6.jpg already downloaded
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc1%252F50c163893cea63fd8a3ca54fa71af49d%252Fpa%252FPV48618_eb69c36bc6d9d72f7d9d4d2b707a078f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_eb69c36bc6d9d72f7d9d4d2b707a078f.jpg already downloaded
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc1%252F50c163893cea63fd8a3ca54fa71af49d%252Fpa%252FPV48618_ad92d03d0c4a951d4081c9a48db66827.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_ad92d03d0c4a951d4081c9a48db66827.jpg already downloaded
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc1%252F50c163893cea63fd8a3ca54fa71af49d%252Fpa%252FPV48618_3ca6481f92566ade3cb16a30f0670b81.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_3ca6481f92566ade3cb16a30f0670b81.jpg already downloaded
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg50%252Fc1%252F50c163893cea63fd8a3ca54fa71af49d%252Fpa%252FPV48618_e7379834db269f43929b64dd68031cf9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_e7379834db269f43929b64dd68031cf9.jpg already downloaded
2026-03-30 07:40:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecb44b39-d11c-5dc0-94b3-a29f41e4e22a, identifier: PV48618
2026-03-30 07:40:11 [auto1.de] INFO: Found listing with ID: FR51775
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR51775%27 HTTP/1.1" 200 None
2026-03-30 07:40:11 [auto1.de] INFO: Scrape type for FR51775: 1
2026-03-30 07:40:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecb44b39-d11c-5dc0-94b3-a29f41e4e22a with identifier: PV48618
2026-03-30 07:40:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecb44b39-d11c-5dc0-94b3-a29f41e4e22a with identifier: PV48618
2026-03-30 07:40:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecb44b39-d11c-5dc0-94b3-a29f41e4e22a with identifier: PV48618 to the API
2026-03-30 07:40:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PV48618>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-31T15:34:19Z',
 'fuel_type': 'petrol',
 'id': 'ecb44b39-d11c-5dc0-94b3-a29f41e4e22a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV48618',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 113724,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_53dbe799444910ecd43b25b1fc271d16.jpg',
                'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_29636976e61205e161baa36cc456d345.jpg',
                'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_46b97d9798faf42e04b242f8e8d366a2.jpg',
                'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_cd5794bd3baeab2726a5964124727853.jpg',
                'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_21e2f313558106c91efd94d40161a892.jpg',
                'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_cb07ed441f852b80f6a74c4315db3dd6.jpg',
                'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_eb69c36bc6d9d72f7d9d4d2b707a078f.jpg',
                'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_ad92d03d0c4a951d4081c9a48db66827.jpg',
                'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_3ca6481f92566ade3cb16a30f0670b81.jpg',
                'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_e7379834db269f43929b64dd68031cf9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb44b39-d11c-5dc0-94b3-a29f41e4e22a/ecb44b39-d11c-5dc0-94b3-a29f41e4e22a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2828282,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_53dbe799444910ecd43b25b1fc271d16.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb44b39-d11c-5dc0-94b3-a29f41e4e22a/ecb44b39-d11c-5dc0-94b3-a29f41e4e22a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2895337,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_29636976e61205e161baa36cc456d345.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb44b39-d11c-5dc0-94b3-a29f41e4e22a/ecb44b39-d11c-5dc0-94b3-a29f41e4e22a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2794604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_46b97d9798faf42e04b242f8e8d366a2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb44b39-d11c-5dc0-94b3-a29f41e4e22a/ecb44b39-d11c-5dc0-94b3-a29f41e4e22a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2737063,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_cd5794bd3baeab2726a5964124727853.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb44b39-d11c-5dc0-94b3-a29f41e4e22a/ecb44b39-d11c-5dc0-94b3-a29f41e4e22a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2623098,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_21e2f313558106c91efd94d40161a892.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb44b39-d11c-5dc0-94b3-a29f41e4e22a/ecb44b39-d11c-5dc0-94b3-a29f41e4e22a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2760440,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_cb07ed441f852b80f6a74c4315db3dd6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb44b39-d11c-5dc0-94b3-a29f41e4e22a/ecb44b39-d11c-5dc0-94b3-a29f41e4e22a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2769928,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_eb69c36bc6d9d72f7d9d4d2b707a078f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb44b39-d11c-5dc0-94b3-a29f41e4e22a/ecb44b39-d11c-5dc0-94b3-a29f41e4e22a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2896956,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_ad92d03d0c4a951d4081c9a48db66827.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb44b39-d11c-5dc0-94b3-a29f41e4e22a/ecb44b39-d11c-5dc0-94b3-a29f41e4e22a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2719234,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_3ca6481f92566ade3cb16a30f0670b81.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecb44b39-d11c-5dc0-94b3-a29f41e4e22a/ecb44b39-d11c-5dc0-94b3-a29f41e4e22a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2824090,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img50/c1/50c163893cea63fd8a3ca54fa71af49d/pa/PV48618_e7379834db269f43929b64dd68031cf9.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-08-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Ibiza 1.0 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2017}
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV48618%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [auto1.de] INFO: Saving data for PV48618: {'created_time': 1774856412.139678, 'last_price_update_time': 1774856412.139689, 'auction_closing_time': 1774971259.0}
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV48618') HTTP/1.1" 204 0
2026-03-30 07:40:12 [auto1.de] INFO: Found listing with ID: FD53596
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD53596%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [auto1.de] INFO: Scrape type for FD53596: 1
2026-03-30 07:40:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:12 [auto1.de] INFO: Found listing with ID: VP95743
2026-03-30 07:40:12 [auto1.de] INFO: Found listing with ID: BV91761
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV91761%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [auto1.de] INFO: Scrape type for BV91761: 2
2026-03-30 07:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d75aec62-f31c-5f94-8d6e-15de1f25b928 with identifier: BV91761
2026-03-30 07:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d75aec62-f31c-5f94-8d6e-15de1f25b928 with scrape type 2
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d75aec62-f31c-5f94-8d6e-15de1f25b928 with scrape type 2
2026-03-30 07:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d75aec62-f31c-5f94-8d6e-15de1f25b928, identifier: BV91761
2026-03-30 07:40:12 [auto1.de] INFO: Found listing with ID: RD37486
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD37486%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [auto1.de] INFO: Scrape type for RD37486: 1
2026-03-30 07:40:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d75aec62-f31c-5f94-8d6e-15de1f25b928 with identifier: BV91761
2026-03-30 07:40:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d75aec62-f31c-5f94-8d6e-15de1f25b928 with identifier: BV91761
2026-03-30 07:40:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d75aec62-f31c-5f94-8d6e-15de1f25b928 with identifier: BV91761 to the API
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:33:12Z',
 'fuel_type': 'petrol',
 'id': 'd75aec62-f31c-5f94-8d6e-15de1f25b928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV91761',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 86770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-19',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2018}
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV91761%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [auto1.de] INFO: Saving data for BV91761: {'auction_closing_time': 1774971192.0, 'created_time': 1773659459.505081, 'last_price_update_time': 1774856412.676545}
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV91761') HTTP/1.1" 204 0
2026-03-30 07:40:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 522a6055-0a99-59be-bd92-6e04ed9d39ee with identifier: SY32033
2026-03-30 07:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 522a6055-0a99-59be-bd92-6e04ed9d39ee with scrape type 1
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 522a6055-0a99-59be-bd92-6e04ed9d39ee
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F94%252Faa94fe9be04a78b9e12d4df3b19e5c2f%252Fpa%252FSY32033_d9067e5176015e8a55c0f035dec9b970.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_d9067e5176015e8a55c0f035dec9b970.jpg already downloaded
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F94%252Faa94fe9be04a78b9e12d4df3b19e5c2f%252Fpa%252FSY32033_da9ab72ac75c91d00be53d63bba95c21.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_da9ab72ac75c91d00be53d63bba95c21.jpg already downloaded
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F94%252Faa94fe9be04a78b9e12d4df3b19e5c2f%252Fpa%252FSY32033_d060c06197e8c1a6968c177e172a03dd.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_d060c06197e8c1a6968c177e172a03dd.jpg already downloaded
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F94%252Faa94fe9be04a78b9e12d4df3b19e5c2f%252Fpa%252FSY32033_7c685cf4d35d74af204434a2c9e01dca.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_7c685cf4d35d74af204434a2c9e01dca.jpg already downloaded
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F94%252Faa94fe9be04a78b9e12d4df3b19e5c2f%252Fpa%252FSY32033_f356579970d69c4490eb12ef820dbe39.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_f356579970d69c4490eb12ef820dbe39.jpg already downloaded
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F94%252Faa94fe9be04a78b9e12d4df3b19e5c2f%252Fpa%252FSY32033_aa30ac6cb8d3ee2d676769b5b37a47bb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_aa30ac6cb8d3ee2d676769b5b37a47bb.jpg already downloaded
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F94%252Faa94fe9be04a78b9e12d4df3b19e5c2f%252Fpa%252FSY32033_9ce5b7102cd5bd3a0c263b8103ef72a2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_9ce5b7102cd5bd3a0c263b8103ef72a2.jpg already downloaded
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F94%252Faa94fe9be04a78b9e12d4df3b19e5c2f%252Fpa%252FSY32033_0badbbda180e0d65f4dc4f46fb6d606f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_0badbbda180e0d65f4dc4f46fb6d606f.jpg already downloaded
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F94%252Faa94fe9be04a78b9e12d4df3b19e5c2f%252Fpa%252FSY32033_78a701b197da2a5feace696b524bf3b6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_78a701b197da2a5feace696b524bf3b6.jpg already downloaded
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgaa%252F94%252Faa94fe9be04a78b9e12d4df3b19e5c2f%252Fpa%252FSY32033_7c7e972522494c2243435c52306fb7c6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_7c7e972522494c2243435c52306fb7c6.jpg already downloaded
2026-03-30 07:40:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 522a6055-0a99-59be-bd92-6e04ed9d39ee, identifier: SY32033
2026-03-30 07:40:12 [auto1.de] INFO: Found listing with ID: UP50948
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP50948%27 HTTP/1.1" 200 None
2026-03-30 07:40:12 [auto1.de] INFO: Scrape type for UP50948: 2
2026-03-30 07:40:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a96ca92-fe95-5632-80f5-7e3a956eea45 with identifier: UP50948
2026-03-30 07:40:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a96ca92-fe95-5632-80f5-7e3a956eea45 with scrape type 2
2026-03-30 07:40:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a96ca92-fe95-5632-80f5-7e3a956eea45 with scrape type 2
2026-03-30 07:40:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a96ca92-fe95-5632-80f5-7e3a956eea45, identifier: UP50948
2026-03-30 07:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 522a6055-0a99-59be-bd92-6e04ed9d39ee with identifier: SY32033
2026-03-30 07:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 522a6055-0a99-59be-bd92-6e04ed9d39ee with identifier: SY32033
2026-03-30 07:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 522a6055-0a99-59be-bd92-6e04ed9d39ee with identifier: SY32033 to the API
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SY32033>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'engine_horse_power': 73,
 'expiration_date': '2026-03-31T15:25:17Z',
 'fuel_type': 'petrol',
 'id': '522a6055-0a99-59be-bd92-6e04ed9d39ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY32033',
 'listing': 'auction',
 'location': 'DE, Zörbig',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 59805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_d9067e5176015e8a55c0f035dec9b970.jpg',
                'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_da9ab72ac75c91d00be53d63bba95c21.jpg',
                'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_d060c06197e8c1a6968c177e172a03dd.jpg',
                'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_7c685cf4d35d74af204434a2c9e01dca.jpg',
                'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_f356579970d69c4490eb12ef820dbe39.jpg',
                'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_aa30ac6cb8d3ee2d676769b5b37a47bb.jpg',
                'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_9ce5b7102cd5bd3a0c263b8103ef72a2.jpg',
                'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_0badbbda180e0d65f4dc4f46fb6d606f.jpg',
                'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_78a701b197da2a5feace696b524bf3b6.jpg',
                'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_7c7e972522494c2243435c52306fb7c6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_522a6055-0a99-59be-bd92-6e04ed9d39ee/522a6055-0a99-59be-bd92-6e04ed9d39ee_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82508,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_d9067e5176015e8a55c0f035dec9b970.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_522a6055-0a99-59be-bd92-6e04ed9d39ee/522a6055-0a99-59be-bd92-6e04ed9d39ee_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_da9ab72ac75c91d00be53d63bba95c21.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_522a6055-0a99-59be-bd92-6e04ed9d39ee/522a6055-0a99-59be-bd92-6e04ed9d39ee_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_d060c06197e8c1a6968c177e172a03dd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_522a6055-0a99-59be-bd92-6e04ed9d39ee/522a6055-0a99-59be-bd92-6e04ed9d39ee_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_7c685cf4d35d74af204434a2c9e01dca.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_522a6055-0a99-59be-bd92-6e04ed9d39ee/522a6055-0a99-59be-bd92-6e04ed9d39ee_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68316,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_f356579970d69c4490eb12ef820dbe39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_522a6055-0a99-59be-bd92-6e04ed9d39ee/522a6055-0a99-59be-bd92-6e04ed9d39ee_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78967,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_aa30ac6cb8d3ee2d676769b5b37a47bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_522a6055-0a99-59be-bd92-6e04ed9d39ee/522a6055-0a99-59be-bd92-6e04ed9d39ee_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_9ce5b7102cd5bd3a0c263b8103ef72a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_522a6055-0a99-59be-bd92-6e04ed9d39ee/522a6055-0a99-59be-bd92-6e04ed9d39ee_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88549,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_0badbbda180e0d65f4dc4f46fb6d606f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_522a6055-0a99-59be-bd92-6e04ed9d39ee/522a6055-0a99-59be-bd92-6e04ed9d39ee_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83649,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_78a701b197da2a5feace696b524bf3b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_522a6055-0a99-59be-bd92-6e04ed9d39ee/522a6055-0a99-59be-bd92-6e04ed9d39ee_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgaa/94/aa94fe9be04a78b9e12d4df3b19e5c2f/pa/SY32033_7c7e972522494c2243435c52306fb7c6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-07-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.2 Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2018}
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY32033%27 HTTP/1.1" 200 None
2026-03-30 07:40:13 [auto1.de] INFO: Saving data for SY32033: {'created_time': 1774856413.563203, 'last_price_update_time': 1774856413.563215, 'auction_closing_time': 1774970717.0}
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SY32033') HTTP/1.1" 204 0
2026-03-30 07:40:13 [auto1.de] INFO: Found listing with ID: HW52746
2026-03-30 07:40:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a96ca92-fe95-5632-80f5-7e3a956eea45 with identifier: UP50948
2026-03-30 07:40:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a96ca92-fe95-5632-80f5-7e3a956eea45 with identifier: UP50948
2026-03-30 07:40:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a96ca92-fe95-5632-80f5-7e3a956eea45 with identifier: UP50948 to the API
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:59:57Z',
 'fuel_type': 'diesel',
 'id': '5a96ca92-fe95-5632-80f5-7e3a956eea45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UP50948',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 48755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-14',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP50948%27 HTTP/1.1" 200 None
2026-03-30 07:40:13 [auto1.de] INFO: Saving data for UP50948: {'auction_closing_time': 1774972797.0, 'created_time': 1773775892.89581, 'last_price_update_time': 1774856413.90945}
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UP50948') HTTP/1.1" 204 0
2026-03-30 07:40:13 [auto1.de] INFO: Found listing with ID: CY77324
2026-03-30 07:40:13 [auto1.de] INFO: Found listing with ID: TX22736
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX22736%27 HTTP/1.1" 200 None
2026-03-30 07:40:13 [auto1.de] INFO: Scrape type for TX22736: 2
2026-03-30 07:40:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fe085a4-d4ac-5f2f-a463-f78ba330698e with identifier: TX22736
2026-03-30 07:40:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe085a4-d4ac-5f2f-a463-f78ba330698e with scrape type 2
2026-03-30 07:40:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fe085a4-d4ac-5f2f-a463-f78ba330698e with scrape type 2
2026-03-30 07:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fe085a4-d4ac-5f2f-a463-f78ba330698e, identifier: TX22736
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: PX20909
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: CL67420
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67420%27 HTTP/1.1" 200 None
2026-03-30 07:40:14 [auto1.de] INFO: Scrape type for CL67420: 0
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: CC87438
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC87438%27 HTTP/1.1" 200 None
2026-03-30 07:40:14 [auto1.de] INFO: Scrape type for CC87438: 0
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: KA69379
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA69379%27 HTTP/1.1" 200 None
2026-03-30 07:40:14 [auto1.de] INFO: Scrape type for KA69379: 0
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: WM40779
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: CJ14168
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ14168%27 HTTP/1.1" 200 None
2026-03-30 07:40:14 [auto1.de] INFO: Scrape type for CJ14168: 0
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: FR51775
2026-03-30 07:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fe085a4-d4ac-5f2f-a463-f78ba330698e with identifier: TX22736
2026-03-30 07:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fe085a4-d4ac-5f2f-a463-f78ba330698e with identifier: TX22736
2026-03-30 07:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fe085a4-d4ac-5f2f-a463-f78ba330698e with identifier: TX22736 to the API
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:56:01Z',
 'fuel_type': 'diesel',
 'id': '2fe085a4-d4ac-5f2f-a463-f78ba330698e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX22736',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 239956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-24',
 'seller_name': None,
 'title': 'Renault Espace 2.0 dCi Celsium',
 'transmission': 'manual',
 'trim': 'Celsium',
 'year': 2011}
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX22736%27 HTTP/1.1" 200 None
2026-03-30 07:40:14 [auto1.de] INFO: Saving data for TX22736: {'auction_closing_time': 1774972561.0, 'created_time': 1773133076.150751, 'last_price_update_time': 1774856414.456009}
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX22736') HTTP/1.1" 204 0
2026-03-30 07:40:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: KP46159
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: YF64568
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF64568%27 HTTP/1.1" 200 None
2026-03-30 07:40:14 [auto1.de] INFO: Scrape type for YF64568: 2
2026-03-30 07:40:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42721902-2066-5dcc-be3a-d6dceb3d0c91 with identifier: YF64568
2026-03-30 07:40:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42721902-2066-5dcc-be3a-d6dceb3d0c91 with scrape type 2
2026-03-30 07:40:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42721902-2066-5dcc-be3a-d6dceb3d0c91 with scrape type 2
2026-03-30 07:40:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42721902-2066-5dcc-be3a-d6dceb3d0c91, identifier: YF64568
2026-03-30 07:40:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: VP95743
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: BV91761
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV91761%27 HTTP/1.1" 200 None
2026-03-30 07:40:14 [auto1.de] INFO: Scrape type for BV91761: 0
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: UP50948
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP50948%27 HTTP/1.1" 200 None
2026-03-30 07:40:14 [auto1.de] INFO: Scrape type for UP50948: 0
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: CY77324
2026-03-30 07:40:14 [auto1.de] INFO: Found listing with ID: TX22736
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX22736%27 HTTP/1.1" 200 None
2026-03-30 07:40:14 [auto1.de] INFO: Scrape type for TX22736: 0
2026-03-30 07:40:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42721902-2066-5dcc-be3a-d6dceb3d0c91 with identifier: YF64568
2026-03-30 07:40:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42721902-2066-5dcc-be3a-d6dceb3d0c91 with identifier: YF64568
2026-03-30 07:40:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42721902-2066-5dcc-be3a-d6dceb3d0c91 with identifier: YF64568 to the API
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-31T15:13:00Z',
 'fuel_type': 'diesel',
 'id': '42721902-2066-5dcc-be3a-d6dceb3d0c91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF64568',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 99926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-07',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Design ultra',
 'transmission': 'manual',
 'trim': 'Design ultra',
 'year': 2017}
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF64568%27 HTTP/1.1" 200 None
2026-03-30 07:40:15 [auto1.de] INFO: Saving data for YF64568: {'auction_closing_time': 1774969980.0, 'created_time': 1774292732.917758, 'last_price_update_time': 1774856415.091572}
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF64568') HTTP/1.1" 204 0
2026-03-30 07:40:15 [auto1.de] INFO: Found listing with ID: AA32108
2026-03-30 07:40:15 [auto1.de] INFO: Found listing with ID: EN61962
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN61962%27 HTTP/1.1" 200 None
2026-03-30 07:40:15 [auto1.de] INFO: Scrape type for EN61962: 2
2026-03-30 07:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2035cd93-7907-5d89-9110-8832e54849c5 with identifier: EN61962
2026-03-30 07:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2035cd93-7907-5d89-9110-8832e54849c5 with scrape type 2
2026-03-30 07:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2035cd93-7907-5d89-9110-8832e54849c5 with scrape type 2
2026-03-30 07:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2035cd93-7907-5d89-9110-8832e54849c5, identifier: EN61962
2026-03-30 07:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2035cd93-7907-5d89-9110-8832e54849c5 with identifier: EN61962
2026-03-30 07:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2035cd93-7907-5d89-9110-8832e54849c5 with identifier: EN61962
2026-03-30 07:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2035cd93-7907-5d89-9110-8832e54849c5 with identifier: EN61962 to the API
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-31T15:59:23Z',
 'fuel_type': 'diesel',
 'id': '2035cd93-7907-5d89-9110-8832e54849c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN61962',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 200874,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-18',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi Mild-Hybrid 320 L2 Tourneo Titanium',
 'transmission': 'manual',
 'trim': '320 L2 Tourneo Titanium',
 'year': 2021}
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN61962%27 HTTP/1.1" 200 None
2026-03-30 07:40:15 [auto1.de] INFO: Saving data for EN61962: {'auction_closing_time': 1774972763.0, 'created_time': 1774638634.942679, 'last_price_update_time': 1774856415.574647}
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN61962') HTTP/1.1" 204 0
2026-03-30 07:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EK40849/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:15 [auto1.de] INFO: Channel: 24h | Page: 31 | totalHits: 7937 | hits on page: 40
2026-03-30 07:40:15 [auto1.de] INFO: Found listing with ID: ZG21023
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG21023%27 HTTP/1.1" 200 None
2026-03-30 07:40:15 [auto1.de] INFO: Scrape type for ZG21023: 2
2026-03-30 07:40:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52c07f79-58de-549a-ab34-55ec4d1e91c1 with identifier: ZG21023
2026-03-30 07:40:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52c07f79-58de-549a-ab34-55ec4d1e91c1 with scrape type 2
2026-03-30 07:40:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52c07f79-58de-549a-ab34-55ec4d1e91c1 with scrape type 2
2026-03-30 07:40:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52c07f79-58de-549a-ab34-55ec4d1e91c1, identifier: ZG21023
2026-03-30 07:40:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX60164> (referer: https://www.auto1.com/v1/car-details-view/VX60164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XY36888> (referer: https://www.auto1.com/v1/car-details-view/XY36888/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW52746/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52c07f79-58de-549a-ab34-55ec4d1e91c1 with identifier: ZG21023
2026-03-30 07:40:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52c07f79-58de-549a-ab34-55ec4d1e91c1 with identifier: ZG21023
2026-03-30 07:40:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52c07f79-58de-549a-ab34-55ec4d1e91c1 with identifier: ZG21023 to the API
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:39:52Z',
 'fuel_type': 'petrol',
 'id': '52c07f79-58de-549a-ab34-55ec4d1e91c1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG21023',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 72512,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2022}
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG21023%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Saving data for ZG21023: {'auction_closing_time': 1774971592.0, 'created_time': 1774294181.630397, 'last_price_update_time': 1774856416.092255}
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG21023') HTTP/1.1" 204 0
2026-03-30 07:40:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: MU18409
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW22041%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for XW22041: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: YW85241
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: UX63116
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: BX27275
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: XK12555
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: ZJ08126
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ08126%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for ZJ08126: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: VN44067
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN44067%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for VN44067: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: BR93746
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR93746%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for BR93746: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62397%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for PC62397: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV60507%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for JV60507: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR63828%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for ZR63828: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: PW74632
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: ME72449
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: KR66468
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: GN45872
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN45872%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for GN45872: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: RT76020
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: RV72396
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV72396%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for RV72396: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: PY88253
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY88253%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for PY88253: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: GE15008
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE15008%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for GE15008: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: SA16616
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: FH74417
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH74417%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for FH74417: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: RG72110
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG72110%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for RG72110: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB70277%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for AB70277: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN07930%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for GN07930: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34146%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for PJ34146: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU78317%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for SU78317: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY59919%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for PY59919: 0
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: BB43937
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB43937%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for BB43937: 1
2026-03-30 07:40:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: XC39500
2026-03-30 07:40:16 [auto1.de] INFO: Found listing with ID: SZ69357
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ69357%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [auto1.de] INFO: Scrape type for SZ69357: 2
2026-03-30 07:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357
2026-03-30 07:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea77ddc3-e24b-5693-bbcc-61718932a5cc with scrape type 2
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea77ddc3-e24b-5693-bbcc-61718932a5cc with scrape type 2
2026-03-30 07:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea77ddc3-e24b-5693-bbcc-61718932a5cc, identifier: SZ69357
2026-03-30 07:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR51775/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FD53596/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PL78548/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 620f6bf9-870f-5e3a-af08-7a1cb999e11d with identifier: VX60164
2026-03-30 07:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 620f6bf9-870f-5e3a-af08-7a1cb999e11d with scrape type 1
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 620f6bf9-870f-5e3a-af08-7a1cb999e11d
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb833ce9758bdf16b013d0188abe004e0%252Fpa%252FVX60164_a0d1663ccb69e3a87e13ca0519df5c05.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_a0d1663ccb69e3a87e13ca0519df5c05.jpg already downloaded
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb833ce9758bdf16b013d0188abe004e0%252Fpa%252FVX60164_323aafcdc2f9b0549cdd39b23f5b8a35.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_323aafcdc2f9b0549cdd39b23f5b8a35.jpg already downloaded
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb833ce9758bdf16b013d0188abe004e0%252Fpa%252FVX60164_a7cda1116ed81d74d06eade3f7d4d52b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_a7cda1116ed81d74d06eade3f7d4d52b.jpg already downloaded
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb833ce9758bdf16b013d0188abe004e0%252Fpa%252FVX60164_4d671e697c2cf18bdaca0f0a3d373ddb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_4d671e697c2cf18bdaca0f0a3d373ddb.jpg already downloaded
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb833ce9758bdf16b013d0188abe004e0%252Fpa%252FVX60164_ab661739b1008c812f4f77e358fa7430.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_ab661739b1008c812f4f77e358fa7430.jpg already downloaded
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb833ce9758bdf16b013d0188abe004e0%252Fpa%252FVX60164_7f37c4bc036029de73264a17db0d1ad7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_7f37c4bc036029de73264a17db0d1ad7.jpg already downloaded
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb833ce9758bdf16b013d0188abe004e0%252Fpa%252FVX60164_21fcef229e15f5c0f68f629b25320711.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_21fcef229e15f5c0f68f629b25320711.jpg already downloaded
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb833ce9758bdf16b013d0188abe004e0%252Fpa%252FVX60164_9a4f2d9d19b5b103e35b45a5a77f7b98.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_9a4f2d9d19b5b103e35b45a5a77f7b98.jpg already downloaded
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb833ce9758bdf16b013d0188abe004e0%252Fpa%252FVX60164_6d9021a348da068e94405f2a7ad672d8.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_6d9021a348da068e94405f2a7ad672d8.jpg already downloaded
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb8%252F33%252Fb833ce9758bdf16b013d0188abe004e0%252Fpa%252FVX60164_d8dda0d9360c6020a955577a621e7d91.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_d8dda0d9360c6020a955577a621e7d91.jpg already downloaded
2026-03-30 07:40:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 620f6bf9-870f-5e3a-af08-7a1cb999e11d, identifier: VX60164
2026-03-30 07:40:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adb76a8f-d966-502b-8b11-7975219e94db with identifier: XY36888
2026-03-30 07:40:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adb76a8f-d966-502b-8b11-7975219e94db with scrape type 1
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item adb76a8f-d966-502b-8b11-7975219e94db
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F65%252F9465da8d9db46120f7d4d4e51c8f6184%252Fpa%252FXY36888_ac118bfb51cb00d9c39f9b4afbf0c09b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_ac118bfb51cb00d9c39f9b4afbf0c09b.jpg already downloaded
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F65%252F9465da8d9db46120f7d4d4e51c8f6184%252Fpa%252FXY36888_553e6012c6208c0ba96703a7409449b1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_553e6012c6208c0ba96703a7409449b1.jpg already downloaded
2026-03-30 07:40:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F65%252F9465da8d9db46120f7d4d4e51c8f6184%252Fpa%252FXY36888_30999b71c7d63f0116d4d1c25cd0d274.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_30999b71c7d63f0116d4d1c25cd0d274.jpg already downloaded
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F65%252F9465da8d9db46120f7d4d4e51c8f6184%252Fpa%252FXY36888_3a19afc208a90b7d8ddd265fe19a6e68.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_3a19afc208a90b7d8ddd265fe19a6e68.jpg already downloaded
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg94%252F65%252F9465da8d9db46120f7d4d4e51c8f6184%252Fpa%252FXY36888_c859236b8c85ce1f99b30da22ad86e26.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_c859236b8c85ce1f99b30da22ad86e26.jpg already downloaded
2026-03-30 07:40:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: adb76a8f-d966-502b-8b11-7975219e94db, identifier: XY36888
2026-03-30 07:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357
2026-03-30 07:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357
2026-03-30 07:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea77ddc3-e24b-5693-bbcc-61718932a5cc with identifier: SZ69357 to the API
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-31T15:45:35Z',
 'fuel_type': 'petrol',
 'id': 'ea77ddc3-e24b-5693-bbcc-61718932a5cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ69357',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS3 Crossback',
 'odometer': 45548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-21',
 'seller_name': None,
 'title': 'DS Automobiles DS3 Crossback 1.2 PureTech So Chic',
 'transmission': 'manual',
 'trim': 'So Chic',
 'year': 2020}
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ69357%27 HTTP/1.1" 200 None
2026-03-30 07:40:17 [auto1.de] INFO: Saving data for SZ69357: {'auction_closing_time': 1774971935.0, 'created_time': 1774607749.196827, 'last_price_update_time': 1774856417.499991}
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ69357') HTTP/1.1" 204 0
2026-03-30 07:40:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 620f6bf9-870f-5e3a-af08-7a1cb999e11d with identifier: VX60164
2026-03-30 07:40:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 620f6bf9-870f-5e3a-af08-7a1cb999e11d with identifier: VX60164
2026-03-30 07:40:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 620f6bf9-870f-5e3a-af08-7a1cb999e11d with identifier: VX60164 to the API
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VX60164>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:59:47Z',
 'fuel_type': 'petrol',
 'id': '620f6bf9-870f-5e3a-af08-7a1cb999e11d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX60164',
 'listing': 'auction',
 'location': 'DE, Zülpich',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 61142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_a0d1663ccb69e3a87e13ca0519df5c05.jpg',
                'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_323aafcdc2f9b0549cdd39b23f5b8a35.jpg',
                'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_a7cda1116ed81d74d06eade3f7d4d52b.jpg',
                'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_4d671e697c2cf18bdaca0f0a3d373ddb.jpg',
                'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_ab661739b1008c812f4f77e358fa7430.jpg',
                'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_7f37c4bc036029de73264a17db0d1ad7.jpg',
                'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_21fcef229e15f5c0f68f629b25320711.jpg',
                'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_9a4f2d9d19b5b103e35b45a5a77f7b98.jpg',
                'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_6d9021a348da068e94405f2a7ad672d8.jpg',
                'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_d8dda0d9360c6020a955577a621e7d91.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_620f6bf9-870f-5e3a-af08-7a1cb999e11d/620f6bf9-870f-5e3a-af08-7a1cb999e11d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_a0d1663ccb69e3a87e13ca0519df5c05.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_620f6bf9-870f-5e3a-af08-7a1cb999e11d/620f6bf9-870f-5e3a-af08-7a1cb999e11d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72546,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_323aafcdc2f9b0549cdd39b23f5b8a35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_620f6bf9-870f-5e3a-af08-7a1cb999e11d/620f6bf9-870f-5e3a-af08-7a1cb999e11d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_a7cda1116ed81d74d06eade3f7d4d52b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_620f6bf9-870f-5e3a-af08-7a1cb999e11d/620f6bf9-870f-5e3a-af08-7a1cb999e11d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49992,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_4d671e697c2cf18bdaca0f0a3d373ddb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_620f6bf9-870f-5e3a-af08-7a1cb999e11d/620f6bf9-870f-5e3a-af08-7a1cb999e11d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65544,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_ab661739b1008c812f4f77e358fa7430.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_620f6bf9-870f-5e3a-af08-7a1cb999e11d/620f6bf9-870f-5e3a-af08-7a1cb999e11d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_7f37c4bc036029de73264a17db0d1ad7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_620f6bf9-870f-5e3a-af08-7a1cb999e11d/620f6bf9-870f-5e3a-af08-7a1cb999e11d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_21fcef229e15f5c0f68f629b25320711.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_620f6bf9-870f-5e3a-af08-7a1cb999e11d/620f6bf9-870f-5e3a-af08-7a1cb999e11d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66933,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_9a4f2d9d19b5b103e35b45a5a77f7b98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_620f6bf9-870f-5e3a-af08-7a1cb999e11d/620f6bf9-870f-5e3a-af08-7a1cb999e11d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72521,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_6d9021a348da068e94405f2a7ad672d8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_620f6bf9-870f-5e3a-af08-7a1cb999e11d/620f6bf9-870f-5e3a-af08-7a1cb999e11d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60079,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb8/33/b833ce9758bdf16b013d0188abe004e0/pa/VX60164_d8dda0d9360c6020a955577a621e7d91.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-12-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Ambition Outdoor',
 'transmission': 'automatic',
 'trim': 'Ambition Outdoor',
 'year': 2014}
2026-03-30 07:40:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX60164%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [auto1.de] INFO: Saving data for VX60164: {'created_time': 1774856418.002511, 'last_price_update_time': 1774856418.002528, 'auction_closing_time': 1774972787.0}
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX60164') HTTP/1.1" 204 0
2026-03-30 07:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: adb76a8f-d966-502b-8b11-7975219e94db with identifier: XY36888
2026-03-30 07:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: adb76a8f-d966-502b-8b11-7975219e94db with identifier: XY36888
2026-03-30 07:40:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: adb76a8f-d966-502b-8b11-7975219e94db with identifier: XY36888 to the API
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XY36888>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.6L',
 'engine_horse_power': 107,
 'expiration_date': '2026-03-31T15:04:31Z',
 'fuel_type': 'petrol',
 'id': 'adb76a8f-d966-502b-8b11-7975219e94db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY36888',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 176918,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_ac118bfb51cb00d9c39f9b4afbf0c09b.jpg',
                'https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_553e6012c6208c0ba96703a7409449b1.jpg',
                'https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_30999b71c7d63f0116d4d1c25cd0d274.jpg',
                'https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_3a19afc208a90b7d8ddd265fe19a6e68.jpg',
                'https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_c859236b8c85ce1f99b30da22ad86e26.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb76a8f-d966-502b-8b11-7975219e94db/adb76a8f-d966-502b-8b11-7975219e94db_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67224,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_ac118bfb51cb00d9c39f9b4afbf0c09b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb76a8f-d966-502b-8b11-7975219e94db/adb76a8f-d966-502b-8b11-7975219e94db_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75926,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_553e6012c6208c0ba96703a7409449b1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb76a8f-d966-502b-8b11-7975219e94db/adb76a8f-d966-502b-8b11-7975219e94db_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85679,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_30999b71c7d63f0116d4d1c25cd0d274.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb76a8f-d966-502b-8b11-7975219e94db/adb76a8f-d966-502b-8b11-7975219e94db_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62308,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_3a19afc208a90b7d8ddd265fe19a6e68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_adb76a8f-d966-502b-8b11-7975219e94db/adb76a8f-d966-502b-8b11-7975219e94db_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img94/65/9465da8d9db46120f7d4d4e51c8f6184/pa/XY36888_c859236b8c85ce1f99b30da22ad86e26.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '1998-01-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Toyota Corolla 1.6 Terra',
 'transmission': 'automatic',
 'trim': 'Terra',
 'year': 1998}
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY36888%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [auto1.de] INFO: Saving data for XY36888: {'created_time': 1774856418.391531, 'last_price_update_time': 1774856418.391543, 'auction_closing_time': 1774969471.0}
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY36888') HTTP/1.1" 204 0
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: BP51481
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: MU18409
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: AA81624
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: XW22041
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW22041%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [auto1.de] INFO: Scrape type for XW22041: 0
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: MV69505
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: GT74179
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: ZP13586
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: LT01619
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: YW85241
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: UX63116
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: BX27275
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: XK12555
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: ZJ08126
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ08126%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [auto1.de] INFO: Scrape type for ZJ08126: 0
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: VN44067
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN44067%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [auto1.de] INFO: Scrape type for VN44067: 0
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: BR93746
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR93746%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [auto1.de] INFO: Scrape type for BR93746: 0
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: PC62397
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC62397%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [auto1.de] INFO: Scrape type for PC62397: 0
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: JV60507
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV60507%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [auto1.de] INFO: Scrape type for JV60507: 0
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: ZR63828
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR63828%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [auto1.de] INFO: Scrape type for ZR63828: 0
2026-03-30 07:40:18 [auto1.de] INFO: Found listing with ID: MT99965
2026-03-30 07:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB30434> (referer: https://www.auto1.com/v1/car-details-view/JB30434/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b260a6a-9efc-52ff-82c6-4c93bdca7217 with identifier: JB30434
2026-03-30 07:40:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b260a6a-9efc-52ff-82c6-4c93bdca7217 with scrape type 1
2026-03-30 07:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b260a6a-9efc-52ff-82c6-4c93bdca7217
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F0e%252F5c0e6d8a4c11353ebd3c7edbbec10ee0%252Fpa%252FJB30434_d2ae3b97e9e0a66bed407209fa4b1e4a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_d2ae3b97e9e0a66bed407209fa4b1e4a.jpg already downloaded
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F0e%252F5c0e6d8a4c11353ebd3c7edbbec10ee0%252Fpa%252FJB30434_7a677a23a2cc7c6c794d09535a5c1053.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_7a677a23a2cc7c6c794d09535a5c1053.jpg already downloaded
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F0e%252F5c0e6d8a4c11353ebd3c7edbbec10ee0%252Fpa%252FJB30434_972388ac7cdf4f51987c30c2540d7417.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_972388ac7cdf4f51987c30c2540d7417.jpg already downloaded
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F0e%252F5c0e6d8a4c11353ebd3c7edbbec10ee0%252Fpa%252FJB30434_0ea04f14a343b59e9a27340208b5dd85.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_0ea04f14a343b59e9a27340208b5dd85.jpg already downloaded
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F0e%252F5c0e6d8a4c11353ebd3c7edbbec10ee0%252Fpa%252FJB30434_6ffdb28c945ce38c95c7351d878ede1c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_6ffdb28c945ce38c95c7351d878ede1c.jpg already downloaded
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F0e%252F5c0e6d8a4c11353ebd3c7edbbec10ee0%252Fpa%252FJB30434_d1e764864de3d40d2797890ac84f70dc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_d1e764864de3d40d2797890ac84f70dc.jpg already downloaded
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F0e%252F5c0e6d8a4c11353ebd3c7edbbec10ee0%252Fpa%252FJB30434_e5cb30e19a66c056c304858b269d8121.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_e5cb30e19a66c056c304858b269d8121.jpg already downloaded
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F0e%252F5c0e6d8a4c11353ebd3c7edbbec10ee0%252Fpa%252FJB30434_0bfda7f7aa9555c661374378887bee7d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_0bfda7f7aa9555c661374378887bee7d.jpg already downloaded
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F0e%252F5c0e6d8a4c11353ebd3c7edbbec10ee0%252Fpa%252FJB30434_a86a14905bdfd297216e1c79b15a6501.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_a86a14905bdfd297216e1c79b15a6501.jpg already downloaded
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5c%252F0e%252F5c0e6d8a4c11353ebd3c7edbbec10ee0%252Fpa%252FJB30434_65e9f379afdc1e303daea010f1f37bfc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_65e9f379afdc1e303daea010f1f37bfc.jpg already downloaded
2026-03-30 07:40:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b260a6a-9efc-52ff-82c6-4c93bdca7217, identifier: JB30434
2026-03-30 07:40:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b260a6a-9efc-52ff-82c6-4c93bdca7217 with identifier: JB30434
2026-03-30 07:40:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b260a6a-9efc-52ff-82c6-4c93bdca7217 with identifier: JB30434
2026-03-30 07:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b260a6a-9efc-52ff-82c6-4c93bdca7217 with identifier: JB30434 to the API
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/JB30434>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 99,
 'expiration_date': '2026-03-31T15:07:27Z',
 'fuel_type': 'petrol',
 'id': '4b260a6a-9efc-52ff-82c6-4c93bdca7217',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB30434',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 52333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_d2ae3b97e9e0a66bed407209fa4b1e4a.jpg',
                'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_7a677a23a2cc7c6c794d09535a5c1053.jpg',
                'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_972388ac7cdf4f51987c30c2540d7417.jpg',
                'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_0ea04f14a343b59e9a27340208b5dd85.jpg',
                'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_6ffdb28c945ce38c95c7351d878ede1c.jpg',
                'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_d1e764864de3d40d2797890ac84f70dc.jpg',
                'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_e5cb30e19a66c056c304858b269d8121.jpg',
                'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_0bfda7f7aa9555c661374378887bee7d.jpg',
                'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_a86a14905bdfd297216e1c79b15a6501.jpg',
                'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_65e9f379afdc1e303daea010f1f37bfc.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b260a6a-9efc-52ff-82c6-4c93bdca7217/4b260a6a-9efc-52ff-82c6-4c93bdca7217_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_d2ae3b97e9e0a66bed407209fa4b1e4a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b260a6a-9efc-52ff-82c6-4c93bdca7217/4b260a6a-9efc-52ff-82c6-4c93bdca7217_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2631748,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_7a677a23a2cc7c6c794d09535a5c1053.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b260a6a-9efc-52ff-82c6-4c93bdca7217/4b260a6a-9efc-52ff-82c6-4c93bdca7217_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2625540,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_972388ac7cdf4f51987c30c2540d7417.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b260a6a-9efc-52ff-82c6-4c93bdca7217/4b260a6a-9efc-52ff-82c6-4c93bdca7217_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60669,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_0ea04f14a343b59e9a27340208b5dd85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b260a6a-9efc-52ff-82c6-4c93bdca7217/4b260a6a-9efc-52ff-82c6-4c93bdca7217_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2533822,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_6ffdb28c945ce38c95c7351d878ede1c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b260a6a-9efc-52ff-82c6-4c93bdca7217/4b260a6a-9efc-52ff-82c6-4c93bdca7217_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75686,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_d1e764864de3d40d2797890ac84f70dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b260a6a-9efc-52ff-82c6-4c93bdca7217/4b260a6a-9efc-52ff-82c6-4c93bdca7217_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2574906,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_e5cb30e19a66c056c304858b269d8121.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b260a6a-9efc-52ff-82c6-4c93bdca7217/4b260a6a-9efc-52ff-82c6-4c93bdca7217_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78273,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_0bfda7f7aa9555c661374378887bee7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b260a6a-9efc-52ff-82c6-4c93bdca7217/4b260a6a-9efc-52ff-82c6-4c93bdca7217_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672407,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_a86a14905bdfd297216e1c79b15a6501.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b260a6a-9efc-52ff-82c6-4c93bdca7217/4b260a6a-9efc-52ff-82c6-4c93bdca7217_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2973424,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img5c/0e/5c0e6d8a4c11353ebd3c7edbbec10ee0/pa/JB30434_65e9f379afdc1e303daea010f1f37bfc.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-05-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Hyundai i30 1.4 MPI Passion',
 'transmission': 'manual',
 'trim': 'Passion',
 'year': 2018}
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB30434%27 HTTP/1.1" 200 None
2026-03-30 07:40:19 [auto1.de] INFO: Saving data for JB30434: {'created_time': 1774856419.311114, 'last_price_update_time': 1774856419.311126, 'auction_closing_time': 1774969647.0}
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB30434') HTTP/1.1" 204 0
2026-03-30 07:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RD37486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KP36820> (referer: https://www.auto1.com/v1/car-details-view/KP36820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KU11171> (referer: https://www.auto1.com/v1/car-details-view/KU11171/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e5e218a-354b-5afe-befd-81ed13d77779 with identifier: KP36820
2026-03-30 07:40:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e5e218a-354b-5afe-befd-81ed13d77779 with scrape type 1
2026-03-30 07:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7e5e218a-354b-5afe-befd-81ed13d77779
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F13%252F4313a70c7e553076388f8f7d2f0b30db%252Fpa%252FKP36820_aea46397e99886cdff1940a4a55a0641.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_aea46397e99886cdff1940a4a55a0641.jpg already downloaded
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F13%252F4313a70c7e553076388f8f7d2f0b30db%252Fpa%252FKP36820_964c42e89b2178a64006d9dd62bddc4e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_964c42e89b2178a64006d9dd62bddc4e.jpg already downloaded
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F13%252F4313a70c7e553076388f8f7d2f0b30db%252Fpa%252FKP36820_0f2903748bb0aa0cce543ab59abcce69.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_0f2903748bb0aa0cce543ab59abcce69.jpg already downloaded
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F13%252F4313a70c7e553076388f8f7d2f0b30db%252Fpa%252FKP36820_7a91485e3744c6c2ab549926b979515a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_7a91485e3744c6c2ab549926b979515a.jpg already downloaded
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F13%252F4313a70c7e553076388f8f7d2f0b30db%252Fpa%252FKP36820_f819465b68163d1ed175d750970b3ce2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_f819465b68163d1ed175d750970b3ce2.jpg already downloaded
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F13%252F4313a70c7e553076388f8f7d2f0b30db%252Fpa%252FKP36820_d8b6199cb160a1c917998ab8a7c30c9e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_d8b6199cb160a1c917998ab8a7c30c9e.jpg already downloaded
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F13%252F4313a70c7e553076388f8f7d2f0b30db%252Fpa%252FKP36820_554a14ef4feaefc105c7ede51856779f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_554a14ef4feaefc105c7ede51856779f.jpg already downloaded
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F13%252F4313a70c7e553076388f8f7d2f0b30db%252Fpa%252FKP36820_bd007a7234dbae979f19a07771cfb82e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_bd007a7234dbae979f19a07771cfb82e.jpg already downloaded
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F13%252F4313a70c7e553076388f8f7d2f0b30db%252Fpa%252FKP36820_554e09268fca92720df839509da79795.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_554e09268fca92720df839509da79795.jpg already downloaded
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg43%252F13%252F4313a70c7e553076388f8f7d2f0b30db%252Fpa%252FKP36820_6985321593fc66c3e4b592ec73334fb6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_6985321593fc66c3e4b592ec73334fb6.jpg already downloaded
2026-03-30 07:40:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e5e218a-354b-5afe-befd-81ed13d77779, identifier: KP36820
2026-03-30 07:40:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e5e218a-354b-5afe-befd-81ed13d77779 with identifier: KP36820
2026-03-30 07:40:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e5e218a-354b-5afe-befd-81ed13d77779 with identifier: KP36820
2026-03-30 07:40:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e5e218a-354b-5afe-befd-81ed13d77779 with identifier: KP36820 to the API
2026-03-30 07:40:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KP36820>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'category': None,
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 225,
 'expiration_date': '2026-03-31T15:17:23Z',
 'fuel_type': 'diesel',
 'id': '7e5e218a-354b-5afe-befd-81ed13d77779',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP36820',
 'listing': 'auction',
 'location': 'DE, Dortmund',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 192166,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 16,
 'photo_urls': ['https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_aea46397e99886cdff1940a4a55a0641.jpg',
                'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_964c42e89b2178a64006d9dd62bddc4e.jpg',
                'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_0f2903748bb0aa0cce543ab59abcce69.jpg',
                'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_7a91485e3744c6c2ab549926b979515a.jpg',
                'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_f819465b68163d1ed175d750970b3ce2.jpg',
                'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_d8b6199cb160a1c917998ab8a7c30c9e.jpg',
                'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_554a14ef4feaefc105c7ede51856779f.jpg',
                'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_bd007a7234dbae979f19a07771cfb82e.jpg',
                'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_554e09268fca92720df839509da79795.jpg',
                'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_6985321593fc66c3e4b592ec73334fb6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5e218a-354b-5afe-befd-81ed13d77779/7e5e218a-354b-5afe-befd-81ed13d77779_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_aea46397e99886cdff1940a4a55a0641.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5e218a-354b-5afe-befd-81ed13d77779/7e5e218a-354b-5afe-befd-81ed13d77779_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68132,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_964c42e89b2178a64006d9dd62bddc4e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5e218a-354b-5afe-befd-81ed13d77779/7e5e218a-354b-5afe-befd-81ed13d77779_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2562462,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_0f2903748bb0aa0cce543ab59abcce69.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5e218a-354b-5afe-befd-81ed13d77779/7e5e218a-354b-5afe-befd-81ed13d77779_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2323655,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_7a91485e3744c6c2ab549926b979515a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5e218a-354b-5afe-befd-81ed13d77779/7e5e218a-354b-5afe-befd-81ed13d77779_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2616722,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_f819465b68163d1ed175d750970b3ce2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5e218a-354b-5afe-befd-81ed13d77779/7e5e218a-354b-5afe-befd-81ed13d77779_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672692,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_d8b6199cb160a1c917998ab8a7c30c9e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5e218a-354b-5afe-befd-81ed13d77779/7e5e218a-354b-5afe-befd-81ed13d77779_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2556642,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_554a14ef4feaefc105c7ede51856779f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5e218a-354b-5afe-befd-81ed13d77779/7e5e218a-354b-5afe-befd-81ed13d77779_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2672119,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_bd007a7234dbae979f19a07771cfb82e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5e218a-354b-5afe-befd-81ed13d77779/7e5e218a-354b-5afe-befd-81ed13d77779_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2786682,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_554e09268fca92720df839509da79795.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7e5e218a-354b-5afe-befd-81ed13d77779/7e5e218a-354b-5afe-befd-81ed13d77779_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66480,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img43/13/4313a70c7e553076388f8f7d2f0b30db/pa/KP36820_6985321593fc66c3e4b592ec73334fb6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-05-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2016}
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP36820%27 HTTP/1.1" 200 None
2026-03-30 07:40:20 [auto1.de] INFO: Saving data for KP36820: {'created_time': 1774856420.7558, 'last_price_update_time': 1774856420.755815, 'auction_closing_time': 1774970243.0}
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP36820') HTTP/1.1" 204 0
2026-03-30 07:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BB43937/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d96f1f0c-bfe9-5626-ad48-6d213babe67d with identifier: KU11171
2026-03-30 07:40:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d96f1f0c-bfe9-5626-ad48-6d213babe67d with scrape type 1
2026-03-30 07:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d96f1f0c-bfe9-5626-ad48-6d213babe67d
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fda%252F4fda6ef58a25a8ce57e3c77944bd5c71%252Fpa%252FKU11171_f25ae7c0bb71355d22f34d45969cbb44.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_f25ae7c0bb71355d22f34d45969cbb44.jpg already downloaded
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fda%252F4fda6ef58a25a8ce57e3c77944bd5c71%252Fpa%252FKU11171_2cce4330e2f4317a8428f26e7533f774.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_2cce4330e2f4317a8428f26e7533f774.jpg already downloaded
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fda%252F4fda6ef58a25a8ce57e3c77944bd5c71%252Fpa%252FKU11171_7faabf3886cb2f495e8f3fca4556b179.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_7faabf3886cb2f495e8f3fca4556b179.jpg already downloaded
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fda%252F4fda6ef58a25a8ce57e3c77944bd5c71%252Fpa%252FKU11171_e3eac64bfbdd36bd91a0ad1d9d1db58e.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_e3eac64bfbdd36bd91a0ad1d9d1db58e.jpg already downloaded
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fda%252F4fda6ef58a25a8ce57e3c77944bd5c71%252Fpa%252FKU11171_1f405f893c9c625d3720c35b412491f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_1f405f893c9c625d3720c35b412491f1.jpg already downloaded
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fda%252F4fda6ef58a25a8ce57e3c77944bd5c71%252Fpa%252FKU11171_9f1378b2135066eeb40145b0d0a27a94.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_9f1378b2135066eeb40145b0d0a27a94.jpg already downloaded
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fda%252F4fda6ef58a25a8ce57e3c77944bd5c71%252Fpa%252FKU11171_927afd79f45ace71a97df77537a73846.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_927afd79f45ace71a97df77537a73846.jpg already downloaded
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fda%252F4fda6ef58a25a8ce57e3c77944bd5c71%252Fpa%252FKU11171_a60bcc6f52a641b6e2a0a006f56514e1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_a60bcc6f52a641b6e2a0a006f56514e1.jpg already downloaded
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fda%252F4fda6ef58a25a8ce57e3c77944bd5c71%252Fpa%252FKU11171_510ff3bf732daf531aa995ecb3961ebc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_510ff3bf732daf531aa995ecb3961ebc.jpg already downloaded
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4f%252Fda%252F4fda6ef58a25a8ce57e3c77944bd5c71%252Fpa%252FKU11171_98417eb33b9acda2118b8b28fb010511.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_98417eb33b9acda2118b8b28fb010511.jpg already downloaded
2026-03-30 07:40:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d96f1f0c-bfe9-5626-ad48-6d213babe67d, identifier: KU11171
2026-03-30 07:40:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d96f1f0c-bfe9-5626-ad48-6d213babe67d with identifier: KU11171
2026-03-30 07:40:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d96f1f0c-bfe9-5626-ad48-6d213babe67d with identifier: KU11171
2026-03-30 07:40:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d96f1f0c-bfe9-5626-ad48-6d213babe67d with identifier: KU11171 to the API
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KU11171>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:24:33Z',
 'fuel_type': 'diesel',
 'id': 'd96f1f0c-bfe9-5626-ad48-6d213babe67d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU11171',
 'listing': 'auction',
 'location': 'Hamburg-Billstedt',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 225681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_f25ae7c0bb71355d22f34d45969cbb44.jpg',
                'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_2cce4330e2f4317a8428f26e7533f774.jpg',
                'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_7faabf3886cb2f495e8f3fca4556b179.jpg',
                'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_e3eac64bfbdd36bd91a0ad1d9d1db58e.jpg',
                'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_1f405f893c9c625d3720c35b412491f1.jpg',
                'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_9f1378b2135066eeb40145b0d0a27a94.jpg',
                'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_927afd79f45ace71a97df77537a73846.jpg',
                'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_a60bcc6f52a641b6e2a0a006f56514e1.jpg',
                'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_510ff3bf732daf531aa995ecb3961ebc.jpg',
                'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_98417eb33b9acda2118b8b28fb010511.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96f1f0c-bfe9-5626-ad48-6d213babe67d/d96f1f0c-bfe9-5626-ad48-6d213babe67d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85148,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_f25ae7c0bb71355d22f34d45969cbb44.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96f1f0c-bfe9-5626-ad48-6d213babe67d/d96f1f0c-bfe9-5626-ad48-6d213babe67d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_2cce4330e2f4317a8428f26e7533f774.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96f1f0c-bfe9-5626-ad48-6d213babe67d/d96f1f0c-bfe9-5626-ad48-6d213babe67d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67212,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_7faabf3886cb2f495e8f3fca4556b179.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96f1f0c-bfe9-5626-ad48-6d213babe67d/d96f1f0c-bfe9-5626-ad48-6d213babe67d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_e3eac64bfbdd36bd91a0ad1d9d1db58e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96f1f0c-bfe9-5626-ad48-6d213babe67d/d96f1f0c-bfe9-5626-ad48-6d213babe67d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59864,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_1f405f893c9c625d3720c35b412491f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96f1f0c-bfe9-5626-ad48-6d213babe67d/d96f1f0c-bfe9-5626-ad48-6d213babe67d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63827,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_9f1378b2135066eeb40145b0d0a27a94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96f1f0c-bfe9-5626-ad48-6d213babe67d/d96f1f0c-bfe9-5626-ad48-6d213babe67d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_927afd79f45ace71a97df77537a73846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96f1f0c-bfe9-5626-ad48-6d213babe67d/d96f1f0c-bfe9-5626-ad48-6d213babe67d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76380,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_a60bcc6f52a641b6e2a0a006f56514e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96f1f0c-bfe9-5626-ad48-6d213babe67d/d96f1f0c-bfe9-5626-ad48-6d213babe67d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_510ff3bf732daf531aa995ecb3961ebc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d96f1f0c-bfe9-5626-ad48-6d213babe67d/d96f1f0c-bfe9-5626-ad48-6d213babe67d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75579,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4f/da/4fda6ef58a25a8ce57e3c77944bd5c71/pa/KU11171_98417eb33b9acda2118b8b28fb010511.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-02-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Summum 2WD',
 'transmission': 'manual',
 'trim': 'Summum 2WD',
 'year': 2016}
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU11171%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Saving data for KU11171: {'created_time': 1774856421.43597, 'last_price_update_time': 1774856421.435981, 'auction_closing_time': 1774970673.0}
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU11171') HTTP/1.1" 204 0
2026-03-30 07:40:21 [auto1.de] INFO: Channel: 24h | Page: 32 | totalHits: 7947 | hits on page: 40
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: HN36676
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: BX89684
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: AB70277
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB70277%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for AB70277: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: GN07930
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN07930%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for GN07930: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: PJ34146
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ34146%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for PJ34146: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: HM22337
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: SU78317
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU78317%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for SU78317: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: MP03054
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: PY59919
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY59919%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for PY59919: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: PF20752
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: JM25076
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: BE10482
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE10482%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for BE10482: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: DY40129
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY40129%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for DY40129: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: HD80802
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: CR70620
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: BV77129
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV77129%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for BV77129: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: FY87536
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: PX43483
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: YH32466
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH32466%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for YH32466: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: ZW96632
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW96632%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for ZW96632: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: ZY10708
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY10708%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for ZY10708: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: KS38701
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: NW88180
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW88180%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for NW88180: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: HC26014
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC26014%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for HC26014: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: LN64409
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: BB56040
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB56040%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for BB56040: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: KY70270
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY70270%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for KY70270: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: JS58048
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS58048%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for JS58048: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: RC36772
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC36772%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for RC36772: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: UG24074
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: RE36292
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: ZA01516
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: NX65869
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39369%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for KF39369: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX65130%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for CX65130: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: EM69588
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: FY70837
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY70837%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for FY70837: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL11317%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for YL11317: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: ZH40630
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH40630%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [auto1.de] INFO: Scrape type for ZH40630: 0
2026-03-30 07:40:21 [auto1.de] INFO: Found listing with ID: RA38840
2026-03-30 07:40:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EK40849> (referer: https://www.auto1.com/v1/car-details-view/EK40849/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d15c36ad-ef7a-5d44-8b30-bea6d8d6547f with identifier: EK40849
2026-03-30 07:40:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d15c36ad-ef7a-5d44-8b30-bea6d8d6547f with scrape type 1
2026-03-30 07:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d15c36ad-ef7a-5d44-8b30-bea6d8d6547f
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F25%252Fde2539a2c02126b8c9dfd06fc5866331%252Fpa%252FEK40849_c5c5ef6bbbc258b0b169a65be2691d3b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_c5c5ef6bbbc258b0b169a65be2691d3b.jpg already downloaded
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F25%252Fde2539a2c02126b8c9dfd06fc5866331%252Fpa%252FEK40849_d52747f87ae82d85df838db89f439029.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_d52747f87ae82d85df838db89f439029.jpg already downloaded
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F25%252Fde2539a2c02126b8c9dfd06fc5866331%252Fpa%252FEK40849_3d14392b320a6e7722600d4611d70419.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_3d14392b320a6e7722600d4611d70419.jpg already downloaded
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F25%252Fde2539a2c02126b8c9dfd06fc5866331%252Fpa%252FEK40849_ebde0f24566817f55aa54f8d8b871d49.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_ebde0f24566817f55aa54f8d8b871d49.jpg already downloaded
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252F25%252Fde2539a2c02126b8c9dfd06fc5866331%252Fpa%252FEK40849_f3ee56384ab499f0b7c99b69654aa499.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_f3ee56384ab499f0b7c99b69654aa499.jpg already downloaded
2026-03-30 07:40:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d15c36ad-ef7a-5d44-8b30-bea6d8d6547f, identifier: EK40849
2026-03-30 07:40:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d15c36ad-ef7a-5d44-8b30-bea6d8d6547f with identifier: EK40849
2026-03-30 07:40:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d15c36ad-ef7a-5d44-8b30-bea6d8d6547f with identifier: EK40849
2026-03-30 07:40:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d15c36ad-ef7a-5d44-8b30-bea6d8d6547f with identifier: EK40849 to the API
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EK40849>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:36:38Z',
 'fuel_type': 'diesel',
 'id': 'd15c36ad-ef7a-5d44-8b30-bea6d8d6547f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK40849',
 'listing': 'auction',
 'location': 'DE, Schkopau (OT Rassnitz)',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 267289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_c5c5ef6bbbc258b0b169a65be2691d3b.jpg',
                'https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_d52747f87ae82d85df838db89f439029.jpg',
                'https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_3d14392b320a6e7722600d4611d70419.jpg',
                'https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_ebde0f24566817f55aa54f8d8b871d49.jpg',
                'https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_f3ee56384ab499f0b7c99b69654aa499.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15c36ad-ef7a-5d44-8b30-bea6d8d6547f/d15c36ad-ef7a-5d44-8b30-bea6d8d6547f_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94516,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_c5c5ef6bbbc258b0b169a65be2691d3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15c36ad-ef7a-5d44-8b30-bea6d8d6547f/d15c36ad-ef7a-5d44-8b30-bea6d8d6547f_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87015,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_d52747f87ae82d85df838db89f439029.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15c36ad-ef7a-5d44-8b30-bea6d8d6547f/d15c36ad-ef7a-5d44-8b30-bea6d8d6547f_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80630,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_3d14392b320a6e7722600d4611d70419.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15c36ad-ef7a-5d44-8b30-bea6d8d6547f/d15c36ad-ef7a-5d44-8b30-bea6d8d6547f_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74921,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_ebde0f24566817f55aa54f8d8b871d49.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d15c36ad-ef7a-5d44-8b30-bea6d8d6547f/d15c36ad-ef7a-5d44-8b30-bea6d8d6547f_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116237,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/25/de2539a2c02126b8c9dfd06fc5866331/pa/EK40849_f3ee56384ab499f0b7c99b69654aa499.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK40849%27 HTTP/1.1" 200 None
2026-03-30 07:40:22 [auto1.de] INFO: Saving data for EK40849: {'created_time': 1774856422.537548, 'last_price_update_time': 1774856422.53756, 'auction_closing_time': 1774971398.0}
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK40849') HTTP/1.1" 204 0
2026-03-30 07:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PL78548> (referer: https://www.auto1.com/v1/car-details-view/PL78548/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR51775> (referer: https://www.auto1.com/v1/car-details-view/FR51775/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FD53596> (referer: https://www.auto1.com/v1/car-details-view/FD53596/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RD37486> (referer: https://www.auto1.com/v1/car-details-view/RD37486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63f71cd4-8e69-5f45-838d-ca1b64c54483 with identifier: PL78548
2026-03-30 07:40:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63f71cd4-8e69-5f45-838d-ca1b64c54483 with scrape type 1
2026-03-30 07:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 63f71cd4-8e69-5f45-838d-ca1b64c54483
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F96%252F7e96e6956f7f292a147b1b464940f02d%252Fpa%252FPL78548_9b0a4c43bec34cd0266ec3deeac291e6.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_9b0a4c43bec34cd0266ec3deeac291e6.jpg already downloaded
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F96%252F7e96e6956f7f292a147b1b464940f02d%252Fpa%252FPL78548_7e37040af3097869e5b6519bc0cafe87.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_7e37040af3097869e5b6519bc0cafe87.jpg already downloaded
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F96%252F7e96e6956f7f292a147b1b464940f02d%252Fpa%252FPL78548_7df498f0d688b14ed242de7d3e33a323.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_7df498f0d688b14ed242de7d3e33a323.jpg already downloaded
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F96%252F7e96e6956f7f292a147b1b464940f02d%252Fpa%252FPL78548_65f9ebba96dad4c0a648bccc30d5ff26.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_65f9ebba96dad4c0a648bccc30d5ff26.jpg already downloaded
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F96%252F7e96e6956f7f292a147b1b464940f02d%252Fpa%252FPL78548_efb14fa3026b3b3379eeea294ae70c65.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_efb14fa3026b3b3379eeea294ae70c65.jpg already downloaded
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F96%252F7e96e6956f7f292a147b1b464940f02d%252Fpa%252FPL78548_3934426aaf6f335f397af422dc4deffe.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_3934426aaf6f335f397af422dc4deffe.jpg already downloaded
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F96%252F7e96e6956f7f292a147b1b464940f02d%252Fpa%252FPL78548_272ff9de27fa8257b69c672116804d7f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_272ff9de27fa8257b69c672116804d7f.jpg already downloaded
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F96%252F7e96e6956f7f292a147b1b464940f02d%252Fpa%252FPL78548_18e41d2e36ab37adc11d1b29aa1e3ea4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_18e41d2e36ab37adc11d1b29aa1e3ea4.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F96%252F7e96e6956f7f292a147b1b464940f02d%252Fpa%252FPL78548_17d1899bba8ed0609c93860d97a63d06.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_17d1899bba8ed0609c93860d97a63d06.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7e%252F96%252F7e96e6956f7f292a147b1b464940f02d%252Fpa%252FPL78548_73c037e30331a2b34c9beffe783d19b4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_73c037e30331a2b34c9beffe783d19b4.jpg already downloaded
2026-03-30 07:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63f71cd4-8e69-5f45-838d-ca1b64c54483, identifier: PL78548
2026-03-30 07:40:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63f71cd4-8e69-5f45-838d-ca1b64c54483 with identifier: PL78548
2026-03-30 07:40:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63f71cd4-8e69-5f45-838d-ca1b64c54483 with identifier: PL78548
2026-03-30 07:40:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63f71cd4-8e69-5f45-838d-ca1b64c54483 with identifier: PL78548 to the API
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PL78548>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 240,
 'expiration_date': '2026-03-31T15:50:01Z',
 'fuel_type': 'diesel',
 'id': '63f71cd4-8e69-5f45-838d-ca1b64c54483',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL78548',
 'listing': 'auction',
 'location': 'DE, Buch',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 165191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_9b0a4c43bec34cd0266ec3deeac291e6.jpg',
                'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_7e37040af3097869e5b6519bc0cafe87.jpg',
                'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_7df498f0d688b14ed242de7d3e33a323.jpg',
                'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_65f9ebba96dad4c0a648bccc30d5ff26.jpg',
                'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_efb14fa3026b3b3379eeea294ae70c65.jpg',
                'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_3934426aaf6f335f397af422dc4deffe.jpg',
                'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_272ff9de27fa8257b69c672116804d7f.jpg',
                'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_18e41d2e36ab37adc11d1b29aa1e3ea4.jpg',
                'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_17d1899bba8ed0609c93860d97a63d06.jpg',
                'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_73c037e30331a2b34c9beffe783d19b4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f71cd4-8e69-5f45-838d-ca1b64c54483/63f71cd4-8e69-5f45-838d-ca1b64c54483_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73724,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_9b0a4c43bec34cd0266ec3deeac291e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f71cd4-8e69-5f45-838d-ca1b64c54483/63f71cd4-8e69-5f45-838d-ca1b64c54483_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69951,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_7e37040af3097869e5b6519bc0cafe87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f71cd4-8e69-5f45-838d-ca1b64c54483/63f71cd4-8e69-5f45-838d-ca1b64c54483_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67733,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_7df498f0d688b14ed242de7d3e33a323.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f71cd4-8e69-5f45-838d-ca1b64c54483/63f71cd4-8e69-5f45-838d-ca1b64c54483_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59385,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_65f9ebba96dad4c0a648bccc30d5ff26.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f71cd4-8e69-5f45-838d-ca1b64c54483/63f71cd4-8e69-5f45-838d-ca1b64c54483_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64397,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_efb14fa3026b3b3379eeea294ae70c65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f71cd4-8e69-5f45-838d-ca1b64c54483/63f71cd4-8e69-5f45-838d-ca1b64c54483_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_3934426aaf6f335f397af422dc4deffe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f71cd4-8e69-5f45-838d-ca1b64c54483/63f71cd4-8e69-5f45-838d-ca1b64c54483_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72615,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_272ff9de27fa8257b69c672116804d7f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f71cd4-8e69-5f45-838d-ca1b64c54483/63f71cd4-8e69-5f45-838d-ca1b64c54483_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73883,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_18e41d2e36ab37adc11d1b29aa1e3ea4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f71cd4-8e69-5f45-838d-ca1b64c54483/63f71cd4-8e69-5f45-838d-ca1b64c54483_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_17d1899bba8ed0609c93860d97a63d06.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63f71cd4-8e69-5f45-838d-ca1b64c54483/63f71cd4-8e69-5f45-838d-ca1b64c54483_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7e/96/7e96e6956f7f292a147b1b464940f02d/pa/PL78548_73c037e30331a2b34c9beffe783d19b4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-08-03',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Audi A5 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL78548%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [auto1.de] INFO: Saving data for PL78548: {'created_time': 1774856423.462469, 'last_price_update_time': 1774856423.462482, 'auction_closing_time': 1774972201.0}
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL78548') HTTP/1.1" 204 0
2026-03-30 07:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 798db20b-6417-5796-9011-f338ae3a8785 with identifier: FR51775
2026-03-30 07:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798db20b-6417-5796-9011-f338ae3a8785 with scrape type 1
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 798db20b-6417-5796-9011-f338ae3a8785
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_6f264530d6400b3225caf2be3a296c5f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_6f264530d6400b3225caf2be3a296c5f.jpg not downloaded yet
2026-03-30 07:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e562767b-ab1b-571b-b414-b40dda23e14a with identifier: FD53596
2026-03-30 07:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e562767b-ab1b-571b-b414-b40dda23e14a with scrape type 1
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e562767b-ab1b-571b-b414-b40dda23e14a
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb6%252Fdfb6db374a74f6d83ea9fb7890ca98d1%252Fpa%252FFD53596_06599defad685ac3b2e4b892f9b5d07c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_06599defad685ac3b2e4b892f9b5d07c.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb6%252Fdfb6db374a74f6d83ea9fb7890ca98d1%252Fpa%252FFD53596_fc6d9f2e654f2596ff5e51d9f2e08e61.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_fc6d9f2e654f2596ff5e51d9f2e08e61.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb6%252Fdfb6db374a74f6d83ea9fb7890ca98d1%252Fpa%252FFD53596_6dc518a004517390b34ffdc12cd7e172.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_6dc518a004517390b34ffdc12cd7e172.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb6%252Fdfb6db374a74f6d83ea9fb7890ca98d1%252Fpa%252FFD53596_2847cec09c1cb2960a256ad541918825.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_2847cec09c1cb2960a256ad541918825.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb6%252Fdfb6db374a74f6d83ea9fb7890ca98d1%252Fpa%252FFD53596_53cd2e4e393e95d2ad0f98c00b02a99f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_53cd2e4e393e95d2ad0f98c00b02a99f.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb6%252Fdfb6db374a74f6d83ea9fb7890ca98d1%252Fpa%252FFD53596_fa8e9a428b65036061de2e06f11f45f9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_fa8e9a428b65036061de2e06f11f45f9.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb6%252Fdfb6db374a74f6d83ea9fb7890ca98d1%252Fpa%252FFD53596_96430e2f0410803c1fd4174e1ce56f30.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_96430e2f0410803c1fd4174e1ce56f30.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb6%252Fdfb6db374a74f6d83ea9fb7890ca98d1%252Fpa%252FFD53596_d020f52303b9031a48c06f44499cea88.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_d020f52303b9031a48c06f44499cea88.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb6%252Fdfb6db374a74f6d83ea9fb7890ca98d1%252Fpa%252FFD53596_091908b8cfa73700b9571cecd3b25c2c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_091908b8cfa73700b9571cecd3b25c2c.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252Fb6%252Fdfb6db374a74f6d83ea9fb7890ca98d1%252Fpa%252FFD53596_93320121ce4ee2488035d5bfb55e4d70.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_93320121ce4ee2488035d5bfb55e4d70.jpg already downloaded
2026-03-30 07:40:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e562767b-ab1b-571b-b414-b40dda23e14a, identifier: FD53596
2026-03-30 07:40:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 598f299d-de6a-5db2-86eb-a98de34b9f20 with identifier: RD37486
2026-03-30 07:40:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 598f299d-de6a-5db2-86eb-a98de34b9f20 with scrape type 1
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 598f299d-de6a-5db2-86eb-a98de34b9f20
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe7%252F0ae71e37908402338d485e25f643491a%252Fpa%252FRD37486_64a290d52c9d53a348994d772540cd76.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_64a290d52c9d53a348994d772540cd76.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe7%252F0ae71e37908402338d485e25f643491a%252Fpa%252FRD37486_3be942207162efd52efe594843ac9cef.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_3be942207162efd52efe594843ac9cef.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe7%252F0ae71e37908402338d485e25f643491a%252Fpa%252FRD37486_31116302124d26339be0a7227432aa17.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_31116302124d26339be0a7227432aa17.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe7%252F0ae71e37908402338d485e25f643491a%252Fpa%252FRD37486_3ec65b71b38e88d39c2888836f485189.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_3ec65b71b38e88d39c2888836f485189.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe7%252F0ae71e37908402338d485e25f643491a%252Fpa%252FRD37486_5adcfbc8859701023396925275ade641.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_5adcfbc8859701023396925275ade641.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe7%252F0ae71e37908402338d485e25f643491a%252Fpa%252FRD37486_7c84b983f4f89b467a8d77f469542691.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_7c84b983f4f89b467a8d77f469542691.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe7%252F0ae71e37908402338d485e25f643491a%252Fpa%252FRD37486_259b22328bbc28828c29df383ae45ff1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_259b22328bbc28828c29df383ae45ff1.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe7%252F0ae71e37908402338d485e25f643491a%252Fpa%252FRD37486_43780610271774cdd2ea77e665d20335.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_43780610271774cdd2ea77e665d20335.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe7%252F0ae71e37908402338d485e25f643491a%252Fpa%252FRD37486_23c5400353fa7dcf5dd9c482556659c1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_23c5400353fa7dcf5dd9c482556659c1.jpg already downloaded
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252Fe7%252F0ae71e37908402338d485e25f643491a%252Fpa%252FRD37486_18af28b4132a3a4a94a3116d063eb98d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_18af28b4132a3a4a94a3116d063eb98d.jpg already downloaded
2026-03-30 07:40:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 598f299d-de6a-5db2-86eb-a98de34b9f20, identifier: RD37486
2026-03-30 07:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e562767b-ab1b-571b-b414-b40dda23e14a with identifier: FD53596
2026-03-30 07:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e562767b-ab1b-571b-b414-b40dda23e14a with identifier: FD53596
2026-03-30 07:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e562767b-ab1b-571b-b414-b40dda23e14a with identifier: FD53596 to the API
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FD53596>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 177,
 'expiration_date': '2026-03-31T15:03:49Z',
 'fuel_type': 'diesel',
 'id': 'e562767b-ab1b-571b-b414-b40dda23e14a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD53596',
 'listing': 'auction',
 'location': 'DE, Erbach',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 181324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_06599defad685ac3b2e4b892f9b5d07c.jpg',
                'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_fc6d9f2e654f2596ff5e51d9f2e08e61.jpg',
                'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_6dc518a004517390b34ffdc12cd7e172.jpg',
                'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_2847cec09c1cb2960a256ad541918825.jpg',
                'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_53cd2e4e393e95d2ad0f98c00b02a99f.jpg',
                'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_fa8e9a428b65036061de2e06f11f45f9.jpg',
                'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_96430e2f0410803c1fd4174e1ce56f30.jpg',
                'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_d020f52303b9031a48c06f44499cea88.jpg',
                'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_091908b8cfa73700b9571cecd3b25c2c.jpg',
                'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_93320121ce4ee2488035d5bfb55e4d70.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562767b-ab1b-571b-b414-b40dda23e14a/e562767b-ab1b-571b-b414-b40dda23e14a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79896,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_06599defad685ac3b2e4b892f9b5d07c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562767b-ab1b-571b-b414-b40dda23e14a/e562767b-ab1b-571b-b414-b40dda23e14a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84188,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_fc6d9f2e654f2596ff5e51d9f2e08e61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562767b-ab1b-571b-b414-b40dda23e14a/e562767b-ab1b-571b-b414-b40dda23e14a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69781,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_6dc518a004517390b34ffdc12cd7e172.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562767b-ab1b-571b-b414-b40dda23e14a/e562767b-ab1b-571b-b414-b40dda23e14a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_2847cec09c1cb2960a256ad541918825.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562767b-ab1b-571b-b414-b40dda23e14a/e562767b-ab1b-571b-b414-b40dda23e14a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62535,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_53cd2e4e393e95d2ad0f98c00b02a99f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562767b-ab1b-571b-b414-b40dda23e14a/e562767b-ab1b-571b-b414-b40dda23e14a_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_fa8e9a428b65036061de2e06f11f45f9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562767b-ab1b-571b-b414-b40dda23e14a/e562767b-ab1b-571b-b414-b40dda23e14a_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60929,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_96430e2f0410803c1fd4174e1ce56f30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562767b-ab1b-571b-b414-b40dda23e14a/e562767b-ab1b-571b-b414-b40dda23e14a_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_d020f52303b9031a48c06f44499cea88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562767b-ab1b-571b-b414-b40dda23e14a/e562767b-ab1b-571b-b414-b40dda23e14a_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_091908b8cfa73700b9571cecd3b25c2c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e562767b-ab1b-571b-b414-b40dda23e14a/e562767b-ab1b-571b-b414-b40dda23e14a_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80800,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/b6/dfb6db374a74f6d83ea9fb7890ca98d1/pa/FD53596_93320121ce4ee2488035d5bfb55e4d70.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-01-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A4 Allroad 2.0 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD53596%27 HTTP/1.1" 200 None
2026-03-30 07:40:24 [auto1.de] INFO: Saving data for FD53596: {'created_time': 1774856424.438799, 'last_price_update_time': 1774856424.438811, 'auction_closing_time': 1774969429.0}
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD53596') HTTP/1.1" 204 0
2026-03-30 07:40:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 598f299d-de6a-5db2-86eb-a98de34b9f20 with identifier: RD37486
2026-03-30 07:40:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 598f299d-de6a-5db2-86eb-a98de34b9f20 with identifier: RD37486
2026-03-30 07:40:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 598f299d-de6a-5db2-86eb-a98de34b9f20 with identifier: RD37486 to the API
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/RD37486>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.2L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-31T15:56:02Z',
 'fuel_type': 'petrol',
 'id': '598f299d-de6a-5db2-86eb-a98de34b9f20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD37486',
 'listing': 'auction',
 'location': 'DE, Ketzin',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 160896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_64a290d52c9d53a348994d772540cd76.jpg',
                'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_3be942207162efd52efe594843ac9cef.jpg',
                'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_31116302124d26339be0a7227432aa17.jpg',
                'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_3ec65b71b38e88d39c2888836f485189.jpg',
                'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_5adcfbc8859701023396925275ade641.jpg',
                'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_7c84b983f4f89b467a8d77f469542691.jpg',
                'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_259b22328bbc28828c29df383ae45ff1.jpg',
                'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_43780610271774cdd2ea77e665d20335.jpg',
                'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_23c5400353fa7dcf5dd9c482556659c1.jpg',
                'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_18af28b4132a3a4a94a3116d063eb98d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f299d-de6a-5db2-86eb-a98de34b9f20/598f299d-de6a-5db2-86eb-a98de34b9f20_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_64a290d52c9d53a348994d772540cd76.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f299d-de6a-5db2-86eb-a98de34b9f20/598f299d-de6a-5db2-86eb-a98de34b9f20_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107906,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_3be942207162efd52efe594843ac9cef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f299d-de6a-5db2-86eb-a98de34b9f20/598f299d-de6a-5db2-86eb-a98de34b9f20_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_31116302124d26339be0a7227432aa17.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f299d-de6a-5db2-86eb-a98de34b9f20/598f299d-de6a-5db2-86eb-a98de34b9f20_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79818,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_3ec65b71b38e88d39c2888836f485189.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f299d-de6a-5db2-86eb-a98de34b9f20/598f299d-de6a-5db2-86eb-a98de34b9f20_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106917,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_5adcfbc8859701023396925275ade641.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f299d-de6a-5db2-86eb-a98de34b9f20/598f299d-de6a-5db2-86eb-a98de34b9f20_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106889,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_7c84b983f4f89b467a8d77f469542691.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f299d-de6a-5db2-86eb-a98de34b9f20/598f299d-de6a-5db2-86eb-a98de34b9f20_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_259b22328bbc28828c29df383ae45ff1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f299d-de6a-5db2-86eb-a98de34b9f20/598f299d-de6a-5db2-86eb-a98de34b9f20_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103791,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_43780610271774cdd2ea77e665d20335.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f299d-de6a-5db2-86eb-a98de34b9f20/598f299d-de6a-5db2-86eb-a98de34b9f20_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112293,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_23c5400353fa7dcf5dd9c482556659c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_598f299d-de6a-5db2-86eb-a98de34b9f20/598f299d-de6a-5db2-86eb-a98de34b9f20_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103559,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/e7/0ae71e37908402338d485e25f643491a/pa/RD37486_18af28b4132a3a4a94a3116d063eb98d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-03',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Jetta 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2013}
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD37486%27 HTTP/1.1" 200 None
2026-03-30 07:40:24 [auto1.de] INFO: Saving data for RD37486: {'created_time': 1774856424.814265, 'last_price_update_time': 1774856424.814277, 'auction_closing_time': 1774972562.0}
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD37486') HTTP/1.1" 204 0
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_f2c54bf07c420012fb09c2ca6e56d02b.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_f2c54bf07c420012fb09c2ca6e56d02b.jpg not downloaded yet
2026-03-30 07:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BB43937> (referer: https://www.auto1.com/v1/car-details-view/BB43937/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_464691c8515cd2eecf1f8e7d9a9fa7ee.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_464691c8515cd2eecf1f8e7d9a9fa7ee.jpg not downloaded yet
2026-03-30 07:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW52746> (referer: https://www.auto1.com/v1/car-details-view/HW52746/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_0c7281fe16d11ac26dd25c9a392d22fb.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_0c7281fe16d11ac26dd25c9a392d22fb.jpg not downloaded yet
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_322c7d3c74bf78383d873072d929ea9d.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_322c7d3c74bf78383d873072d929ea9d.jpg not downloaded yet
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_f38fd5122170958334af071660395fcc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_f38fd5122170958334af071660395fcc.jpg not downloaded yet
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_0f8859f87ea3fbf813d9f944ed417aa9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_0f8859f87ea3fbf813d9f944ed417aa9.jpg not downloaded yet
2026-03-30 07:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_f2c54bf07c420012fb09c2ca6e56d02b.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_1be59dac8c6ecd8c13f240fc3a9bba3c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_1be59dac8c6ecd8c13f240fc3a9bba3c.jpg not downloaded yet
2026-03-30 07:40:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_464691c8515cd2eecf1f8e7d9a9fa7ee.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_5d6385a398bfa234e3aa18557c0ab5f1.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_5d6385a398bfa234e3aa18557c0ab5f1.jpg not downloaded yet
2026-03-30 07:40:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39fc2864-eb9b-5f17-83fd-ff9b70e025f4 with identifier: BB43937
2026-03-30 07:40:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4 with scrape type 1
2026-03-30 07:40:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_256158ddf1ad08fcd56d5159bd7e1fdc.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_256158ddf1ad08fcd56d5159bd7e1fdc.jpg not downloaded yet
2026-03-30 07:40:25 [auto1.de] INFO: Channel: 24h | Page: 33 | totalHits: 7954 | hits on page: 40
2026-03-30 07:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_0c7281fe16d11ac26dd25c9a392d22fb.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_322c7d3c74bf78383d873072d929ea9d.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_805a86341821541daa879b06ece57811.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_805a86341821541daa879b06ece57811.jpg not downloaded yet
2026-03-30 07:40:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_0f8859f87ea3fbf813d9f944ed417aa9.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_a09b482fe0fa7cd1c7882c8373cfaf7a.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_a09b482fe0fa7cd1c7882c8373cfaf7a.jpg not downloaded yet
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: KF39369
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF39369%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for KF39369: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: CX65130
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX65130%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for CX65130: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: EM69588
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: FY70837
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY70837%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for FY70837: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: YL11317
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL11317%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for YL11317: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: ZH40630
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH40630%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for ZH40630: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: RA38840
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: RR52693
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR52693%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for RR52693: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: NK75444
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK75444%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for NK75444: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: ES51146
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: RC32924
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: XN76849
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: AA06623
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA06623%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for AA06623: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: XF10018
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: VY63295
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63295%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for VY63295: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: KV42803
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV42803%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for KV42803: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: TJ48176
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: WW07339
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: MM90300
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90300%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for MM90300: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: NH05952
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH05952%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for NH05952: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: HT08782
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: LE65557
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE65557%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for LE65557: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: LJ58074
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58074%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for LJ58074: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: UH53806
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: YY18465
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY18465%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for YY18465: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: VC28435
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: HJ76482
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ76482%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for HJ76482: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: GT35568
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: KP69989
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP69989%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for KP69989: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: TJ90592
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: CV58900
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: ZS29776
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS29776%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for ZS29776: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: PJ98033
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ98033%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for PJ98033: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: RG53469
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: AT97457
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: DS41181
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: WY61426
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: BV92050
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: ZA83090
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA83090%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Scrape type for ZA83090: 0
2026-03-30 07:40:25 [auto1.de] INFO: Found listing with ID: UL88623
2026-03-30 07:40:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3df5ef47-b376-51c7-92fb-6053a249e6fb with identifier: HW52746
2026-03-30 07:40:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3df5ef47-b376-51c7-92fb-6053a249e6fb with scrape type 1
2026-03-30 07:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3df5ef47-b376-51c7-92fb-6053a249e6fb
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F7e%252Fc97ebb0036afe19166ff52a8d450d089%252Fpa%252FHW52746_f92ad006a70ea926588701c6108303d5.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_f92ad006a70ea926588701c6108303d5.jpg already downloaded
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F7e%252Fc97ebb0036afe19166ff52a8d450d089%252Fpa%252FHW52746_ee8db833eea0b8d36feae0c7cfda7ca2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_ee8db833eea0b8d36feae0c7cfda7ca2.jpg already downloaded
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F7e%252Fc97ebb0036afe19166ff52a8d450d089%252Fpa%252FHW52746_26c34c4f8cdc4b217c34b374c0a617ab.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_26c34c4f8cdc4b217c34b374c0a617ab.jpg already downloaded
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F7e%252Fc97ebb0036afe19166ff52a8d450d089%252Fpa%252FHW52746_0c8c246671bcd2dcd4519a7474d9d8c9.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_0c8c246671bcd2dcd4519a7474d9d8c9.jpg already downloaded
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc9%252F7e%252Fc97ebb0036afe19166ff52a8d450d089%252Fpa%252FHW52746_471d0b4dfbac80efa6b22a5f15adbb4f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_471d0b4dfbac80efa6b22a5f15adbb4f.jpg already downloaded
2026-03-30 07:40:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3df5ef47-b376-51c7-92fb-6053a249e6fb, identifier: HW52746
2026-03-30 07:40:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3df5ef47-b376-51c7-92fb-6053a249e6fb with identifier: HW52746
2026-03-30 07:40:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3df5ef47-b376-51c7-92fb-6053a249e6fb with identifier: HW52746
2026-03-30 07:40:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3df5ef47-b376-51c7-92fb-6053a249e6fb with identifier: HW52746 to the API
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/HW52746>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-31T15:29:34Z',
 'fuel_type': 'petrol',
 'id': '3df5ef47-b376-51c7-92fb-6053a249e6fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW52746',
 'listing': 'auction',
 'location': 'DE, Karlskron',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 219180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_f92ad006a70ea926588701c6108303d5.jpg',
                'https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_ee8db833eea0b8d36feae0c7cfda7ca2.jpg',
                'https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_26c34c4f8cdc4b217c34b374c0a617ab.jpg',
                'https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_0c8c246671bcd2dcd4519a7474d9d8c9.jpg',
                'https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_471d0b4dfbac80efa6b22a5f15adbb4f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df5ef47-b376-51c7-92fb-6053a249e6fb/3df5ef47-b376-51c7-92fb-6053a249e6fb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76406,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_f92ad006a70ea926588701c6108303d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df5ef47-b376-51c7-92fb-6053a249e6fb/3df5ef47-b376-51c7-92fb-6053a249e6fb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77849,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_ee8db833eea0b8d36feae0c7cfda7ca2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df5ef47-b376-51c7-92fb-6053a249e6fb/3df5ef47-b376-51c7-92fb-6053a249e6fb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_26c34c4f8cdc4b217c34b374c0a617ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df5ef47-b376-51c7-92fb-6053a249e6fb/3df5ef47-b376-51c7-92fb-6053a249e6fb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86030,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_0c8c246671bcd2dcd4519a7474d9d8c9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3df5ef47-b376-51c7-92fb-6053a249e6fb/3df5ef47-b376-51c7-92fb-6053a249e6fb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88080,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc9/7e/c97ebb0036afe19166ff52a8d450d089/pa/HW52746_471d0b4dfbac80efa6b22a5f15adbb4f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-09-01',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2011}
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW52746%27 HTTP/1.1" 200 None
2026-03-30 07:40:25 [auto1.de] INFO: Saving data for HW52746: {'created_time': 1774856425.931665, 'last_price_update_time': 1774856425.931679, 'auction_closing_time': 1774970974.0}
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW52746') HTTP/1.1" 204 0
2026-03-30 07:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_1be59dac8c6ecd8c13f240fc3a9bba3c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_de97bb252f5ecc5c369f2897bc9b77c2.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_de97bb252f5ecc5c369f2897bc9b77c2.jpg not downloaded yet
2026-03-30 07:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_5d6385a398bfa234e3aa18557c0ab5f1.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_6f264530d6400b3225caf2be3a296c5f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2d47450>
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_f2c54bf07c420012fb09c2ca6e56d02b.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_f2c54bf07c420012fb09c2ca6e56d02b.jpg saved to cache
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 798db20b-6417-5796-9011-f338ae3a8785
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23dc250>
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_464691c8515cd2eecf1f8e7d9a9fa7ee.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_464691c8515cd2eecf1f8e7d9a9fa7ee.jpg saved to cache
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 798db20b-6417-5796-9011-f338ae3a8785
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2305410>
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_0c7281fe16d11ac26dd25c9a392d22fb.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_0c7281fe16d11ac26dd25c9a392d22fb.jpg saved to cache
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 798db20b-6417-5796-9011-f338ae3a8785
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23deed0>
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_322c7d3c74bf78383d873072d929ea9d.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_322c7d3c74bf78383d873072d929ea9d.jpg saved to cache
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 798db20b-6417-5796-9011-f338ae3a8785
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2e63690>
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_0f8859f87ea3fbf813d9f944ed417aa9.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_0f8859f87ea3fbf813d9f944ed417aa9.jpg saved to cache
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 798db20b-6417-5796-9011-f338ae3a8785
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_a1c4398e8568f860b59bbcfc4501eea4.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_a1c4398e8568f860b59bbcfc4501eea4.jpg not downloaded yet
2026-03-30 07:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_256158ddf1ad08fcd56d5159bd7e1fdc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_805a86341821541daa879b06ece57811.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_c5d0ab34078b739f13030205014aa92c.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_c5d0ab34078b739f13030205014aa92c.jpg not downloaded yet
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2125f50>
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_1be59dac8c6ecd8c13f240fc3a9bba3c.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_1be59dac8c6ecd8c13f240fc3a9bba3c.jpg saved to cache
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 798db20b-6417-5796-9011-f338ae3a8785
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d229f810>
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_5d6385a398bfa234e3aa18557c0ab5f1.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_5d6385a398bfa234e3aa18557c0ab5f1.jpg saved to cache
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 798db20b-6417-5796-9011-f338ae3a8785
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2247010>
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_6f264530d6400b3225caf2be3a296c5f.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_6f264530d6400b3225caf2be3a296c5f.jpg saved to cache
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 798db20b-6417-5796-9011-f338ae3a8785
2026-03-30 07:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_f38fd5122170958334af071660395fcc.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_fbb3d47e949dcd552a5dd9658b05dd20.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_fbb3d47e949dcd552a5dd9658b05dd20.jpg not downloaded yet
2026-03-30 07:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_de97bb252f5ecc5c369f2897bc9b77c2.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_a09b482fe0fa7cd1c7882c8373cfaf7a.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2350850>
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_0.jpg HTTP/1.1" 201 0
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_256158ddf1ad08fcd56d5159bd7e1fdc.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_256158ddf1ad08fcd56d5159bd7e1fdc.jpg saved to cache
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2350390>
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_805a86341821541daa879b06ece57811.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_805a86341821541daa879b06ece57811.jpg saved to cache
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 798db20b-6417-5796-9011-f338ae3a8785
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_b008ba4e040eead1c9837a55d4e13936.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_b008ba4e040eead1c9837a55d4e13936.jpg not downloaded yet
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_97d163f7b7dec5b7a580d1946951c94f.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_97d163f7b7dec5b7a580d1946951c94f.jpg not downloaded yet
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d9114610>
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0b%252Fe8%252F0be811f037ffc02dc6f5547c69d6bce9%252Fpa%252FFR51775_f38fd5122170958334af071660395fcc.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_f38fd5122170958334af071660395fcc.jpg saved to cache
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 798db20b-6417-5796-9011-f338ae3a8785
2026-03-30 07:40:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 798db20b-6417-5796-9011-f338ae3a8785, skipping ID generation
2026-03-30 07:40:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 798db20b-6417-5796-9011-f338ae3a8785 with scrape type 1
2026-03-30 07:40:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 798db20b-6417-5796-9011-f338ae3a8785 sending to next pipeline
2026-03-30 07:40:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 798db20b-6417-5796-9011-f338ae3a8785, identifier: FR51775
2026-03-30 07:40:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 798db20b-6417-5796-9011-f338ae3a8785 with identifier: FR51775
2026-03-30 07:40:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 798db20b-6417-5796-9011-f338ae3a8785 with identifier: FR51775
2026-03-30 07:40:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 798db20b-6417-5796-9011-f338ae3a8785 with identifier: FR51775 to the API
2026-03-30 07:40:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_f38fd5122170958334af071660395fcc.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 243,
 'category': 'Rental',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'engine_horse_power': 143,
 'expiration_date': '2026-03-31T15:28:23Z',
 'fuel_type': 'diesel',
 'id': '798db20b-6417-5796-9011-f338ae3a8785',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR51775',
 'listing': 'auction',
 'location': 'DE, Germersheim',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 108127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59569,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_6f264530d6400b3225caf2be3a296c5f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_f2c54bf07c420012fb09c2ca6e56d02b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62499,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_464691c8515cd2eecf1f8e7d9a9fa7ee.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48645,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_0c7281fe16d11ac26dd25c9a392d22fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55912,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_322c7d3c74bf78383d873072d929ea9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57616,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_f38fd5122170958334af071660395fcc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40842,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_0f8859f87ea3fbf813d9f944ed417aa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64613,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_1be59dac8c6ecd8c13f240fc3a9bba3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58041,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_5d6385a398bfa234e3aa18557c0ab5f1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_798db20b-6417-5796-9011-f338ae3a8785/798db20b-6417-5796-9011-f338ae3a8785_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0b/e8/0be811f037ffc02dc6f5547c69d6bce9/pa/FR51775_805a86341821541daa879b06ece57811.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-06-15',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 314 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR51775%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Saving data for FR51775: {'created_time': 1774856427.369626, 'last_price_update_time': 1774856427.369638, 'auction_closing_time': 1774970903.0}
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR51775') HTTP/1.1" 204 0
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d229c950>
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_2.jpg HTTP/1.1" 201 0
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_de97bb252f5ecc5c369f2897bc9b77c2.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_de97bb252f5ecc5c369f2897bc9b77c2.jpg saved to cache
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2205490>
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_1.jpg HTTP/1.1" 201 0
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_a09b482fe0fa7cd1c7882c8373cfaf7a.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_a09b482fe0fa7cd1c7882c8373cfaf7a.jpg saved to cache
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4
2026-03-30 07:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_a1c4398e8568f860b59bbcfc4501eea4.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_6f00a733345cc06b7f2d80b603c254f7.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_6f00a733345cc06b7f2d80b603c254f7.jpg not downloaded yet
2026-03-30 07:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_c5d0ab34078b739f13030205014aa92c.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_fbb3d47e949dcd552a5dd9658b05dd20.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_1556cf567982ae8e87b81e371afc0b59.jpg%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_1556cf567982ae8e87b81e371afc0b59.jpg not downloaded yet
2026-03-30 07:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_97d163f7b7dec5b7a580d1946951c94f.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2330d90>
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_3.jpg HTTP/1.1" 201 0
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_a1c4398e8568f860b59bbcfc4501eea4.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_a1c4398e8568f860b59bbcfc4501eea4.jpg saved to cache
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4
2026-03-30 07:40:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_b008ba4e040eead1c9837a55d4e13936.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24a4ed0>
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_4.jpg HTTP/1.1" 201 0
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_c5d0ab34078b739f13030205014aa92c.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_c5d0ab34078b739f13030205014aa92c.jpg saved to cache
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2279710>
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_5.jpg HTTP/1.1" 201 0
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_fbb3d47e949dcd552a5dd9658b05dd20.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_fbb3d47e949dcd552a5dd9658b05dd20.jpg saved to cache
2026-03-30 07:40:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4
2026-03-30 07:40:27 [auto1.de] INFO: Channel: 24h | Page: 34 | totalHits: 7956 | hits on page: 40
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: ZA83090
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA83090%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for ZA83090: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: UL88623
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: NX62884
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX62884%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for NX62884: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: JJ76956
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ76956%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for JJ76956: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: NW73502
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: BV67523
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: NW01649
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: ZX12399
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX12399%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for ZX12399: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: SN44411
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: BJ40023
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: HA10005
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA10005%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for HA10005: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: GM20688
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM20688%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for GM20688: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: CZ25681
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ25681%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for CZ25681: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: VR35896
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: CG76921
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: JT14161
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: WF02803
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: GX28379
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX28379%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for GX28379: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: LN95655
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: UH31359
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH31359%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for UH31359: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: LG46226
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG46226%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for LG46226: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: BE23086
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE23086%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for BE23086: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: HP19661
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: FA69463
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: GN33586
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN33586%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for GN33586: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: WG22836
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: HN88809
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN88809%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for HN88809: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: NV36056
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV36056%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for NV36056: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: GF37615
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF37615%27 HTTP/1.1" 200 None
2026-03-30 07:40:27 [auto1.de] INFO: Scrape type for GF37615: 0
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: VF27943
2026-03-30 07:40:27 [auto1.de] INFO: Found listing with ID: MC98570
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98570%27 HTTP/1.1" 200 None
2026-03-30 07:40:28 [auto1.de] INFO: Scrape type for MC98570: 0
2026-03-30 07:40:28 [auto1.de] INFO: Found listing with ID: EK20296
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK20296%27 HTTP/1.1" 200 None
2026-03-30 07:40:28 [auto1.de] INFO: Scrape type for EK20296: 0
2026-03-30 07:40:28 [auto1.de] INFO: Found listing with ID: TU72063
2026-03-30 07:40:28 [auto1.de] INFO: Found listing with ID: AF05413
2026-03-30 07:40:28 [auto1.de] INFO: Found listing with ID: JY14465
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY14465%27 HTTP/1.1" 200 None
2026-03-30 07:40:28 [auto1.de] INFO: Scrape type for JY14465: 0
2026-03-30 07:40:28 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-30 07:40:28 [auto1.de] INFO: Found listing with ID: TT55225
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT55225%27 HTTP/1.1" 200 None
2026-03-30 07:40:28 [auto1.de] INFO: Scrape type for TT55225: 0
2026-03-30 07:40:28 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-30 07:40:28 [auto1.de] INFO: Found listing with ID: EX17549
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX17549%27 HTTP/1.1" 200 None
2026-03-30 07:40:28 [auto1.de] INFO: Scrape type for EX17549: 0
2026-03-30 07:40:28 [auto1.de] INFO: Found listing with ID: TE08681
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08681%27 HTTP/1.1" 200 None
2026-03-30 07:40:28 [auto1.de] INFO: Scrape type for TE08681: 0
2026-03-30 07:40:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_6f00a733345cc06b7f2d80b603c254f7.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2471a90>
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_7.jpg HTTP/1.1" 201 0
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_97d163f7b7dec5b7a580d1946951c94f.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_97d163f7b7dec5b7a580d1946951c94f.jpg saved to cache
2026-03-30 07:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4
2026-03-30 07:40:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_1556cf567982ae8e87b81e371afc0b59.jpg> (referer: https://www.auto1.com/)
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d2f67fd0>
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_6.jpg HTTP/1.1" 201 0
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_b008ba4e040eead1c9837a55d4e13936.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_b008ba4e040eead1c9837a55d4e13936.jpg saved to cache
2026-03-30 07:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d24737d0>
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_8.jpg HTTP/1.1" 201 0
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_6f00a733345cc06b7f2d80b603c254f7.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_6f00a733345cc06b7f2d80b603c254f7.jpg saved to cache
2026-03-30 07:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fe5d23a6810>
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-30 07:40:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_9.jpg HTTP/1.1" 201 0
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.de',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg91%252F42%252F9142a7b4e377bb68ab807ed55e5cacf7%252Fpa%252FBB43937_1556cf567982ae8e87b81e371afc0b59.jpg') HTTP/1.1" 204 0
2026-03-30 07:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_1556cf567982ae8e87b81e371afc0b59.jpg saved to cache
2026-03-30 07:40:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4
2026-03-30 07:40:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39fc2864-eb9b-5f17-83fd-ff9b70e025f4, skipping ID generation
2026-03-30 07:40:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4 with scrape type 1
2026-03-30 07:40:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39fc2864-eb9b-5f17-83fd-ff9b70e025f4 sending to next pipeline
2026-03-30 07:40:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39fc2864-eb9b-5f17-83fd-ff9b70e025f4, identifier: BB43937
2026-03-30 07:40:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39fc2864-eb9b-5f17-83fd-ff9b70e025f4 with identifier: BB43937
2026-03-30 07:40:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39fc2864-eb9b-5f17-83fd-ff9b70e025f4 with identifier: BB43937
2026-03-30 07:40:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39fc2864-eb9b-5f17-83fd-ff9b70e025f4 with identifier: BB43937 to the API
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_1556cf567982ae8e87b81e371afc0b59.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-31T15:02:41Z',
 'fuel_type': 'petrol',
 'id': '39fc2864-eb9b-5f17-83fd-ff9b70e025f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB43937',
 'listing': 'auction',
 'location': 'DE, Flensburg',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 176379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_256158ddf1ad08fcd56d5159bd7e1fdc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68296,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_a09b482fe0fa7cd1c7882c8373cfaf7a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84320,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_de97bb252f5ecc5c369f2897bc9b77c2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64077,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_a1c4398e8568f860b59bbcfc4501eea4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68027,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_c5d0ab34078b739f13030205014aa92c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79256,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_fbb3d47e949dcd552a5dd9658b05dd20.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_b008ba4e040eead1c9837a55d4e13936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69571,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_97d163f7b7dec5b7a580d1946951c94f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76345,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_6f00a733345cc06b7f2d80b603c254f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_39fc2864-eb9b-5f17-83fd-ff9b70e025f4/39fc2864-eb9b-5f17-83fd-ff9b70e025f4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91335,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img91/42/9142a7b4e377bb68ab807ed55e5cacf7/pa/BB43937_1556cf567982ae8e87b81e371afc0b59.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-09',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Volvo XC40 2.0 T4 R-Design 2WD',
 'transmission': 'automatic',
 'trim': 'R-Design 2WD',
 'year': 2018}
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB43937%27 HTTP/1.1" 200 None
2026-03-30 07:40:28 [auto1.de] INFO: Saving data for BB43937: {'created_time': 1774856428.931151, 'last_price_update_time': 1774856428.931164, 'auction_closing_time': 1774969361.0}
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB43937') HTTP/1.1" 204 0
2026-03-30 07:40:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:29 [auto1.de] INFO: Channel: 24h | Page: 35 | totalHits: 7962 | hits on page: 40
2026-03-30 07:40:29 [auto1.de] INFO: Found listing with ID: JY14465
2026-03-30 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY14465%27 HTTP/1.1" 200 None
2026-03-30 07:40:29 [auto1.de] INFO: Scrape type for JY14465: 0
2026-03-30 07:40:29 [auto1.de] INFO: Found listing with ID: GC94975
2026-03-30 07:40:29 [auto1.de] INFO: Found listing with ID: TT55225
2026-03-30 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT55225%27 HTTP/1.1" 200 None
2026-03-30 07:40:29 [auto1.de] INFO: Scrape type for TT55225: 0
2026-03-30 07:40:29 [auto1.de] INFO: Found listing with ID: ZR75909
2026-03-30 07:40:29 [auto1.de] INFO: Found listing with ID: EX17549
2026-03-30 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX17549%27 HTTP/1.1" 200 None
2026-03-30 07:40:29 [auto1.de] INFO: Scrape type for EX17549: 0
2026-03-30 07:40:29 [auto1.de] INFO: Found listing with ID: TE08681
2026-03-30 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE08681%27 HTTP/1.1" 200 None
2026-03-30 07:40:29 [auto1.de] INFO: Scrape type for TE08681: 0
2026-03-30 07:40:29 [auto1.de] INFO: Found listing with ID: HB21625
2026-03-30 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB21625%27 HTTP/1.1" 200 None
2026-03-30 07:40:29 [auto1.de] INFO: Scrape type for HB21625: 0
2026-03-30 07:40:29 [auto1.de] INFO: Found listing with ID: YW33550
2026-03-30 07:40:29 [auto1.de] INFO: Found listing with ID: RT89872
2026-03-30 07:40:29 [auto1.de] INFO: Found listing with ID: VE07121
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE07121%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for VE07121: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: VN24673
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: RL83760
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL83760%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for RL83760: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: HH17921
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH17921%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for HH17921: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: UY63030
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY63030%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for UY63030: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: ZY88037
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: NC19407
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC19407%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for NC19407: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: MZ37823
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37823%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for MZ37823: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: AA02702
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: KG90894
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: WX41278
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: RC66900
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: FF58085
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: XV56284
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV56284%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for XV56284: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: TR94323
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: EJ33834
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: KH07650
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH07650%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for KH07650: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: FN39592
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: YV56430
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: VV83737
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: BS63746
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS63746%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for BS63746: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: EC15325
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: BD67330
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD67330%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for BD67330: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: XY86775
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY86775%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for XY86775: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: JC71292
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC71292%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for JC71292: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: MR97164
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR97164%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for MR97164: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: TL60563
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: GF90377
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF90377%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for GF90377: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX05236%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for EX05236: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: RR70760
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR70760%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for RR70760: 0
2026-03-30 07:40:30 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY44506%27 HTTP/1.1" 200 None
2026-03-30 07:40:30 [auto1.de] INFO: Scrape type for FY44506: 0
2026-03-30 07:40:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:31 [auto1.de] INFO: Channel: 24h | Page: 36 | totalHits: 7965 | hits on page: 40
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: EX05236
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX05236%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for EX05236: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: RR70760
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR70760%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for RR70760: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: FY44506
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY44506%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for FY44506: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: DC02620
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC02620%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for DC02620: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: XW84981
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: LF08399
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF08399%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for LF08399: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: MT41300
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT41300%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for MT41300: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: WT31487
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT31487%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for WT31487: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: HB92022
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB92022%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for HB92022: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: XE54390
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: GT54138
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT54138%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for GT54138: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: US93398
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: WY12370
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: UJ19896
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: LN54864
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: ZL28977
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: GA07513
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA07513%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for GA07513: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: BS02635
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS02635%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for BS02635: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: FE29735
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: UB74163
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB74163%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for UB74163: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: TB77068
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB77068%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for TB77068: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: NB51359
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB51359%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for NB51359: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: SP94156
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP94156%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for SP94156: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: KJ70545
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ70545%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for KJ70545: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: NV52830
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV52830%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for NV52830: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: XW55257
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: WM05984
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM05984%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for WM05984: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: TY76082
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY76082%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for TY76082: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: VN17699
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN17699%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for VN17699: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: FG48186
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: EC36111
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC36111%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for EC36111: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: WJ67809
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ67809%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for WJ67809: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: GB77683
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: WZ39505
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: YL47006
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: BT97276
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: UJ62660
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: UY36184
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: JK20630
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK20630%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for JK20630: 0
2026-03-30 07:40:31 [auto1.de] INFO: Found listing with ID: WE06039
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE06039%27 HTTP/1.1" 200 None
2026-03-30 07:40:31 [auto1.de] INFO: Scrape type for WE06039: 0
2026-03-30 07:40:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:33 [auto1.de] INFO: Channel: 24h | Page: 37 | totalHits: 7965 | hits on page: 40
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: UR84816
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR84816%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for UR84816: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: UF70247
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF70247%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for UF70247: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: XA86799
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: SU99742
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: ZE87532
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: PT45615
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: JY35599
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: ZJ67042
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ67042%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for ZJ67042: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: JA40486
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA40486%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for JA40486: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: JY67859
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: SG28932
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: MG41395
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: JL52757
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL52757%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for JL52757: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: ND21540
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND21540%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for ND21540: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: DN18269
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: XG25622
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG25622%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for XG25622: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: WK49951
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: VX95412
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX95412%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for VX95412: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: NP40069
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP40069%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for NP40069: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: AE04688
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE04688%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for AE04688: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: HG95875
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: VW68690
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW68690%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for VW68690: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: NX61710
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX61710%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for NX61710: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: LG72403
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG72403%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for LG72403: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: KX92622
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX92622%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for KX92622: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: KY89472
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY89472%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for KY89472: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: SV54413
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: CL13866
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: WM17924
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: BY81957
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: KP55119
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: NJ51378
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: CF02627
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: NV13979
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV13979%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for NV13979: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: DM11182
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: EX39495
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: SR10535
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR10535%27 HTTP/1.1" 200 None
2026-03-30 07:40:33 [auto1.de] INFO: Scrape type for SR10535: 0
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: GR07934
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: LY60106
2026-03-30 07:40:33 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-30 07:40:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:34 [auto1.de] INFO: Channel: 24h | Page: 38 | totalHits: 7966 | hits on page: 40
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: GZ84157
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: CM86164
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM86164%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for CM86164: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: AD16750
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD16750%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for AD16750: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: UF75132
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: FR75533
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: JE79090
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE79090%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for JE79090: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: RK76188
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK76188%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for RK76188: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: TU64777
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU64777%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for TU64777: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: EK64818
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: XY93824
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY93824%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for XY93824: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: AT28488
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: YB70330
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB70330%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for YB70330: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: YW90897
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: UD27058
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD27058%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for UD27058: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: CJ04557
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ04557%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for CJ04557: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: VV98645
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98645%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for VV98645: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: JG12226
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: UV43425
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: MH98673
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH98673%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for MH98673: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: LD99689
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD99689%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for LD99689: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: JM98796
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM98796%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for JM98796: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: VM39350
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: CZ09643
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: LZ98247
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: TB49409
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB49409%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for TB49409: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: NB42822
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB42822%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for NB42822: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: KU03533
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU03533%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for KU03533: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: LV79824
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: PM35820
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM35820%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for PM35820: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: RE71424
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE71424%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for RE71424: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: TZ64186
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ64186%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for TZ64186: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: HE78253
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE78253%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for HE78253: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: WC37981
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC37981%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for WC37981: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: HA87343
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA87343%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for HA87343: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: VU91193
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU91193%27 HTTP/1.1" 200 None
2026-03-30 07:40:34 [auto1.de] INFO: Scrape type for VU91193: 0
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: TX49680
2026-03-30 07:40:34 [auto1.de] INFO: Found listing with ID: EE57065
2026-03-30 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE57065%27 HTTP/1.1" 200 None
2026-03-30 07:40:35 [auto1.de] INFO: Scrape type for EE57065: 0
2026-03-30 07:40:35 [auto1.de] INFO: Found listing with ID: BP97760
2026-03-30 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97760%27 HTTP/1.1" 200 None
2026-03-30 07:40:35 [auto1.de] INFO: Scrape type for BP97760: 0
2026-03-30 07:40:35 [auto1.de] INFO: Found listing with ID: MW79047
2026-03-30 07:40:35 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-30 07:40:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:36 [auto1.de] INFO: Channel: 24h | Page: 39 | totalHits: 7969 | hits on page: 40
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: BP97760
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97760%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for BP97760: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: MW79047
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: RP29277
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: HC04393
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04393%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for HC04393: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: ZV78302
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV78302%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for ZV78302: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: VX94865
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: ES20413
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES20413%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for ES20413: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: CZ47065
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: XE08723
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: LZ63004
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ63004%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for LZ63004: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: AU50389
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: VT21239
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT21239%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for VT21239: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: ME62571
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME62571%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for ME62571: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: KJ28184
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: NV69214
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV69214%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for NV69214: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: HY43469
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: UT98357
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: KF75867
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: JA01983
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: AH44309
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: UJ23150
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ23150%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for UJ23150: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: YK45245
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK45245%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for YK45245: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: PM99817
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: DB08314
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: HS17931
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS17931%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for HS17931: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: DP06637
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: NG65344
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: JC50514
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC50514%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for JC50514: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: XT30705
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: AD00479
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: CL69426
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: TS98691
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98691%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for TS98691: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: KH18492
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH18492%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for KH18492: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: WJ52801
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: TC78124
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC78124%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for TC78124: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: PY29315
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY29315%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for PY29315: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: EE66446
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE66446%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for EE66446: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: WW76911
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW76911%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for WW76911: 0
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: GV67741
2026-03-30 07:40:36 [auto1.de] INFO: Found listing with ID: VY63466
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY63466%27 HTTP/1.1" 200 None
2026-03-30 07:40:36 [auto1.de] INFO: Scrape type for VY63466: 0
2026-03-30 07:40:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:37 [auto1.de] INFO: Channel: 24h | Page: 40 | totalHits: 7969 | hits on page: 40
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: SR43778
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: PF70516
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: MB34428
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB34428%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for MB34428: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: YY88868
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: WL17880
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL17880%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for WL17880: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: PA05830
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA05830%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for PA05830: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: AX54291
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX54291%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for AX54291: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: NY52199
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY52199%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for NY52199: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: CL67465
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL67465%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for CL67465: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: EU26057
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: KN25796
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN25796%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for KN25796: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: NN77195
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN77195%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for NN77195: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: RZ45087
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: HW35113
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: TP80753
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: NF53472
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF53472%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for NF53472: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: HC78210
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: WB48893
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: WX30683
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30683%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for WX30683: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: YK03536
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: HZ13557
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13557%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for HZ13557: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: CP72119
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP72119%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for CP72119: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: TU13190
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU13190%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for TU13190: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: VG12821
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: NW56335
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: EJ19003
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: EL19889
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: JG80760
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG80760%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for JG80760: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: XC49831
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC49831%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for XC49831: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: TV16338
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV16338%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for TV16338: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: AS89586
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS89586%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for AS89586: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: XL04777
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: ZB59540
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59540%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for ZB59540: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: EZ65040
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ65040%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for EZ65040: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: KR07785
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR07785%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for KR07785: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW58984%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for CW58984: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF51547%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for ZF51547: 0
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: BL18853
2026-03-30 07:40:37 [auto1.de] INFO: Found listing with ID: DW68241
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68241%27 HTTP/1.1" 200 None
2026-03-30 07:40:37 [auto1.de] INFO: Scrape type for DW68241: 0
2026-03-30 07:40:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:39 [auto1.de] INFO: Channel: 24h | Page: 41 | totalHits: 7974 | hits on page: 40
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: CW58984
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW58984%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for CW58984: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: ZF51547
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF51547%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for ZF51547: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: LE60252
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: BL18853
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: DW68241
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW68241%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for DW68241: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: GX07003
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX07003%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for GX07003: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: AE08285
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08285%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for AE08285: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: BV75755
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV75755%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for BV75755: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: XE49281
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: SY67219
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: NL19475
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: WJ46196
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: GZ46196
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ46196%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for GZ46196: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: WE35343
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE35343%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for WE35343: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: UW13006
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13006%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for UW13006: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: AT70381
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: VN12200
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN12200%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for VN12200: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: MS26334
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: HE00957
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: ST83220
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST83220%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for ST83220: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: PJ99813
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: WP80129
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP80129%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for WP80129: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: TJ95012
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ95012%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for TJ95012: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: BB55573
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB55573%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for BB55573: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: AE82588
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE82588%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for AE82588: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: UA53606
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53606%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for UA53606: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: LS75303
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS75303%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for LS75303: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: VH02312
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH02312%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for VH02312: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: PN52671
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN52671%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for PN52671: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: NN25217
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN25217%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for NN25217: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: SR95486
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: NL19683
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL19683%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for NL19683: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: SV33608
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV33608%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for SV33608: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: JW05859
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW05859%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for JW05859: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: WL45010
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: YG26489
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG26489%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for YG26489: 0
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: VJ55974
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: YP11119
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: MC32966
2026-03-30 07:40:39 [auto1.de] INFO: Found listing with ID: GE22934
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE22934%27 HTTP/1.1" 200 None
2026-03-30 07:40:39 [auto1.de] INFO: Scrape type for GE22934: 0
2026-03-30 07:40:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:40 [auto1.de] INFO: Channel: 24h | Page: 42 | totalHits: 7975 | hits on page: 40
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: GE22934
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE22934%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for GE22934: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: FB20654
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: GM09493
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM09493%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for GM09493: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: UZ05424
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ05424%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for UZ05424: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: AY40999
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY40999%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for AY40999: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: FA50226
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: SY89352
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: YE79096
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: XG44569
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: XZ28453
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ28453%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for XZ28453: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: EE17704
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: TU83885
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83885%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for TU83885: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: ZU14307
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU14307%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for ZU14307: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: WT63610
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: GD86800
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: MT90206
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: EH26353
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH26353%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for EH26353: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: TU83793
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU83793%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for TU83793: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: FL70928
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL70928%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for FL70928: 0
2026-03-30 07:40:40 [auto1.de] INFO: Found listing with ID: ZU61192
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61192%27 HTTP/1.1" 200 None
2026-03-30 07:40:40 [auto1.de] INFO: Scrape type for ZU61192: 2
2026-03-30 07:40:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6bef79-2b97-57de-bdec-6c677f278cbe with identifier: ZU61192
2026-03-30 07:40:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6bef79-2b97-57de-bdec-6c677f278cbe with scrape type 2
2026-03-30 07:40:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b6bef79-2b97-57de-bdec-6c677f278cbe with scrape type 2
2026-03-30 07:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b6bef79-2b97-57de-bdec-6c677f278cbe, identifier: ZU61192
2026-03-30 07:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b6bef79-2b97-57de-bdec-6c677f278cbe with identifier: ZU61192
2026-03-30 07:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b6bef79-2b97-57de-bdec-6c677f278cbe with identifier: ZU61192
2026-03-30 07:40:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b6bef79-2b97-57de-bdec-6c677f278cbe with identifier: ZU61192 to the API
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:09Z',
 'fuel_type': 'petrol',
 'id': '6b6bef79-2b97-57de-bdec-6c677f278cbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZU61192',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 129361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Seat Leon 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2014}
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU61192%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Saving data for ZU61192: {'auction_closing_time': 1774884729.0, 'created_time': 1773344876.298529, 'last_price_update_time': 1774856441.719534}
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZU61192') HTTP/1.1" 204 0
2026-03-30 07:40:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:41 [auto1.de] INFO: Found listing with ID: PY62114
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY62114%27 HTTP/1.1" 200 None
2026-03-30 07:40:41 [auto1.de] INFO: Scrape type for PY62114: 2
2026-03-30 07:40:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6b9ceef-b7e7-520c-bc6f-f88b0b9677b3 with identifier: PY62114
2026-03-30 07:40:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6b9ceef-b7e7-520c-bc6f-f88b0b9677b3 with scrape type 2
2026-03-30 07:40:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6b9ceef-b7e7-520c-bc6f-f88b0b9677b3 with scrape type 2
2026-03-30 07:40:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6b9ceef-b7e7-520c-bc6f-f88b0b9677b3, identifier: PY62114
2026-03-30 07:40:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6b9ceef-b7e7-520c-bc6f-f88b0b9677b3 with identifier: PY62114
2026-03-30 07:40:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6b9ceef-b7e7-520c-bc6f-f88b0b9677b3 with identifier: PY62114
2026-03-30 07:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6b9ceef-b7e7-520c-bc6f-f88b0b9677b3 with identifier: PY62114 to the API
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:50:31Z',
 'fuel_type': 'petrol',
 'id': 'd6b9ceef-b7e7-520c-bc6f-f88b0b9677b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY62114',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 82008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seller_name': None,
 'title': 'BMW X2 sDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY62114%27 HTTP/1.1" 200 None
2026-03-30 07:40:42 [auto1.de] INFO: Saving data for PY62114: {'auction_closing_time': 1774885831.0, 'created_time': 1773135854.267106, 'last_price_update_time': 1774856442.256836}
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY62114') HTTP/1.1" 204 0
2026-03-30 07:40:42 [auto1.de] INFO: Found listing with ID: KS19016
2026-03-30 07:40:42 [auto1.de] INFO: Found listing with ID: UB19219
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19219%27 HTTP/1.1" 200 None
2026-03-30 07:40:42 [auto1.de] INFO: Scrape type for UB19219: 2
2026-03-30 07:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92e1e110-d5b0-59c9-835e-be4d808854d9 with identifier: UB19219
2026-03-30 07:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92e1e110-d5b0-59c9-835e-be4d808854d9 with scrape type 2
2026-03-30 07:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92e1e110-d5b0-59c9-835e-be4d808854d9 with scrape type 2
2026-03-30 07:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92e1e110-d5b0-59c9-835e-be4d808854d9, identifier: UB19219
2026-03-30 07:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92e1e110-d5b0-59c9-835e-be4d808854d9 with identifier: UB19219
2026-03-30 07:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92e1e110-d5b0-59c9-835e-be4d808854d9 with identifier: UB19219
2026-03-30 07:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92e1e110-d5b0-59c9-835e-be4d808854d9 with identifier: UB19219 to the API
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:45:20Z',
 'fuel_type': 'petrol',
 'id': '92e1e110-d5b0-59c9-835e-be4d808854d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB19219',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 58419,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-27',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB19219%27 HTTP/1.1" 200 None
2026-03-30 07:40:42 [auto1.de] INFO: Saving data for UB19219: {'auction_closing_time': 1774885520.0, 'created_time': 1773380823.13447, 'last_price_update_time': 1774856442.738204}
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB19219') HTTP/1.1" 204 0
2026-03-30 07:40:42 [auto1.de] INFO: Found listing with ID: UT35325
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT35325%27 HTTP/1.1" 200 None
2026-03-30 07:40:42 [auto1.de] INFO: Scrape type for UT35325: 2
2026-03-30 07:40:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ca26020-5fd7-516c-9749-87a46de5557a with identifier: UT35325
2026-03-30 07:40:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ca26020-5fd7-516c-9749-87a46de5557a with scrape type 2
2026-03-30 07:40:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ca26020-5fd7-516c-9749-87a46de5557a with scrape type 2
2026-03-30 07:40:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0ca26020-5fd7-516c-9749-87a46de5557a, identifier: UT35325
2026-03-30 07:40:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0ca26020-5fd7-516c-9749-87a46de5557a with identifier: UT35325
2026-03-30 07:40:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0ca26020-5fd7-516c-9749-87a46de5557a with identifier: UT35325
2026-03-30 07:40:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0ca26020-5fd7-516c-9749-87a46de5557a with identifier: UT35325 to the API
2026-03-30 07:40:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 441,
 'expiration_date': '2026-03-30T15:25:33Z',
 'fuel_type': 'petrol',
 'id': '0ca26020-5fd7-516c-9749-87a46de5557a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT35325',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 202530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 07:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT35325%27 HTTP/1.1" 200 None
2026-03-30 07:40:43 [auto1.de] INFO: Saving data for UT35325: {'auction_closing_time': 1774884333.0, 'created_time': 1774769730.613028, 'last_price_update_time': 1774856443.149651}
2026-03-30 07:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT35325') HTTP/1.1" 204 0
2026-03-30 07:40:43 [auto1.de] INFO: Found listing with ID: SH98568
2026-03-30 07:40:43 [auto1.de] INFO: Found listing with ID: FU56159
2026-03-30 07:40:43 [auto1.de] INFO: Found listing with ID: HP87515
2026-03-30 07:40:43 [auto1.de] INFO: Found listing with ID: VE03726
2026-03-30 07:40:43 [auto1.de] INFO: Found listing with ID: NG98905
2026-03-30 07:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG98905%27 HTTP/1.1" 200 None
2026-03-30 07:40:43 [auto1.de] INFO: Scrape type for NG98905: 2
2026-03-30 07:40:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67fea5ec-eb4c-50b7-823d-5b68e65dfb20 with identifier: NG98905
2026-03-30 07:40:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67fea5ec-eb4c-50b7-823d-5b68e65dfb20 with scrape type 2
2026-03-30 07:40:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67fea5ec-eb4c-50b7-823d-5b68e65dfb20 with scrape type 2
2026-03-30 07:40:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67fea5ec-eb4c-50b7-823d-5b68e65dfb20, identifier: NG98905
2026-03-30 07:40:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67fea5ec-eb4c-50b7-823d-5b68e65dfb20 with identifier: NG98905
2026-03-30 07:40:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67fea5ec-eb4c-50b7-823d-5b68e65dfb20 with identifier: NG98905
2026-03-30 07:40:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67fea5ec-eb4c-50b7-823d-5b68e65dfb20 with identifier: NG98905 to the API
2026-03-30 07:40:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:49:11Z',
 'fuel_type': 'diesel',
 'id': '67fea5ec-eb4c-50b7-823d-5b68e65dfb20',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG98905',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 146052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-22',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG98905%27 HTTP/1.1" 200 None
2026-03-30 07:40:44 [auto1.de] INFO: Saving data for NG98905: {'auction_closing_time': 1774885751.0, 'created_time': 1773226777.89519, 'last_price_update_time': 1774856444.468779}
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG98905') HTTP/1.1" 204 0
2026-03-30 07:40:44 [auto1.de] INFO: Found listing with ID: VC98877
2026-03-30 07:40:44 [auto1.de] INFO: Found listing with ID: JC07133
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC07133%27 HTTP/1.1" 200 None
2026-03-30 07:40:44 [auto1.de] INFO: Scrape type for JC07133: 2
2026-03-30 07:40:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3db78596-871f-5e2f-8bca-fc420ad4a358 with identifier: JC07133
2026-03-30 07:40:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3db78596-871f-5e2f-8bca-fc420ad4a358 with scrape type 2
2026-03-30 07:40:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3db78596-871f-5e2f-8bca-fc420ad4a358 with scrape type 2
2026-03-30 07:40:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3db78596-871f-5e2f-8bca-fc420ad4a358, identifier: JC07133
2026-03-30 07:40:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3db78596-871f-5e2f-8bca-fc420ad4a358 with identifier: JC07133
2026-03-30 07:40:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3db78596-871f-5e2f-8bca-fc420ad4a358 with identifier: JC07133
2026-03-30 07:40:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3db78596-871f-5e2f-8bca-fc420ad4a358 with identifier: JC07133 to the API
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:13:03Z',
 'fuel_type': 'diesel',
 'id': '3db78596-871f-5e2f-8bca-fc420ad4a358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JC07133',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 198352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-13',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Premium 4WD',
 'transmission': 'automatic',
 'trim': 'Premium 4WD',
 'year': 2016}
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC07133%27 HTTP/1.1" 200 None
2026-03-30 07:40:44 [auto1.de] INFO: Saving data for JC07133: {'auction_closing_time': 1774883583.0, 'created_time': 1773342397.858274, 'last_price_update_time': 1774856444.894873}
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JC07133') HTTP/1.1" 204 0
2026-03-30 07:40:45 [auto1.de] INFO: Found listing with ID: SJ83553
2026-03-30 07:40:45 [auto1.de] INFO: Found listing with ID: GL55365
2026-03-30 07:40:45 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52924%27 HTTP/1.1" 200 None
2026-03-30 07:40:45 [auto1.de] INFO: Scrape type for JR52924: 0
2026-03-30 07:40:45 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU38011%27 HTTP/1.1" 200 None
2026-03-30 07:40:45 [auto1.de] INFO: Scrape type for MU38011: 2
2026-03-30 07:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bba69ba-5742-5f33-ba34-24ea153f5869 with identifier: MU38011
2026-03-30 07:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bba69ba-5742-5f33-ba34-24ea153f5869 with scrape type 2
2026-03-30 07:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bba69ba-5742-5f33-ba34-24ea153f5869 with scrape type 2
2026-03-30 07:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bba69ba-5742-5f33-ba34-24ea153f5869, identifier: MU38011
2026-03-30 07:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bba69ba-5742-5f33-ba34-24ea153f5869 with identifier: MU38011
2026-03-30 07:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bba69ba-5742-5f33-ba34-24ea153f5869 with identifier: MU38011
2026-03-30 07:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bba69ba-5742-5f33-ba34-24ea153f5869 with identifier: MU38011 to the API
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:47:08Z',
 'fuel_type': 'petrol',
 'id': '6bba69ba-5742-5f33-ba34-24ea153f5869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU38011',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 20333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-30',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B3 Mild-Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2024}
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU38011%27 HTTP/1.1" 200 None
2026-03-30 07:40:45 [auto1.de] INFO: Saving data for MU38011: {'auction_closing_time': 1774885628.0, 'created_time': 1773132368.796141, 'last_price_update_time': 1774856445.45492}
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU38011') HTTP/1.1" 204 0
2026-03-30 07:40:45 [auto1.de] INFO: Found listing with ID: GM39396
2026-03-30 07:40:45 [auto1.de] INFO: Found listing with ID: KM60144
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM60144%27 HTTP/1.1" 200 None
2026-03-30 07:40:45 [auto1.de] INFO: Scrape type for KM60144: 2
2026-03-30 07:40:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9f7301e-50e7-5833-8b8f-6538b2a802dd with identifier: KM60144
2026-03-30 07:40:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9f7301e-50e7-5833-8b8f-6538b2a802dd with scrape type 2
2026-03-30 07:40:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9f7301e-50e7-5833-8b8f-6538b2a802dd with scrape type 2
2026-03-30 07:40:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9f7301e-50e7-5833-8b8f-6538b2a802dd, identifier: KM60144
2026-03-30 07:40:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9f7301e-50e7-5833-8b8f-6538b2a802dd with identifier: KM60144
2026-03-30 07:40:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9f7301e-50e7-5833-8b8f-6538b2a802dd with identifier: KM60144
2026-03-30 07:40:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9f7301e-50e7-5833-8b8f-6538b2a802dd with identifier: KM60144 to the API
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-30T15:14:56Z',
 'fuel_type': 'diesel',
 'id': 'b9f7301e-50e7-5833-8b8f-6538b2a802dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM60144',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 144344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-18',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 Summum AWD',
 'transmission': 'automatic',
 'trim': 'Summum AWD',
 'year': 2015}
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM60144%27 HTTP/1.1" 200 None
2026-03-30 07:40:45 [auto1.de] INFO: Saving data for KM60144: {'auction_closing_time': 1774883696.0, 'created_time': 1773227772.864592, 'last_price_update_time': 1774856445.960939}
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM60144') HTTP/1.1" 204 0
2026-03-30 07:40:45 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-30 07:40:45 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-30 07:40:45 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-30 07:40:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP76789%27 HTTP/1.1" 200 None
2026-03-30 07:40:46 [auto1.de] INFO: Scrape type for KP76789: 2
2026-03-30 07:40:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b053e8d-8e6d-54eb-9d01-e86bf24b9549 with identifier: KP76789
2026-03-30 07:40:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b053e8d-8e6d-54eb-9d01-e86bf24b9549 with scrape type 2
2026-03-30 07:40:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b053e8d-8e6d-54eb-9d01-e86bf24b9549 with scrape type 2
2026-03-30 07:40:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6b053e8d-8e6d-54eb-9d01-e86bf24b9549, identifier: KP76789
2026-03-30 07:40:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6b053e8d-8e6d-54eb-9d01-e86bf24b9549 with identifier: KP76789
2026-03-30 07:40:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6b053e8d-8e6d-54eb-9d01-e86bf24b9549 with identifier: KP76789
2026-03-30 07:40:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6b053e8d-8e6d-54eb-9d01-e86bf24b9549 with identifier: KP76789 to the API
2026-03-30 07:40:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-30T15:33:50Z',
 'fuel_type': 'petrol',
 'id': '6b053e8d-8e6d-54eb-9d01-e86bf24b9549',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP76789',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 10494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seller_name': None,
 'title': 'BMW 4er 420i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-30 07:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP76789%27 HTTP/1.1" 200 None
2026-03-30 07:40:46 [auto1.de] INFO: Saving data for KP76789: {'auction_closing_time': 1774884830.0, 'created_time': 1774465937.212623, 'last_price_update_time': 1774856446.419239}
2026-03-30 07:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KP76789') HTTP/1.1" 204 0
2026-03-30 07:40:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:46 [auto1.de] INFO: Channel: 24h | Page: 43 | totalHits: 7982 | hits on page: 40
2026-03-30 07:40:46 [auto1.de] INFO: Found listing with ID: JR52924
2026-03-30 07:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR52924%27 HTTP/1.1" 200 None
2026-03-30 07:40:46 [auto1.de] INFO: Scrape type for JR52924: 0
2026-03-30 07:40:46 [auto1.de] INFO: Found listing with ID: MU38011
2026-03-30 07:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU38011%27 HTTP/1.1" 200 None
2026-03-30 07:40:46 [auto1.de] INFO: Scrape type for MU38011: 0
2026-03-30 07:40:46 [auto1.de] INFO: Found listing with ID: GM39396
2026-03-30 07:40:46 [auto1.de] INFO: Found listing with ID: KM60144
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM60144%27 HTTP/1.1" 200 None
2026-03-30 07:40:47 [auto1.de] INFO: Scrape type for KM60144: 0
2026-03-30 07:40:47 [auto1.de] INFO: Found listing with ID: WJ57335
2026-03-30 07:40:47 [auto1.de] INFO: Found listing with ID: YU84960
2026-03-30 07:40:47 [auto1.de] INFO: Found listing with ID: KP76789
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP76789%27 HTTP/1.1" 200 None
2026-03-30 07:40:47 [auto1.de] INFO: Scrape type for KP76789: 0
2026-03-30 07:40:47 [auto1.de] INFO: Found listing with ID: KM84276
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM84276%27 HTTP/1.1" 200 None
2026-03-30 07:40:47 [auto1.de] INFO: Scrape type for KM84276: 2
2026-03-30 07:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91220869-0932-5dfc-97c3-f6b0fb8c17ca with identifier: KM84276
2026-03-30 07:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91220869-0932-5dfc-97c3-f6b0fb8c17ca with scrape type 2
2026-03-30 07:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91220869-0932-5dfc-97c3-f6b0fb8c17ca with scrape type 2
2026-03-30 07:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91220869-0932-5dfc-97c3-f6b0fb8c17ca, identifier: KM84276
2026-03-30 07:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91220869-0932-5dfc-97c3-f6b0fb8c17ca with identifier: KM84276
2026-03-30 07:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91220869-0932-5dfc-97c3-f6b0fb8c17ca with identifier: KM84276
2026-03-30 07:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91220869-0932-5dfc-97c3-f6b0fb8c17ca with identifier: KM84276 to the API
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:12:11Z',
 'fuel_type': 'diesel',
 'id': '91220869-0932-5dfc-97c3-f6b0fb8c17ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM84276',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 76412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM84276%27 HTTP/1.1" 200 None
2026-03-30 07:40:47 [auto1.de] INFO: Saving data for KM84276: {'auction_closing_time': 1774883531.0, 'created_time': 1773227654.686068, 'last_price_update_time': 1774856447.430878}
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM84276') HTTP/1.1" 204 0
2026-03-30 07:40:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:47 [auto1.de] INFO: Found listing with ID: JT65336
2026-03-30 07:40:47 [auto1.de] INFO: Found listing with ID: HK49782
2026-03-30 07:40:47 [auto1.de] INFO: Found listing with ID: UM76387
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76387%27 HTTP/1.1" 200 None
2026-03-30 07:40:47 [auto1.de] INFO: Scrape type for UM76387: 2
2026-03-30 07:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39993884-77f1-5ea7-8c9c-06743626dbd5 with identifier: UM76387
2026-03-30 07:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39993884-77f1-5ea7-8c9c-06743626dbd5 with scrape type 2
2026-03-30 07:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39993884-77f1-5ea7-8c9c-06743626dbd5 with scrape type 2
2026-03-30 07:40:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39993884-77f1-5ea7-8c9c-06743626dbd5, identifier: UM76387
2026-03-30 07:40:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39993884-77f1-5ea7-8c9c-06743626dbd5 with identifier: UM76387
2026-03-30 07:40:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39993884-77f1-5ea7-8c9c-06743626dbd5 with identifier: UM76387
2026-03-30 07:40:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39993884-77f1-5ea7-8c9c-06743626dbd5 with identifier: UM76387 to the API
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:29:38Z',
 'fuel_type': 'petrol',
 'id': '39993884-77f1-5ea7-8c9c-06743626dbd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM76387',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 111804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM76387%27 HTTP/1.1" 200 None
2026-03-30 07:40:47 [auto1.de] INFO: Saving data for UM76387: {'auction_closing_time': 1774884578.0, 'created_time': 1773225802.036576, 'last_price_update_time': 1774856447.9562}
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM76387') HTTP/1.1" 204 0
2026-03-30 07:40:47 [auto1.de] INFO: Found listing with ID: BR88683
2026-03-30 07:40:47 [auto1.de] INFO: Found listing with ID: PY66131
2026-03-30 07:40:47 [auto1.de] INFO: Found listing with ID: AL04579
2026-03-30 07:40:47 [auto1.de] INFO: Found listing with ID: WX96485
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX96485%27 HTTP/1.1" 200 None
2026-03-30 07:40:47 [auto1.de] INFO: Scrape type for WX96485: 2
2026-03-30 07:40:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4652bbe-be6c-5e09-8c91-6c7d7fc09f75 with identifier: WX96485
2026-03-30 07:40:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4652bbe-be6c-5e09-8c91-6c7d7fc09f75 with scrape type 2
2026-03-30 07:40:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4652bbe-be6c-5e09-8c91-6c7d7fc09f75 with scrape type 2
2026-03-30 07:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4652bbe-be6c-5e09-8c91-6c7d7fc09f75, identifier: WX96485
2026-03-30 07:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4652bbe-be6c-5e09-8c91-6c7d7fc09f75 with identifier: WX96485
2026-03-30 07:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4652bbe-be6c-5e09-8c91-6c7d7fc09f75 with identifier: WX96485
2026-03-30 07:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4652bbe-be6c-5e09-8c91-6c7d7fc09f75 with identifier: WX96485 to the API
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:27Z',
 'fuel_type': 'diesel',
 'id': 'b4652bbe-be6c-5e09-8c91-6c7d7fc09f75',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX96485',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 156065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Joy',
 'transmission': 'manual',
 'trim': 'Joy',
 'year': 2016}
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX96485%27 HTTP/1.1" 200 None
2026-03-30 07:40:48 [auto1.de] INFO: Saving data for WX96485: {'auction_closing_time': 1774884507.0, 'created_time': 1774378070.033371, 'last_price_update_time': 1774856448.376092}
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX96485') HTTP/1.1" 204 0
2026-03-30 07:40:48 [auto1.de] INFO: Found listing with ID: NH10753
2026-03-30 07:40:48 [auto1.de] INFO: Found listing with ID: CA14151
2026-03-30 07:40:48 [auto1.de] INFO: Found listing with ID: EF04397
2026-03-30 07:40:48 [auto1.de] INFO: Found listing with ID: BY37084
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY37084%27 HTTP/1.1" 200 None
2026-03-30 07:40:48 [auto1.de] INFO: Scrape type for BY37084: 2
2026-03-30 07:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c7e4f64-5f67-5844-b0b9-febe0688e47e with identifier: BY37084
2026-03-30 07:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c7e4f64-5f67-5844-b0b9-febe0688e47e with scrape type 2
2026-03-30 07:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c7e4f64-5f67-5844-b0b9-febe0688e47e with scrape type 2
2026-03-30 07:40:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c7e4f64-5f67-5844-b0b9-febe0688e47e, identifier: BY37084
2026-03-30 07:40:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c7e4f64-5f67-5844-b0b9-febe0688e47e with identifier: BY37084
2026-03-30 07:40:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c7e4f64-5f67-5844-b0b9-febe0688e47e with identifier: BY37084
2026-03-30 07:40:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c7e4f64-5f67-5844-b0b9-febe0688e47e with identifier: BY37084 to the API
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 86,
 'expiration_date': '2026-03-30T15:29:44Z',
 'fuel_type': 'petrol',
 'id': '4c7e4f64-5f67-5844-b0b9-febe0688e47e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY37084',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 188002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 MPI Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2011}
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY37084%27 HTTP/1.1" 200 None
2026-03-30 07:40:48 [auto1.de] INFO: Saving data for BY37084: {'auction_closing_time': 1774884584.0, 'created_time': 1773306598.592792, 'last_price_update_time': 1774856448.842404}
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY37084') HTTP/1.1" 204 0
2026-03-30 07:40:48 [auto1.de] INFO: Found listing with ID: PP86111
2026-03-30 07:40:48 [auto1.de] INFO: Found listing with ID: GC63965
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63965%27 HTTP/1.1" 200 None
2026-03-30 07:40:48 [auto1.de] INFO: Scrape type for GC63965: 2
2026-03-30 07:40:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5631e73e-7eef-55c8-8e8d-ef7a83771ed6 with identifier: GC63965
2026-03-30 07:40:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5631e73e-7eef-55c8-8e8d-ef7a83771ed6 with scrape type 2
2026-03-30 07:40:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5631e73e-7eef-55c8-8e8d-ef7a83771ed6 with scrape type 2
2026-03-30 07:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5631e73e-7eef-55c8-8e8d-ef7a83771ed6, identifier: GC63965
2026-03-30 07:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5631e73e-7eef-55c8-8e8d-ef7a83771ed6 with identifier: GC63965
2026-03-30 07:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5631e73e-7eef-55c8-8e8d-ef7a83771ed6 with identifier: GC63965
2026-03-30 07:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5631e73e-7eef-55c8-8e8d-ef7a83771ed6 with identifier: GC63965 to the API
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:34:47Z',
 'fuel_type': 'diesel',
 'id': '5631e73e-7eef-55c8-8e8d-ef7a83771ed6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC63965',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 106235,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-13',
 'seller_name': None,
 'title': 'BMW 5er 520d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2020}
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC63965%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Saving data for GC63965: {'auction_closing_time': 1774884887.0, 'created_time': 1774552226.884003, 'last_price_update_time': 1774856449.34327}
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GC63965') HTTP/1.1" 204 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: UA30528
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA30528%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for UA30528: 2
2026-03-30 07:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with identifier: UA30528
2026-03-30 07:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with scrape type 2
2026-03-30 07:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with scrape type 2
2026-03-30 07:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bfeebf2-5add-581b-951d-3d3ecbfef7e8, identifier: UA30528
2026-03-30 07:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with identifier: UA30528
2026-03-30 07:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with identifier: UA30528
2026-03-30 07:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bfeebf2-5add-581b-951d-3d3ecbfef7e8 with identifier: UA30528 to the API
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:28:52Z',
 'fuel_type': 'petrol',
 'id': '5bfeebf2-5add-581b-951d-3d3ecbfef7e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA30528',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 118104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-20',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2016}
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA30528%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Saving data for UA30528: {'auction_closing_time': 1774884532.0, 'created_time': 1773380952.640998, 'last_price_update_time': 1774856449.760585}
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA30528') HTTP/1.1" 204 0
2026-03-30 07:40:49 [auto1.de] INFO: Found listing with ID: AF40281
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF40281%27 HTTP/1.1" 200 None
2026-03-30 07:40:49 [auto1.de] INFO: Scrape type for AF40281: 2
2026-03-30 07:40:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3d6f801-868b-5700-9d4a-d581619bac6b with identifier: AF40281
2026-03-30 07:40:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3d6f801-868b-5700-9d4a-d581619bac6b with scrape type 2
2026-03-30 07:40:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3d6f801-868b-5700-9d4a-d581619bac6b with scrape type 2
2026-03-30 07:40:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3d6f801-868b-5700-9d4a-d581619bac6b, identifier: AF40281
2026-03-30 07:40:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3d6f801-868b-5700-9d4a-d581619bac6b with identifier: AF40281
2026-03-30 07:40:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3d6f801-868b-5700-9d4a-d581619bac6b with identifier: AF40281
2026-03-30 07:40:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3d6f801-868b-5700-9d4a-d581619bac6b with identifier: AF40281 to the API
2026-03-30 07:40:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:44:19Z',
 'fuel_type': 'petrol',
 'id': 'b3d6f801-868b-5700-9d4a-d581619bac6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF40281',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 179042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-23',
 'seller_name': None,
 'title': 'Mazda 6 2.5 Sports-Line',
 'transmission': 'automatic',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF40281%27 HTTP/1.1" 200 None
2026-03-30 07:40:50 [auto1.de] INFO: Saving data for AF40281: {'auction_closing_time': 1774885459.0, 'created_time': 1773306372.160319, 'last_price_update_time': 1774856450.198209}
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF40281') HTTP/1.1" 204 0
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: AU99703
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: UJ07162
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: YV92261
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV92261%27 HTTP/1.1" 200 None
2026-03-30 07:40:50 [auto1.de] INFO: Scrape type for YV92261: 2
2026-03-30 07:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4b79b65-7b20-54fe-bf27-cb2b370b066e with identifier: YV92261
2026-03-30 07:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4b79b65-7b20-54fe-bf27-cb2b370b066e with scrape type 2
2026-03-30 07:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4b79b65-7b20-54fe-bf27-cb2b370b066e with scrape type 2
2026-03-30 07:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4b79b65-7b20-54fe-bf27-cb2b370b066e, identifier: YV92261
2026-03-30 07:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4b79b65-7b20-54fe-bf27-cb2b370b066e with identifier: YV92261
2026-03-30 07:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4b79b65-7b20-54fe-bf27-cb2b370b066e with identifier: YV92261
2026-03-30 07:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4b79b65-7b20-54fe-bf27-cb2b370b066e with identifier: YV92261 to the API
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:50:20Z',
 'fuel_type': 'petrol',
 'id': 'd4b79b65-7b20-54fe-bf27-cb2b370b066e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV92261',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 202575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1990-10-07',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse CE 300',
 'transmission': 'automatic',
 'trim': '',
 'year': 1990}
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV92261%27 HTTP/1.1" 200 None
2026-03-30 07:40:50 [auto1.de] INFO: Saving data for YV92261: {'auction_closing_time': 1774885820.0, 'created_time': 1773831463.274614, 'last_price_update_time': 1774856450.613011}
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV92261') HTTP/1.1" 204 0
2026-03-30 07:40:50 [auto1.de] INFO: Found listing with ID: YG24433
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG24433%27 HTTP/1.1" 200 None
2026-03-30 07:40:50 [auto1.de] INFO: Scrape type for YG24433: 2
2026-03-30 07:40:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c92e9a2c-b932-598a-a49f-f3d7acb2879e with identifier: YG24433
2026-03-30 07:40:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c92e9a2c-b932-598a-a49f-f3d7acb2879e with scrape type 2
2026-03-30 07:40:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c92e9a2c-b932-598a-a49f-f3d7acb2879e with scrape type 2
2026-03-30 07:40:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c92e9a2c-b932-598a-a49f-f3d7acb2879e, identifier: YG24433
2026-03-30 07:40:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c92e9a2c-b932-598a-a49f-f3d7acb2879e with identifier: YG24433
2026-03-30 07:40:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c92e9a2c-b932-598a-a49f-f3d7acb2879e with identifier: YG24433
2026-03-30 07:40:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c92e9a2c-b932-598a-a49f-f3d7acb2879e with identifier: YG24433 to the API
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-30T15:47:25Z',
 'fuel_type': 'petrol',
 'id': 'c92e9a2c-b932-598a-a49f-f3d7acb2879e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG24433',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 5',
 'odometer': 77727,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-01',
 'seller_name': None,
 'title': 'Audi RS 5 2.9 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG24433%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Saving data for YG24433: {'auction_closing_time': 1774885645.0, 'created_time': 1774465801.301873, 'last_price_update_time': 1774856451.050913}
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YG24433') HTTP/1.1" 204 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: RK19274
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK19274%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for RK19274: 2
2026-03-30 07:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57b919c0-9b44-5a09-853a-4a11ccc063f5 with identifier: RK19274
2026-03-30 07:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57b919c0-9b44-5a09-853a-4a11ccc063f5 with scrape type 2
2026-03-30 07:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57b919c0-9b44-5a09-853a-4a11ccc063f5 with scrape type 2
2026-03-30 07:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57b919c0-9b44-5a09-853a-4a11ccc063f5, identifier: RK19274
2026-03-30 07:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57b919c0-9b44-5a09-853a-4a11ccc063f5 with identifier: RK19274
2026-03-30 07:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57b919c0-9b44-5a09-853a-4a11ccc063f5 with identifier: RK19274
2026-03-30 07:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57b919c0-9b44-5a09-853a-4a11ccc063f5 with identifier: RK19274 to the API
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-30T15:16:43Z',
 'fuel_type': 'petrol',
 'id': '57b919c0-9b44-5a09-853a-4a11ccc063f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK19274',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 115865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-15',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK19274%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Saving data for RK19274: {'auction_closing_time': 1774883803.0, 'created_time': 1773136724.122623, 'last_price_update_time': 1774856451.509931}
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK19274') HTTP/1.1" 204 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: XP45109
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP45109%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Scrape type for XP45109: 2
2026-03-30 07:40:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98af3230-510c-555e-adf8-fa5bb29cbf73 with identifier: XP45109
2026-03-30 07:40:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98af3230-510c-555e-adf8-fa5bb29cbf73 with scrape type 2
2026-03-30 07:40:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98af3230-510c-555e-adf8-fa5bb29cbf73 with scrape type 2
2026-03-30 07:40:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98af3230-510c-555e-adf8-fa5bb29cbf73, identifier: XP45109
2026-03-30 07:40:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98af3230-510c-555e-adf8-fa5bb29cbf73 with identifier: XP45109
2026-03-30 07:40:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98af3230-510c-555e-adf8-fa5bb29cbf73 with identifier: XP45109
2026-03-30 07:40:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98af3230-510c-555e-adf8-fa5bb29cbf73 with identifier: XP45109 to the API
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:35:13Z',
 'fuel_type': 'petrol',
 'id': '98af3230-510c-555e-adf8-fa5bb29cbf73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP45109',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 183542,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-23',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 Flexifuel Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP45109%27 HTTP/1.1" 200 None
2026-03-30 07:40:51 [auto1.de] INFO: Saving data for XP45109: {'auction_closing_time': 1774884913.0, 'created_time': 1773342154.519514, 'last_price_update_time': 1774856451.961458}
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP45109') HTTP/1.1" 204 0
2026-03-30 07:40:51 [auto1.de] INFO: Found listing with ID: UB06797
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB06797%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for UB06797: 2
2026-03-30 07:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1661eec3-6d5e-5782-a55a-968cb51fe4dc with identifier: UB06797
2026-03-30 07:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1661eec3-6d5e-5782-a55a-968cb51fe4dc with scrape type 2
2026-03-30 07:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1661eec3-6d5e-5782-a55a-968cb51fe4dc with scrape type 2
2026-03-30 07:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1661eec3-6d5e-5782-a55a-968cb51fe4dc, identifier: UB06797
2026-03-30 07:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1661eec3-6d5e-5782-a55a-968cb51fe4dc with identifier: UB06797
2026-03-30 07:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1661eec3-6d5e-5782-a55a-968cb51fe4dc with identifier: UB06797
2026-03-30 07:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1661eec3-6d5e-5782-a55a-968cb51fe4dc with identifier: UB06797 to the API
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:13Z',
 'fuel_type': 'petrol',
 'id': '1661eec3-6d5e-5782-a55a-968cb51fe4dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB06797',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 213957,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-17',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Joy',
 'transmission': 'automatic',
 'trim': 'Joy',
 'year': 2017}
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB06797%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Saving data for UB06797: {'auction_closing_time': 1774883653.0, 'created_time': 1772729224.539932, 'last_price_update_time': 1774856452.374813}
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB06797') HTTP/1.1" 204 0
2026-03-30 07:40:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: HL50945
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: BM44177
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM44177%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for BM44177: 2
2026-03-30 07:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf01d523-38f6-559e-bfdb-5181b2392c66 with identifier: BM44177
2026-03-30 07:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf01d523-38f6-559e-bfdb-5181b2392c66 with scrape type 2
2026-03-30 07:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf01d523-38f6-559e-bfdb-5181b2392c66 with scrape type 2
2026-03-30 07:40:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf01d523-38f6-559e-bfdb-5181b2392c66, identifier: BM44177
2026-03-30 07:40:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf01d523-38f6-559e-bfdb-5181b2392c66 with identifier: BM44177
2026-03-30 07:40:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf01d523-38f6-559e-bfdb-5181b2392c66 with identifier: BM44177
2026-03-30 07:40:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf01d523-38f6-559e-bfdb-5181b2392c66 with identifier: BM44177 to the API
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:19:49Z',
 'fuel_type': 'diesel',
 'id': 'bf01d523-38f6-559e-bfdb-5181b2392c66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM44177',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 165202,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-28',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 317 CDI Kasten L2',
 'transmission': 'manual',
 'trim': 'Kasten L2',
 'year': 2022}
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM44177%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Saving data for BM44177: {'auction_closing_time': 1774883989.0, 'created_time': 1773302842.094708, 'last_price_update_time': 1774856452.889255}
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM44177') HTTP/1.1" 204 0
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-30 07:40:52 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK88220%27 HTTP/1.1" 200 None
2026-03-30 07:40:52 [auto1.de] INFO: Scrape type for AK88220: 2
2026-03-30 07:40:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85f3b2d3-0491-58de-8375-41a41f281d4d with identifier: AK88220
2026-03-30 07:40:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85f3b2d3-0491-58de-8375-41a41f281d4d with scrape type 2
2026-03-30 07:40:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85f3b2d3-0491-58de-8375-41a41f281d4d with scrape type 2
2026-03-30 07:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85f3b2d3-0491-58de-8375-41a41f281d4d, identifier: AK88220
2026-03-30 07:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85f3b2d3-0491-58de-8375-41a41f281d4d with identifier: AK88220
2026-03-30 07:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85f3b2d3-0491-58de-8375-41a41f281d4d with identifier: AK88220
2026-03-30 07:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85f3b2d3-0491-58de-8375-41a41f281d4d with identifier: AK88220 to the API
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:10:22Z',
 'fuel_type': 'diesel',
 'id': '85f3b2d3-0491-58de-8375-41a41f281d4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK88220',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 50729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-19',
 'seller_name': None,
 'title': 'Jaguar E-Pace D240 R-Dynamic SE AWD',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE AWD',
 'year': 2020}
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK88220%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Saving data for AK88220: {'auction_closing_time': 1774883422.0, 'created_time': 1774465901.977631, 'last_price_update_time': 1774856453.454437}
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK88220') HTTP/1.1" 204 0
2026-03-30 07:40:53 [auto1.de] INFO: Channel: 24h | Page: 44 | totalHits: 7990 | hits on page: 40
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: DN40523
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP49415%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Scrape type for UP49415: 0
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: XW83383
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW83383%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Scrape type for XW83383: 2
2026-03-30 07:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd93fa7a-8497-5e79-a5db-98e60dfcb3ec with identifier: XW83383
2026-03-30 07:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd93fa7a-8497-5e79-a5db-98e60dfcb3ec with scrape type 2
2026-03-30 07:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd93fa7a-8497-5e79-a5db-98e60dfcb3ec with scrape type 2
2026-03-30 07:40:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd93fa7a-8497-5e79-a5db-98e60dfcb3ec, identifier: XW83383
2026-03-30 07:40:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd93fa7a-8497-5e79-a5db-98e60dfcb3ec with identifier: XW83383
2026-03-30 07:40:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd93fa7a-8497-5e79-a5db-98e60dfcb3ec with identifier: XW83383
2026-03-30 07:40:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd93fa7a-8497-5e79-a5db-98e60dfcb3ec with identifier: XW83383 to the API
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:21:01Z',
 'fuel_type': 'diesel',
 'id': 'fd93fa7a-8497-5e79-a5db-98e60dfcb3ec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW83383',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 105593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-04',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2019}
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW83383%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Saving data for XW83383: {'auction_closing_time': 1774884061.0, 'created_time': 1773226401.941777, 'last_price_update_time': 1774856453.892548}
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW83383') HTTP/1.1" 204 0
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: JE28257
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: TK71200
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: AK88220
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK88220%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Scrape type for AK88220: 0
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: EZ46252
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: XJ45397
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: DN40523
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: UP49415
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP49415%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Scrape type for UP49415: 0
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: XW83383
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW83383%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Scrape type for XW83383: 0
2026-03-30 07:40:53 [auto1.de] INFO: Found listing with ID: TZ55203
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ55203%27 HTTP/1.1" 200 None
2026-03-30 07:40:53 [auto1.de] INFO: Scrape type for TZ55203: 2
2026-03-30 07:40:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2628cd5c-b6d7-55ec-9283-666636448b24 with identifier: TZ55203
2026-03-30 07:40:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2628cd5c-b6d7-55ec-9283-666636448b24 with scrape type 2
2026-03-30 07:40:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2628cd5c-b6d7-55ec-9283-666636448b24 with scrape type 2
2026-03-30 07:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2628cd5c-b6d7-55ec-9283-666636448b24, identifier: TZ55203
2026-03-30 07:40:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2628cd5c-b6d7-55ec-9283-666636448b24 with identifier: TZ55203
2026-03-30 07:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2628cd5c-b6d7-55ec-9283-666636448b24 with identifier: TZ55203
2026-03-30 07:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2628cd5c-b6d7-55ec-9283-666636448b24 with identifier: TZ55203 to the API
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:35:54Z',
 'fuel_type': 'diesel',
 'id': '2628cd5c-b6d7-55ec-9283-666636448b24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ55203',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 150897,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang BlueTEC Avantgarde Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueTEC Avantgarde Edition',
 'year': 2016}
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ55203%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Saving data for TZ55203: {'auction_closing_time': 1774884954.0, 'created_time': 1773136221.012935, 'last_price_update_time': 1774856454.391883}
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ55203') HTTP/1.1" 204 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: NR32079
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: DN59974
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN59974%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for DN59974: 2
2026-03-30 07:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e804bb8-c842-5629-af2e-7ee06ab5a148 with identifier: DN59974
2026-03-30 07:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e804bb8-c842-5629-af2e-7ee06ab5a148 with scrape type 2
2026-03-30 07:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e804bb8-c842-5629-af2e-7ee06ab5a148 with scrape type 2
2026-03-30 07:40:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e804bb8-c842-5629-af2e-7ee06ab5a148, identifier: DN59974
2026-03-30 07:40:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e804bb8-c842-5629-af2e-7ee06ab5a148 with identifier: DN59974
2026-03-30 07:40:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e804bb8-c842-5629-af2e-7ee06ab5a148 with identifier: DN59974
2026-03-30 07:40:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e804bb8-c842-5629-af2e-7ee06ab5a148 with identifier: DN59974 to the API
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:38:19Z',
 'fuel_type': 'diesel',
 'id': '0e804bb8-c842-5629-af2e-7ee06ab5a148',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN59974',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 152810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-01',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2016}
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN59974%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Saving data for DN59974: {'auction_closing_time': 1774885099.0, 'created_time': 1774465908.911417, 'last_price_update_time': 1774856454.911654}
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN59974') HTTP/1.1" 204 0
2026-03-30 07:40:54 [auto1.de] INFO: Found listing with ID: TH47484
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH47484%27 HTTP/1.1" 200 None
2026-03-30 07:40:54 [auto1.de] INFO: Scrape type for TH47484: 2
2026-03-30 07:40:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a1f6562-3d7e-515d-95ed-13168499629e with identifier: TH47484
2026-03-30 07:40:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a1f6562-3d7e-515d-95ed-13168499629e with scrape type 2
2026-03-30 07:40:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a1f6562-3d7e-515d-95ed-13168499629e with scrape type 2
2026-03-30 07:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5a1f6562-3d7e-515d-95ed-13168499629e, identifier: TH47484
2026-03-30 07:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5a1f6562-3d7e-515d-95ed-13168499629e with identifier: TH47484
2026-03-30 07:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5a1f6562-3d7e-515d-95ed-13168499629e with identifier: TH47484
2026-03-30 07:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5a1f6562-3d7e-515d-95ed-13168499629e with identifier: TH47484 to the API
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:42Z',
 'fuel_type': 'petrol',
 'id': '5a1f6562-3d7e-515d-95ed-13168499629e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH47484',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 45820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-16',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2024}
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH47484%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Saving data for TH47484: {'auction_closing_time': 1774883802.0, 'created_time': 1774769751.634868, 'last_price_update_time': 1774856455.564864}
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH47484') HTTP/1.1" 204 0
2026-03-30 07:40:55 [auto1.de] INFO: Found listing with ID: ST09245
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST09245%27 HTTP/1.1" 200 None
2026-03-30 07:40:55 [auto1.de] INFO: Scrape type for ST09245: 2
2026-03-30 07:40:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4f76a29-07fd-5ca9-987c-72aa81ee00d8 with identifier: ST09245
2026-03-30 07:40:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4f76a29-07fd-5ca9-987c-72aa81ee00d8 with scrape type 2
2026-03-30 07:40:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4f76a29-07fd-5ca9-987c-72aa81ee00d8 with scrape type 2
2026-03-30 07:40:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4f76a29-07fd-5ca9-987c-72aa81ee00d8, identifier: ST09245
2026-03-30 07:40:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4f76a29-07fd-5ca9-987c-72aa81ee00d8 with identifier: ST09245
2026-03-30 07:40:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4f76a29-07fd-5ca9-987c-72aa81ee00d8 with identifier: ST09245
2026-03-30 07:40:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4f76a29-07fd-5ca9-987c-72aa81ee00d8 with identifier: ST09245 to the API
2026-03-30 07:40:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:53:43Z',
 'fuel_type': 'diesel',
 'id': 'f4f76a29-07fd-5ca9-987c-72aa81ee00d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST09245',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 157405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI 70 Jahre Bulli',
 'transmission': 'automatic',
 'trim': '70 Jahre Bulli',
 'year': 2017}
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST09245%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Saving data for ST09245: {'auction_closing_time': 1774886023.0, 'created_time': 1773229363.628444, 'last_price_update_time': 1774856456.348321}
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST09245') HTTP/1.1" 204 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: TM91896
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM91896%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for TM91896: 2
2026-03-30 07:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a8b11b-8894-5750-a8e2-0f65185251af with identifier: TM91896
2026-03-30 07:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a8b11b-8894-5750-a8e2-0f65185251af with scrape type 2
2026-03-30 07:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0a8b11b-8894-5750-a8e2-0f65185251af with scrape type 2
2026-03-30 07:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0a8b11b-8894-5750-a8e2-0f65185251af, identifier: TM91896
2026-03-30 07:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0a8b11b-8894-5750-a8e2-0f65185251af with identifier: TM91896
2026-03-30 07:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0a8b11b-8894-5750-a8e2-0f65185251af with identifier: TM91896
2026-03-30 07:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0a8b11b-8894-5750-a8e2-0f65185251af with identifier: TM91896 to the API
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 470,
 'expiration_date': '2026-03-30T15:38:25Z',
 'fuel_type': 'petrol',
 'id': 'a0a8b11b-8894-5750-a8e2-0f65185251af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM91896',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 125968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-08',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 560',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM91896%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Saving data for TM91896: {'auction_closing_time': 1774885105.0, 'created_time': 1773380936.283147, 'last_price_update_time': 1774856456.770229}
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TM91896') HTTP/1.1" 204 0
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: GZ01520
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: PD79431
2026-03-30 07:40:56 [auto1.de] INFO: Found listing with ID: TK97766
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97766%27 HTTP/1.1" 200 None
2026-03-30 07:40:56 [auto1.de] INFO: Scrape type for TK97766: 2
2026-03-30 07:40:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e874732-9a38-515c-ab9c-44b30817d6fb with identifier: TK97766
2026-03-30 07:40:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e874732-9a38-515c-ab9c-44b30817d6fb with scrape type 2
2026-03-30 07:40:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e874732-9a38-515c-ab9c-44b30817d6fb with scrape type 2
2026-03-30 07:40:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e874732-9a38-515c-ab9c-44b30817d6fb, identifier: TK97766
2026-03-30 07:40:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e874732-9a38-515c-ab9c-44b30817d6fb with identifier: TK97766
2026-03-30 07:40:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e874732-9a38-515c-ab9c-44b30817d6fb with identifier: TK97766
2026-03-30 07:40:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e874732-9a38-515c-ab9c-44b30817d6fb with identifier: TK97766 to the API
2026-03-30 07:40:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:05:52Z',
 'fuel_type': 'petrol',
 'id': '4e874732-9a38-515c-ab9c-44b30817d6fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK97766',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 65899,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-18',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2019}
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97766%27 HTTP/1.1" 200 None
2026-03-30 07:40:57 [auto1.de] INFO: Saving data for TK97766: {'auction_closing_time': 1774883152.0, 'created_time': 1773138870.341604, 'last_price_update_time': 1774856457.190775}
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TK97766') HTTP/1.1" 204 0
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: RS30445
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: VN22748
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: BK28670
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: TB02108
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: AK90767
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: YC23372
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: GB27698
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: LN26385
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN26385%27 HTTP/1.1" 200 None
2026-03-30 07:40:57 [auto1.de] INFO: Scrape type for LN26385: 2
2026-03-30 07:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0392d03b-208c-5ef2-ac0d-78c8ae66361d with identifier: LN26385
2026-03-30 07:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0392d03b-208c-5ef2-ac0d-78c8ae66361d with scrape type 2
2026-03-30 07:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0392d03b-208c-5ef2-ac0d-78c8ae66361d with scrape type 2
2026-03-30 07:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0392d03b-208c-5ef2-ac0d-78c8ae66361d, identifier: LN26385
2026-03-30 07:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0392d03b-208c-5ef2-ac0d-78c8ae66361d with identifier: LN26385
2026-03-30 07:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0392d03b-208c-5ef2-ac0d-78c8ae66361d with identifier: LN26385
2026-03-30 07:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0392d03b-208c-5ef2-ac0d-78c8ae66361d with identifier: LN26385 to the API
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:58:14Z',
 'fuel_type': 'petrol',
 'id': '0392d03b-208c-5ef2-ac0d-78c8ae66361d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN26385',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 127777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Skoda Yeti 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN26385%27 HTTP/1.1" 200 None
2026-03-30 07:40:57 [auto1.de] INFO: Saving data for LN26385: {'auction_closing_time': 1774886294.0, 'created_time': 1772727927.185611, 'last_price_update_time': 1774856457.599585}
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN26385') HTTP/1.1" 204 0
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: WA11944
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: VA77092
2026-03-30 07:40:57 [auto1.de] INFO: Found listing with ID: SR72775
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR72775%27 HTTP/1.1" 200 None
2026-03-30 07:40:57 [auto1.de] INFO: Scrape type for SR72775: 2
2026-03-30 07:40:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 003e8932-0c0f-5afc-9b26-bb3d304854b4 with identifier: SR72775
2026-03-30 07:40:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 003e8932-0c0f-5afc-9b26-bb3d304854b4 with scrape type 2
2026-03-30 07:40:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 003e8932-0c0f-5afc-9b26-bb3d304854b4 with scrape type 2
2026-03-30 07:40:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 003e8932-0c0f-5afc-9b26-bb3d304854b4, identifier: SR72775
2026-03-30 07:40:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 003e8932-0c0f-5afc-9b26-bb3d304854b4 with identifier: SR72775
2026-03-30 07:40:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 003e8932-0c0f-5afc-9b26-bb3d304854b4 with identifier: SR72775
2026-03-30 07:40:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 003e8932-0c0f-5afc-9b26-bb3d304854b4 with identifier: SR72775 to the API
2026-03-30 07:40:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:10:24Z',
 'fuel_type': 'diesel',
 'id': '003e8932-0c0f-5afc-9b26-bb3d304854b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SR72775',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 228715,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Track & Style 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Track & Style 4Motion BlueMotion Tech',
 'year': 2015}
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR72775%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Saving data for SR72775: {'auction_closing_time': 1774883424.0, 'created_time': 1772728483.99568, 'last_price_update_time': 1774856458.253197}
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SR72775') HTTP/1.1" 204 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: JZ29670
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ29670%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for JZ29670: 2
2026-03-30 07:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with identifier: JZ29670
2026-03-30 07:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with scrape type 2
2026-03-30 07:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with scrape type 2
2026-03-30 07:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0, identifier: JZ29670
2026-03-30 07:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with identifier: JZ29670
2026-03-30 07:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with identifier: JZ29670
2026-03-30 07:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0 with identifier: JZ29670 to the API
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:27:10Z',
 'fuel_type': 'diesel',
 'id': '871f16ee-8e4d-5a5b-a4dc-ba63d80a16d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ29670',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 393697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-15',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2012}
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ29670%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Saving data for JZ29670: {'auction_closing_time': 1774884430.0, 'created_time': 1773228937.512191, 'last_price_update_time': 1774856458.690331}
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ29670') HTTP/1.1" 204 0
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-30 07:40:58 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ23138%27 HTTP/1.1" 200 None
2026-03-30 07:40:58 [auto1.de] INFO: Scrape type for LJ23138: 2
2026-03-30 07:40:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5451d6af-6410-5c81-b5fa-0ae2bf12ece7 with identifier: LJ23138
2026-03-30 07:40:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5451d6af-6410-5c81-b5fa-0ae2bf12ece7 with scrape type 2
2026-03-30 07:40:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5451d6af-6410-5c81-b5fa-0ae2bf12ece7 with scrape type 2
2026-03-30 07:40:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5451d6af-6410-5c81-b5fa-0ae2bf12ece7, identifier: LJ23138
2026-03-30 07:40:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5451d6af-6410-5c81-b5fa-0ae2bf12ece7 with identifier: LJ23138
2026-03-30 07:40:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5451d6af-6410-5c81-b5fa-0ae2bf12ece7 with identifier: LJ23138
2026-03-30 07:40:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5451d6af-6410-5c81-b5fa-0ae2bf12ece7 with identifier: LJ23138 to the API
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:13:14Z',
 'fuel_type': 'diesel',
 'id': '5451d6af-6410-5c81-b5fa-0ae2bf12ece7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LJ23138',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 70737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-16',
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2020}
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ23138%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Saving data for LJ23138: {'auction_closing_time': 1774883594.0, 'created_time': 1773138110.282421, 'last_price_update_time': 1774856459.105149}
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LJ23138') HTTP/1.1" 204 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ47534%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for VZ47534: 2
2026-03-30 07:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20656b3a-b6f0-5048-927e-47f70916c1c6 with identifier: VZ47534
2026-03-30 07:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20656b3a-b6f0-5048-927e-47f70916c1c6 with scrape type 2
2026-03-30 07:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20656b3a-b6f0-5048-927e-47f70916c1c6 with scrape type 2
2026-03-30 07:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 20656b3a-b6f0-5048-927e-47f70916c1c6, identifier: VZ47534
2026-03-30 07:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 20656b3a-b6f0-5048-927e-47f70916c1c6 with identifier: VZ47534
2026-03-30 07:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 20656b3a-b6f0-5048-927e-47f70916c1c6 with identifier: VZ47534
2026-03-30 07:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 20656b3a-b6f0-5048-927e-47f70916c1c6 with identifier: VZ47534 to the API
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:01:33Z',
 'fuel_type': 'petrol',
 'id': '20656b3a-b6f0-5048-927e-47f70916c1c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ47534',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 47161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-21',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200',
 'transmission': 'manual',
 'trim': '',
 'year': 2019}
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ47534%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Saving data for VZ47534: {'auction_closing_time': 1774882893.0, 'created_time': 1772729073.117724, 'last_price_update_time': 1774856459.524142}
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VZ47534') HTTP/1.1" 204 0
2026-03-30 07:40:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY14352%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Scrape type for HY14352: 2
2026-03-30 07:40:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with identifier: HY14352
2026-03-30 07:40:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with scrape type 2
2026-03-30 07:40:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with scrape type 2
2026-03-30 07:40:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef9d3f12-6f4a-53ac-8191-9ce12fc77467, identifier: HY14352
2026-03-30 07:40:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with identifier: HY14352
2026-03-30 07:40:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with identifier: HY14352
2026-03-30 07:40:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef9d3f12-6f4a-53ac-8191-9ce12fc77467 with identifier: HY14352 to the API
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:40:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:39:02Z',
 'fuel_type': 'diesel',
 'id': 'ef9d3f12-6f4a-53ac-8191-9ce12fc77467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY14352',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 104142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-10',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 250 d lang Edition Score',
 'transmission': 'automatic',
 'trim': 'lang Edition Score',
 'year': 2017}
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY14352%27 HTTP/1.1" 200 None
2026-03-30 07:40:59 [auto1.de] INFO: Saving data for HY14352: {'auction_closing_time': 1774885142.0, 'created_time': 1773132761.432819, 'last_price_update_time': 1774856459.963228}
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY14352') HTTP/1.1" 204 0
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: XM73112
2026-03-30 07:40:59 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-30 07:40:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD41613%27 HTTP/1.1" 200 None
2026-03-30 07:41:00 [auto1.de] INFO: Scrape type for JD41613: 2
2026-03-30 07:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with identifier: JD41613
2026-03-30 07:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with scrape type 2
2026-03-30 07:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with scrape type 2
2026-03-30 07:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9cc71a9c-6856-5754-93e6-86a2b49f5c49, identifier: JD41613
2026-03-30 07:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with identifier: JD41613
2026-03-30 07:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with identifier: JD41613
2026-03-30 07:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9cc71a9c-6856-5754-93e6-86a2b49f5c49 with identifier: JD41613 to the API
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:09:49Z',
 'fuel_type': 'diesel',
 'id': '9cc71a9c-6856-5754-93e6-86a2b49f5c49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD41613',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 233894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD41613%27 HTTP/1.1" 200 None
2026-03-30 07:41:00 [auto1.de] INFO: Saving data for JD41613: {'auction_closing_time': 1774883389.0, 'created_time': 1773228716.847241, 'last_price_update_time': 1774856460.404991}
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JD41613') HTTP/1.1" 204 0
2026-03-30 07:41:00 [auto1.de] INFO: Channel: 24h | Page: 45 | totalHits: 8001 | hits on page: 40
2026-03-30 07:41:00 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA70059%27 HTTP/1.1" 200 None
2026-03-30 07:41:00 [auto1.de] INFO: Scrape type for EA70059: 2
2026-03-30 07:41:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fce15dd-f3ba-5bce-a0f1-bb34da8656a0 with identifier: EA70059
2026-03-30 07:41:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fce15dd-f3ba-5bce-a0f1-bb34da8656a0 with scrape type 2
2026-03-30 07:41:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fce15dd-f3ba-5bce-a0f1-bb34da8656a0 with scrape type 2
2026-03-30 07:41:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fce15dd-f3ba-5bce-a0f1-bb34da8656a0, identifier: EA70059
2026-03-30 07:41:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fce15dd-f3ba-5bce-a0f1-bb34da8656a0 with identifier: EA70059
2026-03-30 07:41:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fce15dd-f3ba-5bce-a0f1-bb34da8656a0 with identifier: EA70059
2026-03-30 07:41:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fce15dd-f3ba-5bce-a0f1-bb34da8656a0 with identifier: EA70059 to the API
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:43:35Z',
 'fuel_type': 'diesel',
 'id': '1fce15dd-f3ba-5bce-a0f1-bb34da8656a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA70059',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 275722,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-02-25',
 'seller_name': None,
 'title': 'BMW 3er 320d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA70059%27 HTTP/1.1" 200 None
2026-03-30 07:41:00 [auto1.de] INFO: Saving data for EA70059: {'auction_closing_time': 1774885415.0, 'created_time': 1772541756.585261, 'last_price_update_time': 1774856460.903153}
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA70059') HTTP/1.1" 204 0
2026-03-30 07:41:00 [auto1.de] INFO: Found listing with ID: LW90225
2026-03-30 07:41:00 [auto1.de] INFO: Found listing with ID: LJ23138
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ23138%27 HTTP/1.1" 200 None
2026-03-30 07:41:00 [auto1.de] INFO: Scrape type for LJ23138: 0
2026-03-30 07:41:00 [auto1.de] INFO: Found listing with ID: ZA27483
2026-03-30 07:41:00 [auto1.de] INFO: Found listing with ID: VZ47534
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ47534%27 HTTP/1.1" 200 None
2026-03-30 07:41:00 [auto1.de] INFO: Scrape type for VZ47534: 0
2026-03-30 07:41:00 [auto1.de] INFO: Found listing with ID: HY14352
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY14352%27 HTTP/1.1" 200 None
2026-03-30 07:41:00 [auto1.de] INFO: Scrape type for HY14352: 0
2026-03-30 07:41:00 [auto1.de] INFO: Found listing with ID: XM73112
2026-03-30 07:41:00 [auto1.de] INFO: Found listing with ID: JD41613
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD41613%27 HTTP/1.1" 200 None
2026-03-30 07:41:00 [auto1.de] INFO: Scrape type for JD41613: 0
2026-03-30 07:41:00 [auto1.de] INFO: Found listing with ID: EA70059
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA70059%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for EA70059: 0
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY06306%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for VY06306: 2
2026-03-30 07:41:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0 with identifier: VY06306
2026-03-30 07:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0 with scrape type 2
2026-03-30 07:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0 with scrape type 2
2026-03-30 07:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0, identifier: VY06306
2026-03-30 07:41:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:01 [auto1.de] INFO: Found listing with ID: VY06306
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY06306%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Scrape type for VY06306: 2
2026-03-30 07:41:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0 with scrape type 2
2026-03-30 07:41:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0 with scrape type 2
2026-03-30 07:41:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0, identifier: VY06306
2026-03-30 07:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0 with identifier: VY06306
2026-03-30 07:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0 with identifier: VY06306
2026-03-30 07:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0 with identifier: VY06306 to the API
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:59Z',
 'fuel_type': 'diesel',
 'id': '9c9c2e28-092f-5a4a-bbff-58d2d696f0f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY06306',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 296289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-11',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY06306%27 HTTP/1.1" 200 None
2026-03-30 07:41:01 [auto1.de] INFO: Saving data for VY06306: {'auction_closing_time': 1774884359.0, 'created_time': 1773831130.382523, 'last_price_update_time': 1774856461.604833}
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY06306') HTTP/1.1" 204 0
2026-03-30 07:41:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0 with identifier: VY06306
2026-03-30 07:41:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0 with identifier: VY06306
2026-03-30 07:41:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c9c2e28-092f-5a4a-bbff-58d2d696f0f0 with identifier: VY06306 to the API
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:25:59Z',
 'fuel_type': 'diesel',
 'id': '9c9c2e28-092f-5a4a-bbff-58d2d696f0f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY06306',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 296289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-11',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY06306%27 HTTP/1.1" 200 None
2026-03-30 07:41:02 [auto1.de] INFO: Saving data for VY06306: {'auction_closing_time': 1774884359.0, 'created_time': 1773831130.382523, 'last_price_update_time': 1774856462.109665}
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY06306') HTTP/1.1" 204 0
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: RW76455
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: VL48750
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: RC29911
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: CZ70893
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ70893%27 HTTP/1.1" 200 None
2026-03-30 07:41:02 [auto1.de] INFO: Scrape type for CZ70893: 2
2026-03-30 07:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67dd33f6-0171-5641-b2e7-7cfb8a39737d with identifier: CZ70893
2026-03-30 07:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67dd33f6-0171-5641-b2e7-7cfb8a39737d with scrape type 2
2026-03-30 07:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67dd33f6-0171-5641-b2e7-7cfb8a39737d with scrape type 2
2026-03-30 07:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67dd33f6-0171-5641-b2e7-7cfb8a39737d, identifier: CZ70893
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: HS83117
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: RP66782
2026-03-30 07:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67dd33f6-0171-5641-b2e7-7cfb8a39737d with identifier: CZ70893
2026-03-30 07:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67dd33f6-0171-5641-b2e7-7cfb8a39737d with identifier: CZ70893
2026-03-30 07:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67dd33f6-0171-5641-b2e7-7cfb8a39737d with identifier: CZ70893 to the API
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 347,
 'expiration_date': '2026-03-30T15:10:19Z',
 'fuel_type': 'diesel',
 'id': '67dd33f6-0171-5641-b2e7-7cfb8a39737d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CZ70893',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 42456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ70893%27 HTTP/1.1" 200 None
2026-03-30 07:41:02 [auto1.de] INFO: Saving data for CZ70893: {'auction_closing_time': 1774883419.0, 'created_time': 1773136166.372091, 'last_price_update_time': 1774856462.605805}
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CZ70893') HTTP/1.1" 204 0
2026-03-30 07:41:02 [auto1.de] INFO: Found listing with ID: HC32133
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC32133%27 HTTP/1.1" 200 None
2026-03-30 07:41:02 [auto1.de] INFO: Scrape type for HC32133: 2
2026-03-30 07:41:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c8e9527-c2e0-59db-8fcd-1d77d49f3ecb with identifier: HC32133
2026-03-30 07:41:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c8e9527-c2e0-59db-8fcd-1d77d49f3ecb with scrape type 2
2026-03-30 07:41:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c8e9527-c2e0-59db-8fcd-1d77d49f3ecb with scrape type 2
2026-03-30 07:41:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c8e9527-c2e0-59db-8fcd-1d77d49f3ecb, identifier: HC32133
2026-03-30 07:41:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c8e9527-c2e0-59db-8fcd-1d77d49f3ecb with identifier: HC32133
2026-03-30 07:41:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c8e9527-c2e0-59db-8fcd-1d77d49f3ecb with identifier: HC32133
2026-03-30 07:41:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c8e9527-c2e0-59db-8fcd-1d77d49f3ecb with identifier: HC32133 to the API
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:30Z',
 'fuel_type': 'petrol',
 'id': '1c8e9527-c2e0-59db-8fcd-1d77d49f3ecb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC32133',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 123817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-19',
 'seller_name': None,
 'title': 'Audi Q2 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC32133%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Saving data for HC32133: {'auction_closing_time': 1774886370.0, 'created_time': 1774637378.775621, 'last_price_update_time': 1774856463.058975}
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC32133') HTTP/1.1" 204 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: WC25701
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: RS41901
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: CW57830
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: YC02535
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: XB95476
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB95476%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for XB95476: 2
2026-03-30 07:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8198dcf6-0dc6-5b26-9ce4-11c59566e69a with identifier: XB95476
2026-03-30 07:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8198dcf6-0dc6-5b26-9ce4-11c59566e69a with scrape type 2
2026-03-30 07:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8198dcf6-0dc6-5b26-9ce4-11c59566e69a with scrape type 2
2026-03-30 07:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8198dcf6-0dc6-5b26-9ce4-11c59566e69a, identifier: XB95476
2026-03-30 07:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8198dcf6-0dc6-5b26-9ce4-11c59566e69a with identifier: XB95476
2026-03-30 07:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8198dcf6-0dc6-5b26-9ce4-11c59566e69a with identifier: XB95476
2026-03-30 07:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8198dcf6-0dc6-5b26-9ce4-11c59566e69a with identifier: XB95476 to the API
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:21:55Z',
 'fuel_type': 'diesel',
 'id': '8198dcf6-0dc6-5b26-9ce4-11c59566e69a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB95476',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 167814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-22',
 'seller_name': None,
 'title': 'Audi Q7 50 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB95476%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Saving data for XB95476: {'auction_closing_time': 1774884115.0, 'created_time': 1773132582.9049, 'last_price_update_time': 1774856463.518531}
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB95476') HTTP/1.1" 204 0
2026-03-30 07:41:03 [auto1.de] INFO: Found listing with ID: HK91051
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK91051%27 HTTP/1.1" 200 None
2026-03-30 07:41:03 [auto1.de] INFO: Scrape type for HK91051: 2
2026-03-30 07:41:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 102e6efd-15fb-5577-8b03-0199dc7904eb with identifier: HK91051
2026-03-30 07:41:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 102e6efd-15fb-5577-8b03-0199dc7904eb with scrape type 2
2026-03-30 07:41:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 102e6efd-15fb-5577-8b03-0199dc7904eb with scrape type 2
2026-03-30 07:41:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 102e6efd-15fb-5577-8b03-0199dc7904eb, identifier: HK91051
2026-03-30 07:41:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 102e6efd-15fb-5577-8b03-0199dc7904eb with identifier: HK91051
2026-03-30 07:41:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 102e6efd-15fb-5577-8b03-0199dc7904eb with identifier: HK91051
2026-03-30 07:41:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 102e6efd-15fb-5577-8b03-0199dc7904eb with identifier: HK91051 to the API
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:12:50Z',
 'fuel_type': 'petrol',
 'id': '102e6efd-15fb-5577-8b03-0199dc7904eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK91051',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 54734,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-21',
 'seller_name': None,
 'title': 'Cupra Leon 2.0 TSI VZ 4Drive',
 'transmission': 'automatic',
 'trim': 'VZ 4Drive',
 'year': 2022}
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK91051%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Saving data for HK91051: {'auction_closing_time': 1774883570.0, 'created_time': 1773226054.960228, 'last_price_update_time': 1774856464.096132}
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK91051') HTTP/1.1" 204 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: TW01944
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: RN71628
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN71628%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for RN71628: 2
2026-03-30 07:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc2b1632-5510-5477-8af7-f332cb4ea798 with identifier: RN71628
2026-03-30 07:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc2b1632-5510-5477-8af7-f332cb4ea798 with scrape type 2
2026-03-30 07:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc2b1632-5510-5477-8af7-f332cb4ea798 with scrape type 2
2026-03-30 07:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc2b1632-5510-5477-8af7-f332cb4ea798, identifier: RN71628
2026-03-30 07:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc2b1632-5510-5477-8af7-f332cb4ea798 with identifier: RN71628
2026-03-30 07:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc2b1632-5510-5477-8af7-f332cb4ea798 with identifier: RN71628
2026-03-30 07:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc2b1632-5510-5477-8af7-f332cb4ea798 with identifier: RN71628 to the API
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:26:20Z',
 'fuel_type': 'diesel',
 'id': 'dc2b1632-5510-5477-8af7-f332cb4ea798',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN71628',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 182370,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-19',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium S',
 'transmission': 'automatic',
 'trim': 'Titanium S',
 'year': 2014}
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN71628%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Saving data for RN71628: {'auction_closing_time': 1774884380.0, 'created_time': 1773831319.482661, 'last_price_update_time': 1774856464.632935}
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN71628') HTTP/1.1" 204 0
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: HT70874
2026-03-30 07:41:04 [auto1.de] INFO: Found listing with ID: UV60068
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV60068%27 HTTP/1.1" 200 None
2026-03-30 07:41:04 [auto1.de] INFO: Scrape type for UV60068: 2
2026-03-30 07:41:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42ca0116-b85c-5423-9000-236cf05d2bcb with identifier: UV60068
2026-03-30 07:41:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42ca0116-b85c-5423-9000-236cf05d2bcb with scrape type 2
2026-03-30 07:41:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42ca0116-b85c-5423-9000-236cf05d2bcb with scrape type 2
2026-03-30 07:41:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42ca0116-b85c-5423-9000-236cf05d2bcb, identifier: UV60068
2026-03-30 07:41:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42ca0116-b85c-5423-9000-236cf05d2bcb with identifier: UV60068
2026-03-30 07:41:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42ca0116-b85c-5423-9000-236cf05d2bcb with identifier: UV60068
2026-03-30 07:41:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42ca0116-b85c-5423-9000-236cf05d2bcb with identifier: UV60068 to the API
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:44:26Z',
 'fuel_type': 'gas',
 'id': '42ca0116-b85c-5423-9000-236cf05d2bcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UV60068',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 71694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-15',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV60068%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Saving data for UV60068: {'auction_closing_time': 1774885466.0, 'created_time': 1773132238.159153, 'last_price_update_time': 1774856465.063982}
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UV60068') HTTP/1.1" 204 0
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: YW93482
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW93482%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Scrape type for YW93482: 2
2026-03-30 07:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91fcc334-6bca-5d79-b242-54a93cf549d4 with identifier: YW93482
2026-03-30 07:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91fcc334-6bca-5d79-b242-54a93cf549d4 with scrape type 2
2026-03-30 07:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91fcc334-6bca-5d79-b242-54a93cf549d4 with scrape type 2
2026-03-30 07:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 91fcc334-6bca-5d79-b242-54a93cf549d4, identifier: YW93482
2026-03-30 07:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 91fcc334-6bca-5d79-b242-54a93cf549d4 with identifier: YW93482
2026-03-30 07:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 91fcc334-6bca-5d79-b242-54a93cf549d4 with identifier: YW93482
2026-03-30 07:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 91fcc334-6bca-5d79-b242-54a93cf549d4 with identifier: YW93482 to the API
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:27:23Z',
 'fuel_type': 'hybrid',
 'id': '91fcc334-6bca-5d79-b242-54a93cf549d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW93482',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 43519,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-04-25',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Trend 2WD',
 'transmission': 'automatic',
 'trim': 'Trend 2WD',
 'year': 2023}
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW93482%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Saving data for YW93482: {'auction_closing_time': 1774884443.0, 'created_time': 1773302542.460735, 'last_price_update_time': 1774856465.473023}
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW93482') HTTP/1.1" 204 0
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: CJ85818
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ85818%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Scrape type for CJ85818: 2
2026-03-30 07:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b7b7a77-5eaa-5416-b097-957b6ab3b54c with identifier: CJ85818
2026-03-30 07:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b7b7a77-5eaa-5416-b097-957b6ab3b54c with scrape type 2
2026-03-30 07:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b7b7a77-5eaa-5416-b097-957b6ab3b54c with scrape type 2
2026-03-30 07:41:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3b7b7a77-5eaa-5416-b097-957b6ab3b54c, identifier: CJ85818
2026-03-30 07:41:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3b7b7a77-5eaa-5416-b097-957b6ab3b54c with identifier: CJ85818
2026-03-30 07:41:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3b7b7a77-5eaa-5416-b097-957b6ab3b54c with identifier: CJ85818
2026-03-30 07:41:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3b7b7a77-5eaa-5416-b097-957b6ab3b54c with identifier: CJ85818 to the API
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:03:03Z',
 'fuel_type': 'petrol',
 'id': '3b7b7a77-5eaa-5416-b097-957b6ab3b54c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ85818',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 22601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ85818%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Saving data for CJ85818: {'auction_closing_time': 1774882983.0, 'created_time': 1774379175.097896, 'last_price_update_time': 1774856465.883286}
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ85818') HTTP/1.1" 204 0
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: KF64937
2026-03-30 07:41:05 [auto1.de] INFO: Found listing with ID: CM64848
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM64848%27 HTTP/1.1" 200 None
2026-03-30 07:41:05 [auto1.de] INFO: Scrape type for CM64848: 2
2026-03-30 07:41:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a144a7fd-f153-5f51-a9ae-fbd819781947 with identifier: CM64848
2026-03-30 07:41:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a144a7fd-f153-5f51-a9ae-fbd819781947 with scrape type 2
2026-03-30 07:41:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a144a7fd-f153-5f51-a9ae-fbd819781947 with scrape type 2
2026-03-30 07:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a144a7fd-f153-5f51-a9ae-fbd819781947, identifier: CM64848
2026-03-30 07:41:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a144a7fd-f153-5f51-a9ae-fbd819781947 with identifier: CM64848
2026-03-30 07:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a144a7fd-f153-5f51-a9ae-fbd819781947 with identifier: CM64848
2026-03-30 07:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a144a7fd-f153-5f51-a9ae-fbd819781947 with identifier: CM64848 to the API
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:02:24Z',
 'fuel_type': 'diesel',
 'id': 'a144a7fd-f153-5f51-a9ae-fbd819781947',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM64848',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 205959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-09',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM64848%27 HTTP/1.1" 200 None
2026-03-30 07:41:06 [auto1.de] INFO: Saving data for CM64848: {'auction_closing_time': 1774882944.0, 'created_time': 1773228419.140524, 'last_price_update_time': 1774856466.331716}
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM64848') HTTP/1.1" 204 0
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: MW29670
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW29670%27 HTTP/1.1" 200 None
2026-03-30 07:41:06 [auto1.de] INFO: Scrape type for MW29670: 2
2026-03-30 07:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc9a3eee-3003-5e15-9d27-182c7dc19cc2 with identifier: MW29670
2026-03-30 07:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc9a3eee-3003-5e15-9d27-182c7dc19cc2 with scrape type 2
2026-03-30 07:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc9a3eee-3003-5e15-9d27-182c7dc19cc2 with scrape type 2
2026-03-30 07:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc9a3eee-3003-5e15-9d27-182c7dc19cc2, identifier: MW29670
2026-03-30 07:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc9a3eee-3003-5e15-9d27-182c7dc19cc2 with identifier: MW29670
2026-03-30 07:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc9a3eee-3003-5e15-9d27-182c7dc19cc2 with identifier: MW29670
2026-03-30 07:41:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc9a3eee-3003-5e15-9d27-182c7dc19cc2 with identifier: MW29670 to the API
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:21:49Z',
 'fuel_type': 'diesel',
 'id': 'fc9a3eee-3003-5e15-9d27-182c7dc19cc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW29670',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 98342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-04',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro Competition',
 'transmission': 'automatic',
 'trim': 'quattro Competition',
 'year': 2016}
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW29670%27 HTTP/1.1" 200 None
2026-03-30 07:41:06 [auto1.de] INFO: Saving data for MW29670: {'auction_closing_time': 1774884109.0, 'created_time': 1774292714.831005, 'last_price_update_time': 1774856466.785814}
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW29670') HTTP/1.1" 204 0
2026-03-30 07:41:06 [auto1.de] INFO: Found listing with ID: RC86966
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86966%27 HTTP/1.1" 200 None
2026-03-30 07:41:06 [auto1.de] INFO: Scrape type for RC86966: 2
2026-03-30 07:41:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87b81cf3-795f-5060-abdd-43fe48f1e341 with identifier: RC86966
2026-03-30 07:41:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87b81cf3-795f-5060-abdd-43fe48f1e341 with scrape type 2
2026-03-30 07:41:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87b81cf3-795f-5060-abdd-43fe48f1e341 with scrape type 2
2026-03-30 07:41:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87b81cf3-795f-5060-abdd-43fe48f1e341, identifier: RC86966
2026-03-30 07:41:06 [scrapy.extensions.logstats] INFO: Crawled 242 pages (at 40 pages/min), scraped 517 items (at 80 items/min)
2026-03-30 07:41:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:41:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87b81cf3-795f-5060-abdd-43fe48f1e341 with identifier: RC86966
2026-03-30 07:41:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87b81cf3-795f-5060-abdd-43fe48f1e341 with identifier: RC86966
2026-03-30 07:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87b81cf3-795f-5060-abdd-43fe48f1e341 with identifier: RC86966 to the API
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:36:02Z',
 'fuel_type': 'petrol',
 'id': '87b81cf3-795f-5060-abdd-43fe48f1e341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC86966',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 151133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-13',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Exclusive-Line 2WD',
 'transmission': 'manual',
 'trim': 'Exclusive-Line 2WD',
 'year': 2016}
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC86966%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Saving data for RC86966: {'auction_closing_time': 1774884962.0, 'created_time': 1773227632.784729, 'last_price_update_time': 1774856467.209051}
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC86966') HTTP/1.1" 204 0
2026-03-30 07:41:07 [auto1.de] INFO: Channel: 24h | Page: 46 | totalHits: 8006 | hits on page: 40
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: XW48128
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: KL19595
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: WS77403
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY40136%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for TY40136: 2
2026-03-30 07:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3caf2ec-6aec-59fc-aace-0225756e15af with identifier: TY40136
2026-03-30 07:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3caf2ec-6aec-59fc-aace-0225756e15af with scrape type 2
2026-03-30 07:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3caf2ec-6aec-59fc-aace-0225756e15af with scrape type 2
2026-03-30 07:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3caf2ec-6aec-59fc-aace-0225756e15af, identifier: TY40136
2026-03-30 07:41:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3caf2ec-6aec-59fc-aace-0225756e15af with identifier: TY40136
2026-03-30 07:41:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3caf2ec-6aec-59fc-aace-0225756e15af with identifier: TY40136
2026-03-30 07:41:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3caf2ec-6aec-59fc-aace-0225756e15af with identifier: TY40136 to the API
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-30T15:07:22Z',
 'fuel_type': 'petrol',
 'id': 'b3caf2ec-6aec-59fc-aace-0225756e15af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TY40136',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 123113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-18',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 45 AMG 4Matic Sport',
 'transmission': 'automatic',
 'trim': '4Matic Sport',
 'year': 2016}
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY40136%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Saving data for TY40136: {'auction_closing_time': 1774883242.0, 'created_time': 1773138091.620624, 'last_price_update_time': 1774856467.756465}
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TY40136') HTTP/1.1" 204 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: LT87510
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: TY40136
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY40136%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for TY40136: 0
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96872%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for SP96872: 2
2026-03-30 07:41:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8990ac28-dcab-548f-845b-961946820850 with identifier: SP96872
2026-03-30 07:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8990ac28-dcab-548f-845b-961946820850 with scrape type 2
2026-03-30 07:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8990ac28-dcab-548f-845b-961946820850 with scrape type 2
2026-03-30 07:41:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8990ac28-dcab-548f-845b-961946820850, identifier: SP96872
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: YV77496
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: UP55946
2026-03-30 07:41:07 [auto1.de] INFO: Found listing with ID: SP96872
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96872%27 HTTP/1.1" 200 None
2026-03-30 07:41:07 [auto1.de] INFO: Scrape type for SP96872: 2
2026-03-30 07:41:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8990ac28-dcab-548f-845b-961946820850 with scrape type 2
2026-03-30 07:41:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8990ac28-dcab-548f-845b-961946820850 with scrape type 2
2026-03-30 07:41:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8990ac28-dcab-548f-845b-961946820850, identifier: SP96872
2026-03-30 07:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8990ac28-dcab-548f-845b-961946820850 with identifier: SP96872
2026-03-30 07:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8990ac28-dcab-548f-845b-961946820850 with identifier: SP96872
2026-03-30 07:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8990ac28-dcab-548f-845b-961946820850 with identifier: SP96872 to the API
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'diesel',
 'id': '8990ac28-dcab-548f-845b-961946820850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP96872',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 200985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-25',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96872%27 HTTP/1.1" 200 None
2026-03-30 07:41:08 [auto1.de] INFO: Saving data for SP96872: {'auction_closing_time': 1774884768.0, 'created_time': 1773831207.432897, 'last_price_update_time': 1774856468.465177}
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP96872') HTTP/1.1" 204 0
2026-03-30 07:41:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8990ac28-dcab-548f-845b-961946820850 with identifier: SP96872
2026-03-30 07:41:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8990ac28-dcab-548f-845b-961946820850 with identifier: SP96872
2026-03-30 07:41:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8990ac28-dcab-548f-845b-961946820850 with identifier: SP96872 to the API
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'diesel',
 'id': '8990ac28-dcab-548f-845b-961946820850',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP96872',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 200985,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-25',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP96872%27 HTTP/1.1" 200 None
2026-03-30 07:41:08 [auto1.de] INFO: Saving data for SP96872: {'auction_closing_time': 1774884768.0, 'created_time': 1773831207.432897, 'last_price_update_time': 1774856468.854521}
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP96872') HTTP/1.1" 204 0
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: NJ52204
2026-03-30 07:41:08 [auto1.de] INFO: Found listing with ID: BG00548
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG00548%27 HTTP/1.1" 200 None
2026-03-30 07:41:08 [auto1.de] INFO: Scrape type for BG00548: 2
2026-03-30 07:41:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03afc4eb-a658-5ad1-beb2-49b4634c1661 with identifier: BG00548
2026-03-30 07:41:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03afc4eb-a658-5ad1-beb2-49b4634c1661 with scrape type 2
2026-03-30 07:41:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03afc4eb-a658-5ad1-beb2-49b4634c1661 with scrape type 2
2026-03-30 07:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 03afc4eb-a658-5ad1-beb2-49b4634c1661, identifier: BG00548
2026-03-30 07:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 03afc4eb-a658-5ad1-beb2-49b4634c1661 with identifier: BG00548
2026-03-30 07:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 03afc4eb-a658-5ad1-beb2-49b4634c1661 with identifier: BG00548
2026-03-30 07:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 03afc4eb-a658-5ad1-beb2-49b4634c1661 with identifier: BG00548 to the API
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:18:03Z',
 'fuel_type': 'diesel',
 'id': '03afc4eb-a658-5ad1-beb2-49b4634c1661',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG00548',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 138576,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-29',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 d Mild-Hybrid T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2023}
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG00548%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Saving data for BG00548: {'auction_closing_time': 1774883883.0, 'created_time': 1774379290.692435, 'last_price_update_time': 1774856469.417258}
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG00548') HTTP/1.1" 204 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: FN44778
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN44778%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for FN44778: 2
2026-03-30 07:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b5ee742-e4d9-5570-a576-bc55aab24812 with identifier: FN44778
2026-03-30 07:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b5ee742-e4d9-5570-a576-bc55aab24812 with scrape type 2
2026-03-30 07:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b5ee742-e4d9-5570-a576-bc55aab24812 with scrape type 2
2026-03-30 07:41:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b5ee742-e4d9-5570-a576-bc55aab24812, identifier: FN44778
2026-03-30 07:41:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b5ee742-e4d9-5570-a576-bc55aab24812 with identifier: FN44778
2026-03-30 07:41:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b5ee742-e4d9-5570-a576-bc55aab24812 with identifier: FN44778
2026-03-30 07:41:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b5ee742-e4d9-5570-a576-bc55aab24812 with identifier: FN44778 to the API
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:17Z',
 'fuel_type': 'diesel',
 'id': '7b5ee742-e4d9-5570-a576-bc55aab24812',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN44778',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 133169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-01',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN44778%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Saving data for FN44778: {'auction_closing_time': 1774884737.0, 'created_time': 1774550692.777916, 'last_price_update_time': 1774856469.832127}
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN44778') HTTP/1.1" 204 0
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: CG08693
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: YN38539
2026-03-30 07:41:09 [auto1.de] INFO: Found listing with ID: ZE88330
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE88330%27 HTTP/1.1" 200 None
2026-03-30 07:41:09 [auto1.de] INFO: Scrape type for ZE88330: 2
2026-03-30 07:41:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with identifier: ZE88330
2026-03-30 07:41:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with scrape type 2
2026-03-30 07:41:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with scrape type 2
2026-03-30 07:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60c8b276-41f2-54f3-9c67-bd0cb68c4fef, identifier: ZE88330
2026-03-30 07:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with identifier: ZE88330
2026-03-30 07:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with identifier: ZE88330
2026-03-30 07:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60c8b276-41f2-54f3-9c67-bd0cb68c4fef with identifier: ZE88330 to the API
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:54:34Z',
 'fuel_type': 'petrol',
 'id': '60c8b276-41f2-54f3-9c67-bd0cb68c4fef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE88330',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 79292,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-17',
 'seller_name': None,
 'title': 'BMW X4 xDrive 30i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE88330%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Saving data for ZE88330: {'auction_closing_time': 1774886074.0, 'created_time': 1773132276.849646, 'last_price_update_time': 1774856470.295029}
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE88330') HTTP/1.1" 204 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: MD51854
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD51854%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for MD51854: 2
2026-03-30 07:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f1a953c-bded-5c3b-98d6-d88d8b1ee17d with identifier: MD51854
2026-03-30 07:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f1a953c-bded-5c3b-98d6-d88d8b1ee17d with scrape type 2
2026-03-30 07:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f1a953c-bded-5c3b-98d6-d88d8b1ee17d with scrape type 2
2026-03-30 07:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f1a953c-bded-5c3b-98d6-d88d8b1ee17d, identifier: MD51854
2026-03-30 07:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f1a953c-bded-5c3b-98d6-d88d8b1ee17d with identifier: MD51854
2026-03-30 07:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f1a953c-bded-5c3b-98d6-d88d8b1ee17d with identifier: MD51854
2026-03-30 07:41:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f1a953c-bded-5c3b-98d6-d88d8b1ee17d with identifier: MD51854 to the API
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:46:52Z',
 'fuel_type': 'petrol',
 'id': '1f1a953c-bded-5c3b-98d6-d88d8b1ee17d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD51854',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 68548,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 200 Kompressor Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2009}
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD51854%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Saving data for MD51854: {'auction_closing_time': 1774885612.0, 'created_time': 1773132245.357303, 'last_price_update_time': 1774856470.76554}
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD51854') HTTP/1.1" 204 0
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: LG10256
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: KK73289
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: LS49952
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: EN74445
2026-03-30 07:41:10 [auto1.de] INFO: Found listing with ID: XY85959
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85959%27 HTTP/1.1" 200 None
2026-03-30 07:41:10 [auto1.de] INFO: Scrape type for XY85959: 2
2026-03-30 07:41:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 504d562c-6bf2-51f0-ab87-001e819a537e with identifier: XY85959
2026-03-30 07:41:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 504d562c-6bf2-51f0-ab87-001e819a537e with scrape type 2
2026-03-30 07:41:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 504d562c-6bf2-51f0-ab87-001e819a537e with scrape type 2
2026-03-30 07:41:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 504d562c-6bf2-51f0-ab87-001e819a537e, identifier: XY85959
2026-03-30 07:41:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 504d562c-6bf2-51f0-ab87-001e819a537e with identifier: XY85959
2026-03-30 07:41:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 504d562c-6bf2-51f0-ab87-001e819a537e with identifier: XY85959
2026-03-30 07:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 504d562c-6bf2-51f0-ab87-001e819a537e with identifier: XY85959 to the API
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:33:23Z',
 'fuel_type': 'diesel',
 'id': '504d562c-6bf2-51f0-ab87-001e819a537e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY85959',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 202721,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-08',
 'seller_name': None,
 'title': 'Porsche Cayenne Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY85959%27 HTTP/1.1" 200 None
2026-03-30 07:41:11 [auto1.de] INFO: Saving data for XY85959: {'auction_closing_time': 1774884803.0, 'created_time': 1773135860.853966, 'last_price_update_time': 1774856471.254902}
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY85959') HTTP/1.1" 204 0
2026-03-30 07:41:11 [auto1.de] INFO: Found listing with ID: EZ47162
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ47162%27 HTTP/1.1" 200 None
2026-03-30 07:41:11 [auto1.de] INFO: Scrape type for EZ47162: 2
2026-03-30 07:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6c87df5-f480-5907-b5ce-b7bfead12d6c with identifier: EZ47162
2026-03-30 07:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c87df5-f480-5907-b5ce-b7bfead12d6c with scrape type 2
2026-03-30 07:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6c87df5-f480-5907-b5ce-b7bfead12d6c with scrape type 2
2026-03-30 07:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6c87df5-f480-5907-b5ce-b7bfead12d6c, identifier: EZ47162
2026-03-30 07:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6c87df5-f480-5907-b5ce-b7bfead12d6c with identifier: EZ47162
2026-03-30 07:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6c87df5-f480-5907-b5ce-b7bfead12d6c with identifier: EZ47162
2026-03-30 07:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6c87df5-f480-5907-b5ce-b7bfead12d6c with identifier: EZ47162 to the API
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:39:49Z',
 'fuel_type': 'diesel',
 'id': 'b6c87df5-f480-5907-b5ce-b7bfead12d6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ47162',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 261000,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-03',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Match BlueMotion',
 'transmission': 'manual',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ47162%27 HTTP/1.1" 200 None
2026-03-30 07:41:11 [auto1.de] INFO: Saving data for EZ47162: {'auction_closing_time': 1774885189.0, 'created_time': 1773344351.126572, 'last_price_update_time': 1774856471.762233}
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ47162') HTTP/1.1" 204 0
2026-03-30 07:41:11 [auto1.de] INFO: Found listing with ID: YB72786
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB72786%27 HTTP/1.1" 200 None
2026-03-30 07:41:11 [auto1.de] INFO: Scrape type for YB72786: 2
2026-03-30 07:41:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b23916ca-b6b2-5cdf-b060-256a2df8cc10 with identifier: YB72786
2026-03-30 07:41:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b23916ca-b6b2-5cdf-b060-256a2df8cc10 with scrape type 2
2026-03-30 07:41:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b23916ca-b6b2-5cdf-b060-256a2df8cc10 with scrape type 2
2026-03-30 07:41:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b23916ca-b6b2-5cdf-b060-256a2df8cc10, identifier: YB72786
2026-03-30 07:41:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b23916ca-b6b2-5cdf-b060-256a2df8cc10 with identifier: YB72786
2026-03-30 07:41:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b23916ca-b6b2-5cdf-b060-256a2df8cc10 with identifier: YB72786
2026-03-30 07:41:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b23916ca-b6b2-5cdf-b060-256a2df8cc10 with identifier: YB72786 to the API
2026-03-30 07:41:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:18Z',
 'fuel_type': 'diesel',
 'id': 'b23916ca-b6b2-5cdf-b060-256a2df8cc10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB72786',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 35070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-15',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L1H1 2,8t Komfort',
 'transmission': 'manual',
 'trim': 'L1H1 2,8t Komfort',
 'year': 2021}
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB72786%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Saving data for YB72786: {'auction_closing_time': 1774884918.0, 'created_time': 1773831098.700868, 'last_price_update_time': 1774856472.227283}
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB72786') HTTP/1.1" 204 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: NC06801
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: YL95361
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: DZ61875
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: TX80950
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX80950%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for TX80950: 2
2026-03-30 07:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47e5e051-4569-5f6c-9686-49be6efd0d01 with identifier: TX80950
2026-03-30 07:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47e5e051-4569-5f6c-9686-49be6efd0d01 with scrape type 2
2026-03-30 07:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47e5e051-4569-5f6c-9686-49be6efd0d01 with scrape type 2
2026-03-30 07:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47e5e051-4569-5f6c-9686-49be6efd0d01, identifier: TX80950
2026-03-30 07:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47e5e051-4569-5f6c-9686-49be6efd0d01 with identifier: TX80950
2026-03-30 07:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47e5e051-4569-5f6c-9686-49be6efd0d01 with identifier: TX80950
2026-03-30 07:41:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47e5e051-4569-5f6c-9686-49be6efd0d01 with identifier: TX80950 to the API
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:23Z',
 'fuel_type': 'diesel',
 'id': '47e5e051-4569-5f6c-9686-49be6efd0d01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX80950',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 104423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-24',
 'seller_name': None,
 'title': 'Ford Focus 2.0 TDCi EcoBlue Vignale',
 'transmission': 'automatic',
 'trim': 'Vignale',
 'year': 2021}
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX80950%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Saving data for TX80950: {'auction_closing_time': 1774885043.0, 'created_time': 1774637321.3134, 'last_price_update_time': 1774856472.833397}
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX80950') HTTP/1.1" 204 0
2026-03-30 07:41:12 [auto1.de] INFO: Found listing with ID: RM28884
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28884%27 HTTP/1.1" 200 None
2026-03-30 07:41:12 [auto1.de] INFO: Scrape type for RM28884: 2
2026-03-30 07:41:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c4d54c2-d68d-51f7-9c8a-e5534388b1ee with identifier: RM28884
2026-03-30 07:41:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c4d54c2-d68d-51f7-9c8a-e5534388b1ee with scrape type 2
2026-03-30 07:41:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c4d54c2-d68d-51f7-9c8a-e5534388b1ee with scrape type 2
2026-03-30 07:41:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c4d54c2-d68d-51f7-9c8a-e5534388b1ee, identifier: RM28884
2026-03-30 07:41:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c4d54c2-d68d-51f7-9c8a-e5534388b1ee with identifier: RM28884
2026-03-30 07:41:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c4d54c2-d68d-51f7-9c8a-e5534388b1ee with identifier: RM28884
2026-03-30 07:41:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c4d54c2-d68d-51f7-9c8a-e5534388b1ee with identifier: RM28884 to the API
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:40Z',
 'fuel_type': 'petrol',
 'id': '0c4d54c2-d68d-51f7-9c8a-e5534388b1ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM28884',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 224277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-20',
 'seller_name': None,
 'title': 'Honda CR-V 2.0 VTEC Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2011}
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM28884%27 HTTP/1.1" 200 None
2026-03-30 07:41:13 [auto1.de] INFO: Saving data for RM28884: {'auction_closing_time': 1774882840.0, 'created_time': 1773344927.500176, 'last_price_update_time': 1774856473.33169}
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM28884') HTTP/1.1" 204 0
2026-03-30 07:41:13 [auto1.de] INFO: Found listing with ID: WJ79239
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ79239%27 HTTP/1.1" 200 None
2026-03-30 07:41:13 [auto1.de] INFO: Scrape type for WJ79239: 0
2026-03-30 07:41:13 [auto1.de] INFO: Found listing with ID: HA68744
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA68744%27 HTTP/1.1" 200 None
2026-03-30 07:41:13 [auto1.de] INFO: Scrape type for HA68744: 2
2026-03-30 07:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e5eef57-d695-5ab3-a64b-84176e042225 with identifier: HA68744
2026-03-30 07:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e5eef57-d695-5ab3-a64b-84176e042225 with scrape type 2
2026-03-30 07:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e5eef57-d695-5ab3-a64b-84176e042225 with scrape type 2
2026-03-30 07:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e5eef57-d695-5ab3-a64b-84176e042225, identifier: HA68744
2026-03-30 07:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e5eef57-d695-5ab3-a64b-84176e042225 with identifier: HA68744
2026-03-30 07:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e5eef57-d695-5ab3-a64b-84176e042225 with identifier: HA68744
2026-03-30 07:41:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e5eef57-d695-5ab3-a64b-84176e042225 with identifier: HA68744 to the API
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:37:17Z',
 'fuel_type': 'diesel',
 'id': '5e5eef57-d695-5ab3-a64b-84176e042225',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA68744',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 135067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-25',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Trend',
 'transmission': 'manual',
 'trim': '320 L1 Trend',
 'year': 2018}
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA68744%27 HTTP/1.1" 200 None
2026-03-30 07:41:13 [auto1.de] INFO: Saving data for HA68744: {'auction_closing_time': 1774885037.0, 'created_time': 1773305244.427815, 'last_price_update_time': 1774856473.771074}
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA68744') HTTP/1.1" 204 0
2026-03-30 07:41:13 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80734%27 HTTP/1.1" 200 None
2026-03-30 07:41:13 [auto1.de] INFO: Scrape type for FD80734: 0
2026-03-30 07:41:13 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV13799%27 HTTP/1.1" 200 None
2026-03-30 07:41:13 [auto1.de] INFO: Scrape type for PV13799: 2
2026-03-30 07:41:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7d9a571-6892-5f4e-b9f5-1b9ca7493e64 with identifier: PV13799
2026-03-30 07:41:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7d9a571-6892-5f4e-b9f5-1b9ca7493e64 with scrape type 2
2026-03-30 07:41:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7d9a571-6892-5f4e-b9f5-1b9ca7493e64 with scrape type 2
2026-03-30 07:41:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e7d9a571-6892-5f4e-b9f5-1b9ca7493e64, identifier: PV13799
2026-03-30 07:41:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e7d9a571-6892-5f4e-b9f5-1b9ca7493e64 with identifier: PV13799
2026-03-30 07:41:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e7d9a571-6892-5f4e-b9f5-1b9ca7493e64 with identifier: PV13799
2026-03-30 07:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e7d9a571-6892-5f4e-b9f5-1b9ca7493e64 with identifier: PV13799 to the API
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:35Z',
 'fuel_type': 'diesel',
 'id': 'e7d9a571-6892-5f4e-b9f5-1b9ca7493e64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV13799',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 230248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV13799%27 HTTP/1.1" 200 None
2026-03-30 07:41:14 [auto1.de] INFO: Saving data for PV13799: {'auction_closing_time': 1774883195.0, 'created_time': 1773137102.94172, 'last_price_update_time': 1774856474.261397}
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV13799') HTTP/1.1" 204 0
2026-03-30 07:41:14 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT54414%27 HTTP/1.1" 200 None
2026-03-30 07:41:14 [auto1.de] INFO: Scrape type for NT54414: 2
2026-03-30 07:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbff0d8d-f27c-548f-922e-29ae438a849d with identifier: NT54414
2026-03-30 07:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbff0d8d-f27c-548f-922e-29ae438a849d with scrape type 2
2026-03-30 07:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbff0d8d-f27c-548f-922e-29ae438a849d with scrape type 2
2026-03-30 07:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbff0d8d-f27c-548f-922e-29ae438a849d, identifier: NT54414
2026-03-30 07:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbff0d8d-f27c-548f-922e-29ae438a849d with identifier: NT54414
2026-03-30 07:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbff0d8d-f27c-548f-922e-29ae438a849d with identifier: NT54414
2026-03-30 07:41:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbff0d8d-f27c-548f-922e-29ae438a849d with identifier: NT54414 to the API
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:28:34Z',
 'fuel_type': 'petrol',
 'id': 'cbff0d8d-f27c-548f-922e-29ae438a849d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT54414',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 138120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-24',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT54414%27 HTTP/1.1" 200 None
2026-03-30 07:41:14 [auto1.de] INFO: Saving data for NT54414: {'auction_closing_time': 1774884514.0, 'created_time': 1773136823.406324, 'last_price_update_time': 1774856474.838078}
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT54414') HTTP/1.1" 204 0
2026-03-30 07:41:14 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-30 07:41:14 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-30 07:41:14 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-30 07:41:14 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE98096%27 HTTP/1.1" 200 None
2026-03-30 07:41:14 [auto1.de] INFO: Scrape type for RE98096: 2
2026-03-30 07:41:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a37619ba-188a-51b5-bdfe-1151c449d83f with identifier: RE98096
2026-03-30 07:41:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a37619ba-188a-51b5-bdfe-1151c449d83f with scrape type 2
2026-03-30 07:41:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a37619ba-188a-51b5-bdfe-1151c449d83f with scrape type 2
2026-03-30 07:41:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a37619ba-188a-51b5-bdfe-1151c449d83f, identifier: RE98096
2026-03-30 07:41:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a37619ba-188a-51b5-bdfe-1151c449d83f with identifier: RE98096
2026-03-30 07:41:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a37619ba-188a-51b5-bdfe-1151c449d83f with identifier: RE98096
2026-03-30 07:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a37619ba-188a-51b5-bdfe-1151c449d83f with identifier: RE98096 to the API
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:08:54Z',
 'fuel_type': 'petrol',
 'id': 'a37619ba-188a-51b5-bdfe-1151c449d83f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE98096',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 95436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-27',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE98096%27 HTTP/1.1" 200 None
2026-03-30 07:41:15 [auto1.de] INFO: Saving data for RE98096: {'auction_closing_time': 1774883334.0, 'created_time': 1774638249.501112, 'last_price_update_time': 1774856475.262793}
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE98096') HTTP/1.1" 204 0
2026-03-30 07:41:15 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR00588%27 HTTP/1.1" 200 None
2026-03-30 07:41:15 [auto1.de] INFO: Scrape type for JR00588: 2
2026-03-30 07:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with identifier: JR00588
2026-03-30 07:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with scrape type 2
2026-03-30 07:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with scrape type 2
2026-03-30 07:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d2a26ac-c1ca-56d5-95f8-38936e81dde1, identifier: JR00588
2026-03-30 07:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with identifier: JR00588
2026-03-30 07:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with identifier: JR00588
2026-03-30 07:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d2a26ac-c1ca-56d5-95f8-38936e81dde1 with identifier: JR00588 to the API
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:57:01Z',
 'fuel_type': 'diesel',
 'id': '5d2a26ac-c1ca-56d5-95f8-38936e81dde1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR00588',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 130422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-11',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR00588%27 HTTP/1.1" 200 None
2026-03-30 07:41:15 [auto1.de] INFO: Saving data for JR00588: {'auction_closing_time': 1774886221.0, 'created_time': 1773132325.657625, 'last_price_update_time': 1774856475.682684}
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR00588') HTTP/1.1" 204 0
2026-03-30 07:41:15 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-30 07:41:15 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU42318%27 HTTP/1.1" 200 None
2026-03-30 07:41:15 [auto1.de] INFO: Scrape type for RU42318: 2
2026-03-30 07:41:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4675149c-e5e5-508e-af9d-6d678b3b1109 with identifier: RU42318
2026-03-30 07:41:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4675149c-e5e5-508e-af9d-6d678b3b1109 with scrape type 2
2026-03-30 07:41:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4675149c-e5e5-508e-af9d-6d678b3b1109 with scrape type 2
2026-03-30 07:41:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4675149c-e5e5-508e-af9d-6d678b3b1109, identifier: RU42318
2026-03-30 07:41:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4675149c-e5e5-508e-af9d-6d678b3b1109 with identifier: RU42318
2026-03-30 07:41:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4675149c-e5e5-508e-af9d-6d678b3b1109 with identifier: RU42318
2026-03-30 07:41:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4675149c-e5e5-508e-af9d-6d678b3b1109 with identifier: RU42318 to the API
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:41:27Z',
 'fuel_type': 'diesel',
 'id': '4675149c-e5e5-508e-af9d-6d678b3b1109',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU42318',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 252642,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-10',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2015}
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU42318%27 HTTP/1.1" 200 None
2026-03-30 07:41:16 [auto1.de] INFO: Saving data for RU42318: {'auction_closing_time': 1774885287.0, 'created_time': 1773226686.88639, 'last_price_update_time': 1774856476.089989}
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU42318') HTTP/1.1" 204 0
2026-03-30 07:41:16 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91725%27 HTTP/1.1" 200 None
2026-03-30 07:41:16 [auto1.de] INFO: Scrape type for BZ91725: 2
2026-03-30 07:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5660d15-35f0-55b5-8062-ca56a20343a7 with identifier: BZ91725
2026-03-30 07:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5660d15-35f0-55b5-8062-ca56a20343a7 with scrape type 2
2026-03-30 07:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5660d15-35f0-55b5-8062-ca56a20343a7 with scrape type 2
2026-03-30 07:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5660d15-35f0-55b5-8062-ca56a20343a7, identifier: BZ91725
2026-03-30 07:41:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5660d15-35f0-55b5-8062-ca56a20343a7 with identifier: BZ91725
2026-03-30 07:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5660d15-35f0-55b5-8062-ca56a20343a7 with identifier: BZ91725
2026-03-30 07:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5660d15-35f0-55b5-8062-ca56a20343a7 with identifier: BZ91725 to the API
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:31Z',
 'fuel_type': 'petrol',
 'id': 'f5660d15-35f0-55b5-8062-ca56a20343a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ91725',
 'listing': 'auction',
 'make': 'Saab',
 'model': '9-5',
 'odometer': 206335,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-06-28',
 'seller_name': None,
 'title': 'Saab 9-5 2.0 T Ecopower',
 'transmission': 'manual',
 'trim': 'T Ecopower',
 'year': 1999}
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91725%27 HTTP/1.1" 200 None
2026-03-30 07:41:16 [auto1.de] INFO: Saving data for BZ91725: {'auction_closing_time': 1774886191.0, 'created_time': 1773228855.651318, 'last_price_update_time': 1774856476.50166}
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ91725') HTTP/1.1" 204 0
2026-03-30 07:41:16 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK06472%27 HTTP/1.1" 200 None
2026-03-30 07:41:16 [auto1.de] INFO: Scrape type for CK06472: 2
2026-03-30 07:41:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b038cc-080f-589c-943b-b68e3624da1e with identifier: CK06472
2026-03-30 07:41:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b038cc-080f-589c-943b-b68e3624da1e with scrape type 2
2026-03-30 07:41:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22b038cc-080f-589c-943b-b68e3624da1e with scrape type 2
2026-03-30 07:41:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22b038cc-080f-589c-943b-b68e3624da1e, identifier: CK06472
2026-03-30 07:41:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22b038cc-080f-589c-943b-b68e3624da1e with identifier: CK06472
2026-03-30 07:41:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22b038cc-080f-589c-943b-b68e3624da1e with identifier: CK06472
2026-03-30 07:41:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22b038cc-080f-589c-943b-b68e3624da1e with identifier: CK06472 to the API
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:47:28Z',
 'fuel_type': 'diesel',
 'id': '22b038cc-080f-589c-943b-b68e3624da1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK06472',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 34319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-07',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK06472%27 HTTP/1.1" 200 None
2026-03-30 07:41:16 [auto1.de] INFO: Saving data for CK06472: {'auction_closing_time': 1774885648.0, 'created_time': 1773303177.876719, 'last_price_update_time': 1774856476.947943}
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK06472') HTTP/1.1" 204 0
2026-03-30 07:41:16 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-30 07:41:16 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-30 07:41:16 [auto1.de] INFO: Channel: 24h | Page: 47 | totalHits: 8020 | hits on page: 40
2026-03-30 07:41:16 [auto1.de] INFO: Found listing with ID: FD80734
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD80734%27 HTTP/1.1" 200 None
2026-03-30 07:41:16 [auto1.de] INFO: Scrape type for FD80734: 0
2026-03-30 07:41:16 [auto1.de] INFO: Found listing with ID: PV13799
2026-03-30 07:41:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV13799%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for PV13799: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: NT54414
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT54414%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for NT54414: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: SF55933
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: RY86630
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: CU91826
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: RE98096
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE98096%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for RE98096: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: JR00588
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR00588%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for JR00588: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: YY17846
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: RU42318
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU42318%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for RU42318: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: BZ91725
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ91725%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for BZ91725: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: CK06472
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK06472%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for CK06472: 0
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: CG73719
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: NB79280
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: XK62781
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: AS80209
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS80209%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for AS80209: 2
2026-03-30 07:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5728f943-b6f8-59ba-92c0-86d30abeb0e7 with identifier: AS80209
2026-03-30 07:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5728f943-b6f8-59ba-92c0-86d30abeb0e7 with scrape type 2
2026-03-30 07:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5728f943-b6f8-59ba-92c0-86d30abeb0e7 with scrape type 2
2026-03-30 07:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5728f943-b6f8-59ba-92c0-86d30abeb0e7, identifier: AS80209
2026-03-30 07:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5728f943-b6f8-59ba-92c0-86d30abeb0e7 with identifier: AS80209
2026-03-30 07:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5728f943-b6f8-59ba-92c0-86d30abeb0e7 with identifier: AS80209
2026-03-30 07:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5728f943-b6f8-59ba-92c0-86d30abeb0e7 with identifier: AS80209 to the API
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:12:26Z',
 'fuel_type': 'diesel',
 'id': '5728f943-b6f8-59ba-92c0-86d30abeb0e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS80209',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Clubman',
 'odometer': 145863,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-16',
 'seller_name': None,
 'title': 'MINI Clubman Cooper SD',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS80209%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Saving data for AS80209: {'auction_closing_time': 1774883546.0, 'created_time': 1773831150.619704, 'last_price_update_time': 1774856477.509206}
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS80209') HTTP/1.1" 204 0
2026-03-30 07:41:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:17 [auto1.de] INFO: Found listing with ID: AP67523
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP67523%27 HTTP/1.1" 200 None
2026-03-30 07:41:17 [auto1.de] INFO: Scrape type for AP67523: 2
2026-03-30 07:41:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c098879c-7879-5d41-b906-dbe3ee054d9a with identifier: AP67523
2026-03-30 07:41:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c098879c-7879-5d41-b906-dbe3ee054d9a with scrape type 2
2026-03-30 07:41:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c098879c-7879-5d41-b906-dbe3ee054d9a with scrape type 2
2026-03-30 07:41:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c098879c-7879-5d41-b906-dbe3ee054d9a, identifier: AP67523
2026-03-30 07:41:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c098879c-7879-5d41-b906-dbe3ee054d9a with identifier: AP67523
2026-03-30 07:41:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c098879c-7879-5d41-b906-dbe3ee054d9a with identifier: AP67523
2026-03-30 07:41:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c098879c-7879-5d41-b906-dbe3ee054d9a with identifier: AP67523 to the API
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:51:01Z',
 'fuel_type': 'petrol',
 'id': 'c098879c-7879-5d41-b906-dbe3ee054d9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP67523',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 103866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Vision 2WD',
 'transmission': 'automatic',
 'trim': 'Vision 2WD',
 'year': 2020}
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP67523%27 HTTP/1.1" 200 None
2026-03-30 07:41:18 [auto1.de] INFO: Saving data for AP67523: {'auction_closing_time': 1774885861.0, 'created_time': 1773342670.65938, 'last_price_update_time': 1774856478.080315}
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP67523') HTTP/1.1" 204 0
2026-03-30 07:41:18 [auto1.de] INFO: Found listing with ID: YF68653
2026-03-30 07:41:18 [auto1.de] INFO: Found listing with ID: SJ86823
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ86823%27 HTTP/1.1" 200 None
2026-03-30 07:41:18 [auto1.de] INFO: Scrape type for SJ86823: 2
2026-03-30 07:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9297d829-353a-5eb4-b002-6e205d63a332 with identifier: SJ86823
2026-03-30 07:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9297d829-353a-5eb4-b002-6e205d63a332 with scrape type 2
2026-03-30 07:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9297d829-353a-5eb4-b002-6e205d63a332 with scrape type 2
2026-03-30 07:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9297d829-353a-5eb4-b002-6e205d63a332, identifier: SJ86823
2026-03-30 07:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9297d829-353a-5eb4-b002-6e205d63a332 with identifier: SJ86823
2026-03-30 07:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9297d829-353a-5eb4-b002-6e205d63a332 with identifier: SJ86823
2026-03-30 07:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9297d829-353a-5eb4-b002-6e205d63a332 with identifier: SJ86823 to the API
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:33:11Z',
 'fuel_type': 'petrol',
 'id': '9297d829-353a-5eb4-b002-6e205d63a332',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ86823',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 64358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-25',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Edition 2014',
 'transmission': 'manual',
 'trim': 'Edition 2014',
 'year': 2014}
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ86823%27 HTTP/1.1" 200 None
2026-03-30 07:41:18 [auto1.de] INFO: Saving data for SJ86823: {'auction_closing_time': 1774884791.0, 'created_time': 1773347032.544867, 'last_price_update_time': 1774856478.564814}
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ86823') HTTP/1.1" 204 0
2026-03-30 07:41:18 [auto1.de] INFO: Found listing with ID: TF22102
2026-03-30 07:41:18 [auto1.de] INFO: Found listing with ID: FG94497
2026-03-30 07:41:18 [auto1.de] INFO: Found listing with ID: HE99483
2026-03-30 07:41:18 [auto1.de] INFO: Found listing with ID: LF77567
2026-03-30 07:41:18 [auto1.de] INFO: Found listing with ID: JL43427
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL43427%27 HTTP/1.1" 200 None
2026-03-30 07:41:18 [auto1.de] INFO: Scrape type for JL43427: 2
2026-03-30 07:41:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b06d11a9-b956-5a4e-9e1b-d40818727377 with identifier: JL43427
2026-03-30 07:41:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b06d11a9-b956-5a4e-9e1b-d40818727377 with scrape type 2
2026-03-30 07:41:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b06d11a9-b956-5a4e-9e1b-d40818727377 with scrape type 2
2026-03-30 07:41:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b06d11a9-b956-5a4e-9e1b-d40818727377, identifier: JL43427
2026-03-30 07:41:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b06d11a9-b956-5a4e-9e1b-d40818727377 with identifier: JL43427
2026-03-30 07:41:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b06d11a9-b956-5a4e-9e1b-d40818727377 with identifier: JL43427
2026-03-30 07:41:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b06d11a9-b956-5a4e-9e1b-d40818727377 with identifier: JL43427 to the API
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:39:47Z',
 'fuel_type': 'petrol',
 'id': 'b06d11a9-b956-5a4e-9e1b-d40818727377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL43427',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 33238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-21',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 300 Mild-Hybrid AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2022}
2026-03-30 07:41:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL43427%27 HTTP/1.1" 200 None
2026-03-30 07:41:19 [auto1.de] INFO: Saving data for JL43427: {'auction_closing_time': 1774885187.0, 'created_time': 1773399709.053378, 'last_price_update_time': 1774856479.006684}
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL43427') HTTP/1.1" 204 0
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: DX27890
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX27890%27 HTTP/1.1" 200 None
2026-03-30 07:41:19 [auto1.de] INFO: Scrape type for DX27890: 2
2026-03-30 07:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab78bc4b-b012-56e4-9a0c-44190b11f726 with identifier: DX27890
2026-03-30 07:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab78bc4b-b012-56e4-9a0c-44190b11f726 with scrape type 2
2026-03-30 07:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab78bc4b-b012-56e4-9a0c-44190b11f726 with scrape type 2
2026-03-30 07:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab78bc4b-b012-56e4-9a0c-44190b11f726, identifier: DX27890
2026-03-30 07:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab78bc4b-b012-56e4-9a0c-44190b11f726 with identifier: DX27890
2026-03-30 07:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab78bc4b-b012-56e4-9a0c-44190b11f726 with identifier: DX27890
2026-03-30 07:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab78bc4b-b012-56e4-9a0c-44190b11f726 with identifier: DX27890 to the API
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:19:33Z',
 'fuel_type': 'petrol',
 'id': 'ab78bc4b-b012-56e4-9a0c-44190b11f726',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX27890',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 195890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX27890%27 HTTP/1.1" 200 None
2026-03-30 07:41:19 [auto1.de] INFO: Saving data for DX27890: {'auction_closing_time': 1774883973.0, 'created_time': 1772542676.590495, 'last_price_update_time': 1774856479.416504}
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX27890') HTTP/1.1" 204 0
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: VJ93938
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: AX13429
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: SD17030
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: AN60754
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60754%27 HTTP/1.1" 200 None
2026-03-30 07:41:19 [auto1.de] INFO: Scrape type for AN60754: 2
2026-03-30 07:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f27633e-4392-52f5-a025-6c743447e407 with identifier: AN60754
2026-03-30 07:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f27633e-4392-52f5-a025-6c743447e407 with scrape type 2
2026-03-30 07:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f27633e-4392-52f5-a025-6c743447e407 with scrape type 2
2026-03-30 07:41:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f27633e-4392-52f5-a025-6c743447e407, identifier: AN60754
2026-03-30 07:41:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f27633e-4392-52f5-a025-6c743447e407 with identifier: AN60754
2026-03-30 07:41:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f27633e-4392-52f5-a025-6c743447e407 with identifier: AN60754
2026-03-30 07:41:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f27633e-4392-52f5-a025-6c743447e407 with identifier: AN60754 to the API
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:57:59Z',
 'fuel_type': 'diesel',
 'id': '4f27633e-4392-52f5-a025-6c743447e407',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN60754',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 215679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-11',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Comfortline 4Motion',
 'transmission': 'automatic',
 'trim': 'Comfortline 4Motion',
 'year': 2017}
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN60754%27 HTTP/1.1" 200 None
2026-03-30 07:41:19 [auto1.de] INFO: Saving data for AN60754: {'auction_closing_time': 1774886279.0, 'created_time': 1773303102.493248, 'last_price_update_time': 1774856479.838379}
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN60754') HTTP/1.1" 204 0
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: NH81971
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: JF12446
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: PU44230
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: ER86835
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: MA20018
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: SU19428
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: UW74525
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: CP06642
2026-03-30 07:41:19 [auto1.de] INFO: Found listing with ID: EH70293
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH70293%27 HTTP/1.1" 200 None
2026-03-30 07:41:19 [auto1.de] INFO: Scrape type for EH70293: 2
2026-03-30 07:41:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5096be98-c956-52d2-9c9d-5d4321abb498 with identifier: EH70293
2026-03-30 07:41:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5096be98-c956-52d2-9c9d-5d4321abb498 with scrape type 2
2026-03-30 07:41:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5096be98-c956-52d2-9c9d-5d4321abb498 with scrape type 2
2026-03-30 07:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5096be98-c956-52d2-9c9d-5d4321abb498, identifier: EH70293
2026-03-30 07:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5096be98-c956-52d2-9c9d-5d4321abb498 with identifier: EH70293
2026-03-30 07:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5096be98-c956-52d2-9c9d-5d4321abb498 with identifier: EH70293
2026-03-30 07:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5096be98-c956-52d2-9c9d-5d4321abb498 with identifier: EH70293 to the API
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:01:30Z',
 'fuel_type': 'diesel',
 'id': '5096be98-c956-52d2-9c9d-5d4321abb498',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH70293',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 169562,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-05',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 316 CDI RWD L2',
 'transmission': 'automatic',
 'trim': 'RWD L2',
 'year': 2019}
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH70293%27 HTTP/1.1" 200 None
2026-03-30 07:41:20 [auto1.de] INFO: Saving data for EH70293: {'auction_closing_time': 1774882890.0, 'created_time': 1773230435.839494, 'last_price_update_time': 1774856480.366266}
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH70293') HTTP/1.1" 204 0
2026-03-30 07:41:20 [auto1.de] INFO: Found listing with ID: NR97756
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR97756%27 HTTP/1.1" 200 None
2026-03-30 07:41:20 [auto1.de] INFO: Scrape type for NR97756: 2
2026-03-30 07:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f5eccc5-331e-50a2-94ec-38e2591a2da3 with identifier: NR97756
2026-03-30 07:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f5eccc5-331e-50a2-94ec-38e2591a2da3 with scrape type 2
2026-03-30 07:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f5eccc5-331e-50a2-94ec-38e2591a2da3 with scrape type 2
2026-03-30 07:41:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f5eccc5-331e-50a2-94ec-38e2591a2da3, identifier: NR97756
2026-03-30 07:41:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f5eccc5-331e-50a2-94ec-38e2591a2da3 with identifier: NR97756
2026-03-30 07:41:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f5eccc5-331e-50a2-94ec-38e2591a2da3 with identifier: NR97756
2026-03-30 07:41:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f5eccc5-331e-50a2-94ec-38e2591a2da3 with identifier: NR97756 to the API
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:29:15Z',
 'fuel_type': 'petrol',
 'id': '6f5eccc5-331e-50a2-94ec-38e2591a2da3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR97756',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 100246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CGI BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR97756%27 HTTP/1.1" 200 None
2026-03-30 07:41:20 [auto1.de] INFO: Saving data for NR97756: {'auction_closing_time': 1774884555.0, 'created_time': 1773773675.30226, 'last_price_update_time': 1774856480.787556}
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR97756') HTTP/1.1" 204 0
2026-03-30 07:41:20 [auto1.de] INFO: Found listing with ID: YX40073
2026-03-30 07:41:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:20 [auto1.de] INFO: Channel: 24h | Page: 48 | totalHits: 8020 | hits on page: 40
2026-03-30 07:41:20 [auto1.de] INFO: Found listing with ID: LC05735
2026-03-30 07:41:20 [auto1.de] INFO: Found listing with ID: VH46900
2026-03-30 07:41:20 [auto1.de] INFO: Found listing with ID: FM78793
2026-03-30 07:41:20 [auto1.de] INFO: Found listing with ID: AW14620
2026-03-30 07:41:20 [auto1.de] INFO: Found listing with ID: ZN75041
2026-03-30 07:41:20 [auto1.de] INFO: Found listing with ID: XV57552
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV57552%27 HTTP/1.1" 200 None
2026-03-30 07:41:20 [auto1.de] INFO: Scrape type for XV57552: 2
2026-03-30 07:41:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fc5020f-a23d-520b-95f5-788f788a3591 with identifier: XV57552
2026-03-30 07:41:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fc5020f-a23d-520b-95f5-788f788a3591 with scrape type 2
2026-03-30 07:41:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fc5020f-a23d-520b-95f5-788f788a3591 with scrape type 2
2026-03-30 07:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fc5020f-a23d-520b-95f5-788f788a3591, identifier: XV57552
2026-03-30 07:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fc5020f-a23d-520b-95f5-788f788a3591 with identifier: XV57552
2026-03-30 07:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fc5020f-a23d-520b-95f5-788f788a3591 with identifier: XV57552
2026-03-30 07:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fc5020f-a23d-520b-95f5-788f788a3591 with identifier: XV57552 to the API
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:30:52Z',
 'fuel_type': 'petrol',
 'id': '1fc5020f-a23d-520b-95f5-788f788a3591',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV57552',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 22831,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-01',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2024}
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV57552%27 HTTP/1.1" 200 None
2026-03-30 07:41:21 [auto1.de] INFO: Saving data for XV57552: {'auction_closing_time': 1774884652.0, 'created_time': 1773306881.011495, 'last_price_update_time': 1774856481.343143}
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV57552') HTTP/1.1" 204 0
2026-03-30 07:41:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:21 [auto1.de] INFO: Found listing with ID: JX06129
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX06129%27 HTTP/1.1" 200 None
2026-03-30 07:41:21 [auto1.de] INFO: Scrape type for JX06129: 2
2026-03-30 07:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00df2826-9faa-59db-828b-5e77f937768d with identifier: JX06129
2026-03-30 07:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00df2826-9faa-59db-828b-5e77f937768d with scrape type 2
2026-03-30 07:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00df2826-9faa-59db-828b-5e77f937768d with scrape type 2
2026-03-30 07:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00df2826-9faa-59db-828b-5e77f937768d, identifier: JX06129
2026-03-30 07:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00df2826-9faa-59db-828b-5e77f937768d with identifier: JX06129
2026-03-30 07:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00df2826-9faa-59db-828b-5e77f937768d with identifier: JX06129
2026-03-30 07:41:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00df2826-9faa-59db-828b-5e77f937768d with identifier: JX06129 to the API
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:24:54Z',
 'fuel_type': 'petrol',
 'id': '00df2826-9faa-59db-828b-5e77f937768d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX06129',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 211635,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-30',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8 TSI Sportline',
 'transmission': 'manual',
 'trim': 'Sportline',
 'year': 2008}
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX06129%27 HTTP/1.1" 200 None
2026-03-30 07:41:21 [auto1.de] INFO: Saving data for JX06129: {'auction_closing_time': 1774884294.0, 'created_time': 1773307719.861102, 'last_price_update_time': 1774856481.850656}
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX06129') HTTP/1.1" 204 0
2026-03-30 07:41:21 [auto1.de] INFO: Found listing with ID: UW93361
2026-03-30 07:41:21 [auto1.de] INFO: Found listing with ID: YY00897
2026-03-30 07:41:21 [auto1.de] INFO: Found listing with ID: DE21080
2026-03-30 07:41:21 [auto1.de] INFO: Found listing with ID: ZP65093
2026-03-30 07:41:21 [auto1.de] INFO: Found listing with ID: JN49232
2026-03-30 07:41:21 [auto1.de] INFO: Found listing with ID: WX35600
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX35600%27 HTTP/1.1" 200 None
2026-03-30 07:41:21 [auto1.de] INFO: Scrape type for WX35600: 2
2026-03-30 07:41:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fabcc13f-405d-53e9-9fda-59e97554cc62 with identifier: WX35600
2026-03-30 07:41:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fabcc13f-405d-53e9-9fda-59e97554cc62 with scrape type 2
2026-03-30 07:41:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fabcc13f-405d-53e9-9fda-59e97554cc62 with scrape type 2
2026-03-30 07:41:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fabcc13f-405d-53e9-9fda-59e97554cc62, identifier: WX35600
2026-03-30 07:41:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fabcc13f-405d-53e9-9fda-59e97554cc62 with identifier: WX35600
2026-03-30 07:41:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fabcc13f-405d-53e9-9fda-59e97554cc62 with identifier: WX35600
2026-03-30 07:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fabcc13f-405d-53e9-9fda-59e97554cc62 with identifier: WX35600 to the API
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 408,
 'expiration_date': '2026-03-30T15:58:42Z',
 'fuel_type': 'petrol',
 'id': 'fabcc13f-405d-53e9-9fda-59e97554cc62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX35600',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 131527,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-01-10',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 500 BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2013}
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX35600%27 HTTP/1.1" 200 None
2026-03-30 07:41:22 [auto1.de] INFO: Saving data for WX35600: {'auction_closing_time': 1774886322.0, 'created_time': 1773302733.605533, 'last_price_update_time': 1774856482.274896}
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX35600') HTTP/1.1" 204 0
2026-03-30 07:41:22 [auto1.de] INFO: Found listing with ID: MH82983
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82983%27 HTTP/1.1" 200 None
2026-03-30 07:41:22 [auto1.de] INFO: Scrape type for MH82983: 2
2026-03-30 07:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200db09a-9b1f-5219-bf39-7f31d0729161 with identifier: MH82983
2026-03-30 07:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200db09a-9b1f-5219-bf39-7f31d0729161 with scrape type 2
2026-03-30 07:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 200db09a-9b1f-5219-bf39-7f31d0729161 with scrape type 2
2026-03-30 07:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 200db09a-9b1f-5219-bf39-7f31d0729161, identifier: MH82983
2026-03-30 07:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 200db09a-9b1f-5219-bf39-7f31d0729161 with identifier: MH82983
2026-03-30 07:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 200db09a-9b1f-5219-bf39-7f31d0729161 with identifier: MH82983
2026-03-30 07:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 200db09a-9b1f-5219-bf39-7f31d0729161 with identifier: MH82983 to the API
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:18Z',
 'fuel_type': 'petrol',
 'id': '200db09a-9b1f-5219-bf39-7f31d0729161',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH82983',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 159257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-31',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 GLS',
 'transmission': 'manual',
 'trim': 'GLS',
 'year': 2007}
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH82983%27 HTTP/1.1" 200 None
2026-03-30 07:41:22 [auto1.de] INFO: Saving data for MH82983: {'auction_closing_time': 1774884078.0, 'created_time': 1773345102.989379, 'last_price_update_time': 1774856482.679704}
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH82983') HTTP/1.1" 204 0
2026-03-30 07:41:22 [auto1.de] INFO: Found listing with ID: WV35399
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV35399%27 HTTP/1.1" 200 None
2026-03-30 07:41:22 [auto1.de] INFO: Scrape type for WV35399: 2
2026-03-30 07:41:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a73557d-b938-5666-bbe2-be2853c73031 with identifier: WV35399
2026-03-30 07:41:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a73557d-b938-5666-bbe2-be2853c73031 with scrape type 2
2026-03-30 07:41:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a73557d-b938-5666-bbe2-be2853c73031 with scrape type 2
2026-03-30 07:41:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a73557d-b938-5666-bbe2-be2853c73031, identifier: WV35399
2026-03-30 07:41:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a73557d-b938-5666-bbe2-be2853c73031 with identifier: WV35399
2026-03-30 07:41:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a73557d-b938-5666-bbe2-be2853c73031 with identifier: WV35399
2026-03-30 07:41:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a73557d-b938-5666-bbe2-be2853c73031 with identifier: WV35399 to the API
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:41:59Z',
 'fuel_type': 'diesel',
 'id': '1a73557d-b938-5666-bbe2-be2853c73031',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV35399',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 162400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seller_name': None,
 'title': 'Audi A5 Sportback 50 TDI Mild-Hybrid quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV35399%27 HTTP/1.1" 200 None
2026-03-30 07:41:23 [auto1.de] INFO: Saving data for WV35399: {'auction_closing_time': 1774885319.0, 'created_time': 1773831496.344256, 'last_price_update_time': 1774856483.097576}
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV35399') HTTP/1.1" 204 0
2026-03-30 07:41:23 [auto1.de] INFO: Found listing with ID: DF56561
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF56561%27 HTTP/1.1" 200 None
2026-03-30 07:41:23 [auto1.de] INFO: Scrape type for DF56561: 2
2026-03-30 07:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bbd4276-e34f-5cbb-859f-5859e41c3c1d with identifier: DF56561
2026-03-30 07:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bbd4276-e34f-5cbb-859f-5859e41c3c1d with scrape type 2
2026-03-30 07:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bbd4276-e34f-5cbb-859f-5859e41c3c1d with scrape type 2
2026-03-30 07:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0bbd4276-e34f-5cbb-859f-5859e41c3c1d, identifier: DF56561
2026-03-30 07:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0bbd4276-e34f-5cbb-859f-5859e41c3c1d with identifier: DF56561
2026-03-30 07:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0bbd4276-e34f-5cbb-859f-5859e41c3c1d with identifier: DF56561
2026-03-30 07:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0bbd4276-e34f-5cbb-859f-5859e41c3c1d with identifier: DF56561 to the API
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:37:51Z',
 'fuel_type': 'petrol',
 'id': '0bbd4276-e34f-5cbb-859f-5859e41c3c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF56561',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 135250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-12',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2012}
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF56561%27 HTTP/1.1" 200 None
2026-03-30 07:41:23 [auto1.de] INFO: Saving data for DF56561: {'auction_closing_time': 1774885071.0, 'created_time': 1773345591.734354, 'last_price_update_time': 1774856483.505349}
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF56561') HTTP/1.1" 204 0
2026-03-30 07:41:23 [auto1.de] INFO: Found listing with ID: ZT07846
2026-03-30 07:41:23 [auto1.de] INFO: Found listing with ID: WG75781
2026-03-30 07:41:23 [auto1.de] INFO: Found listing with ID: MM39918
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM39918%27 HTTP/1.1" 200 None
2026-03-30 07:41:23 [auto1.de] INFO: Scrape type for MM39918: 2
2026-03-30 07:41:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ae2893e-bbca-5c0f-bc5c-7ffd5d19055f with identifier: MM39918
2026-03-30 07:41:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ae2893e-bbca-5c0f-bc5c-7ffd5d19055f with scrape type 2
2026-03-30 07:41:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ae2893e-bbca-5c0f-bc5c-7ffd5d19055f with scrape type 2
2026-03-30 07:41:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ae2893e-bbca-5c0f-bc5c-7ffd5d19055f, identifier: MM39918
2026-03-30 07:41:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ae2893e-bbca-5c0f-bc5c-7ffd5d19055f with identifier: MM39918
2026-03-30 07:41:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ae2893e-bbca-5c0f-bc5c-7ffd5d19055f with identifier: MM39918
2026-03-30 07:41:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ae2893e-bbca-5c0f-bc5c-7ffd5d19055f with identifier: MM39918 to the API
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:01:34Z',
 'fuel_type': 'petrol',
 'id': '4ae2893e-bbca-5c0f-bc5c-7ffd5d19055f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM39918',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 19409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-14',
 'seller_name': None,
 'title': 'Audi Q3 35 TFSI Mild-Hybrid ACT',
 'transmission': 'automatic',
 'trim': 'ACT',
 'year': 2021}
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM39918%27 HTTP/1.1" 200 None
2026-03-30 07:41:23 [auto1.de] INFO: Saving data for MM39918: {'auction_closing_time': 1774882894.0, 'created_time': 1774379201.104027, 'last_price_update_time': 1774856483.923026}
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM39918') HTTP/1.1" 204 0
2026-03-30 07:41:24 [auto1.de] INFO: Found listing with ID: ZR25455
2026-03-30 07:41:24 [auto1.de] INFO: Found listing with ID: AF95202
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF95202%27 HTTP/1.1" 200 None
2026-03-30 07:41:24 [auto1.de] INFO: Scrape type for AF95202: 2
2026-03-30 07:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1b86ec0-a34e-549f-be90-2f2102880eb4 with identifier: AF95202
2026-03-30 07:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1b86ec0-a34e-549f-be90-2f2102880eb4 with scrape type 2
2026-03-30 07:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1b86ec0-a34e-549f-be90-2f2102880eb4 with scrape type 2
2026-03-30 07:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1b86ec0-a34e-549f-be90-2f2102880eb4, identifier: AF95202
2026-03-30 07:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1b86ec0-a34e-549f-be90-2f2102880eb4 with identifier: AF95202
2026-03-30 07:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1b86ec0-a34e-549f-be90-2f2102880eb4 with identifier: AF95202
2026-03-30 07:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1b86ec0-a34e-549f-be90-2f2102880eb4 with identifier: AF95202 to the API
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:46:35Z',
 'fuel_type': 'petrol',
 'id': 'd1b86ec0-a34e-549f-be90-2f2102880eb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF95202',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 83956,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-19',
 'seller_name': None,
 'title': 'Jaguar F-Pace 25t Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2018}
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF95202%27 HTTP/1.1" 200 None
2026-03-30 07:41:24 [auto1.de] INFO: Saving data for AF95202: {'auction_closing_time': 1774885595.0, 'created_time': 1773772970.879474, 'last_price_update_time': 1774856484.443102}
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF95202') HTTP/1.1" 204 0
2026-03-30 07:41:24 [auto1.de] INFO: Found listing with ID: YJ88627
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ88627%27 HTTP/1.1" 200 None
2026-03-30 07:41:24 [auto1.de] INFO: Scrape type for YJ88627: 2
2026-03-30 07:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd50ab77-5f49-5db5-8a9c-004d22ec3718 with identifier: YJ88627
2026-03-30 07:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd50ab77-5f49-5db5-8a9c-004d22ec3718 with scrape type 2
2026-03-30 07:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd50ab77-5f49-5db5-8a9c-004d22ec3718 with scrape type 2
2026-03-30 07:41:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd50ab77-5f49-5db5-8a9c-004d22ec3718, identifier: YJ88627
2026-03-30 07:41:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd50ab77-5f49-5db5-8a9c-004d22ec3718 with identifier: YJ88627
2026-03-30 07:41:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd50ab77-5f49-5db5-8a9c-004d22ec3718 with identifier: YJ88627
2026-03-30 07:41:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd50ab77-5f49-5db5-8a9c-004d22ec3718 with identifier: YJ88627 to the API
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:17:33Z',
 'fuel_type': 'petrol',
 'id': 'dd50ab77-5f49-5db5-8a9c-004d22ec3718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ88627',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 175787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-30',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 250 4Matic Motorsport Edition AMG Sport',
 'transmission': 'automatic',
 'trim': '4Matic Motorsport Edition AMG Sport',
 'year': 2015}
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ88627%27 HTTP/1.1" 200 None
2026-03-30 07:41:24 [auto1.de] INFO: Saving data for YJ88627: {'auction_closing_time': 1774883853.0, 'created_time': 1773831590.058711, 'last_price_update_time': 1774856484.935985}
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ88627') HTTP/1.1" 204 0
2026-03-30 07:41:24 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-30 07:41:24 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-30 07:41:24 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV17111%27 HTTP/1.1" 200 None
2026-03-30 07:41:24 [auto1.de] INFO: Scrape type for XV17111: 2
2026-03-30 07:41:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f85d705b-8eb6-50a0-ab26-edbc86707cd5 with identifier: XV17111
2026-03-30 07:41:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f85d705b-8eb6-50a0-ab26-edbc86707cd5 with scrape type 2
2026-03-30 07:41:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f85d705b-8eb6-50a0-ab26-edbc86707cd5 with scrape type 2
2026-03-30 07:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f85d705b-8eb6-50a0-ab26-edbc86707cd5, identifier: XV17111
2026-03-30 07:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f85d705b-8eb6-50a0-ab26-edbc86707cd5 with identifier: XV17111
2026-03-30 07:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f85d705b-8eb6-50a0-ab26-edbc86707cd5 with identifier: XV17111
2026-03-30 07:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f85d705b-8eb6-50a0-ab26-edbc86707cd5 with identifier: XV17111 to the API
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:58:36Z',
 'fuel_type': 'hybrid',
 'id': 'f85d705b-8eb6-50a0-ab26-edbc86707cd5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV17111',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 28698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-21',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2021}
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV17111%27 HTTP/1.1" 200 None
2026-03-30 07:41:25 [auto1.de] INFO: Saving data for XV17111: {'auction_closing_time': 1774886316.0, 'created_time': 1773831285.169982, 'last_price_update_time': 1774856485.346059}
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV17111') HTTP/1.1" 204 0
2026-03-30 07:41:25 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01319%27 HTTP/1.1" 200 None
2026-03-30 07:41:25 [auto1.de] INFO: Scrape type for DV01319: 2
2026-03-30 07:41:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f22bdcdf-71b5-54b1-83ea-5125b7963d26 with identifier: DV01319
2026-03-30 07:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f22bdcdf-71b5-54b1-83ea-5125b7963d26 with scrape type 2
2026-03-30 07:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f22bdcdf-71b5-54b1-83ea-5125b7963d26 with scrape type 2
2026-03-30 07:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f22bdcdf-71b5-54b1-83ea-5125b7963d26, identifier: DV01319
2026-03-30 07:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f22bdcdf-71b5-54b1-83ea-5125b7963d26 with identifier: DV01319
2026-03-30 07:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f22bdcdf-71b5-54b1-83ea-5125b7963d26 with identifier: DV01319
2026-03-30 07:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f22bdcdf-71b5-54b1-83ea-5125b7963d26 with identifier: DV01319 to the API
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:58:51Z',
 'fuel_type': 'diesel',
 'id': 'f22bdcdf-71b5-54b1-83ea-5125b7963d26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV01319',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 340284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-10',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion',
 'transmission': 'automatic',
 'trim': 'Business Edition BlueMotion',
 'year': 2014}
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01319%27 HTTP/1.1" 200 None
2026-03-30 07:41:25 [auto1.de] INFO: Saving data for DV01319: {'auction_closing_time': 1774886331.0, 'created_time': 1773228893.58388, 'last_price_update_time': 1774856485.745736}
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV01319') HTTP/1.1" 204 0
2026-03-30 07:41:25 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76820%27 HTTP/1.1" 200 None
2026-03-30 07:41:25 [auto1.de] INFO: Scrape type for EW76820: 2
2026-03-30 07:41:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with identifier: EW76820
2026-03-30 07:41:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with scrape type 2
2026-03-30 07:41:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with scrape type 2
2026-03-30 07:41:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6d78fca-0ccf-556f-a814-b1f2fd005cd4, identifier: EW76820
2026-03-30 07:41:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with identifier: EW76820
2026-03-30 07:41:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with identifier: EW76820
2026-03-30 07:41:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6d78fca-0ccf-556f-a814-b1f2fd005cd4 with identifier: EW76820 to the API
2026-03-30 07:41:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:00:15Z',
 'fuel_type': 'diesel',
 'id': 'b6d78fca-0ccf-556f-a814-b1f2fd005cd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW76820',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 140632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-06',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI SportLine',
 'transmission': 'automatic',
 'trim': 'SportLine',
 'year': 2019}
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76820%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Saving data for EW76820: {'auction_closing_time': 1774882815.0, 'created_time': 1773226322.388167, 'last_price_update_time': 1774856486.15743}
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW76820') HTTP/1.1" 204 0
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK52723%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for JK52723: 2
2026-03-30 07:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a464ab33-d1b2-5857-9311-42fccdbf3cb9 with identifier: JK52723
2026-03-30 07:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a464ab33-d1b2-5857-9311-42fccdbf3cb9 with scrape type 2
2026-03-30 07:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a464ab33-d1b2-5857-9311-42fccdbf3cb9 with scrape type 2
2026-03-30 07:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a464ab33-d1b2-5857-9311-42fccdbf3cb9, identifier: JK52723
2026-03-30 07:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a464ab33-d1b2-5857-9311-42fccdbf3cb9 with identifier: JK52723
2026-03-30 07:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a464ab33-d1b2-5857-9311-42fccdbf3cb9 with identifier: JK52723
2026-03-30 07:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a464ab33-d1b2-5857-9311-42fccdbf3cb9 with identifier: JK52723 to the API
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:02:07Z',
 'fuel_type': 'petrol',
 'id': 'a464ab33-d1b2-5857-9311-42fccdbf3cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK52723',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 67869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK52723%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Saving data for JK52723: {'auction_closing_time': 1774882927.0, 'created_time': 1773306603.499724, 'last_price_update_time': 1774856486.593594}
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JK52723') HTTP/1.1" 204 0
2026-03-30 07:41:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: GJ78269
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-30 07:41:26 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR38931%27 HTTP/1.1" 200 None
2026-03-30 07:41:26 [auto1.de] INFO: Scrape type for GR38931: 2
2026-03-30 07:41:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0465093-343d-5765-a513-88314dfeba45 with identifier: GR38931
2026-03-30 07:41:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0465093-343d-5765-a513-88314dfeba45 with scrape type 2
2026-03-30 07:41:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0465093-343d-5765-a513-88314dfeba45 with scrape type 2
2026-03-30 07:41:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0465093-343d-5765-a513-88314dfeba45, identifier: GR38931
2026-03-30 07:41:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0465093-343d-5765-a513-88314dfeba45 with identifier: GR38931
2026-03-30 07:41:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0465093-343d-5765-a513-88314dfeba45 with identifier: GR38931
2026-03-30 07:41:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0465093-343d-5765-a513-88314dfeba45 with identifier: GR38931 to the API
2026-03-30 07:41:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-30T15:51:16Z',
 'fuel_type': 'petrol',
 'id': 'e0465093-343d-5765-a513-88314dfeba45',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR38931',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 54996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-09',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T N-Way',
 'transmission': 'manual',
 'trim': 'N-Way',
 'year': 2020}
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR38931%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Saving data for GR38931: {'auction_closing_time': 1774885876.0, 'created_time': 1773230343.995948, 'last_price_update_time': 1774856487.346422}
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR38931') HTTP/1.1" 204 0
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS91363%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Scrape type for FS91363: 2
2026-03-30 07:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c71dc0c3-9853-5206-aea5-e722152d92e8 with identifier: FS91363
2026-03-30 07:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c71dc0c3-9853-5206-aea5-e722152d92e8 with scrape type 2
2026-03-30 07:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c71dc0c3-9853-5206-aea5-e722152d92e8 with scrape type 2
2026-03-30 07:41:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c71dc0c3-9853-5206-aea5-e722152d92e8, identifier: FS91363
2026-03-30 07:41:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c71dc0c3-9853-5206-aea5-e722152d92e8 with identifier: FS91363
2026-03-30 07:41:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c71dc0c3-9853-5206-aea5-e722152d92e8 with identifier: FS91363
2026-03-30 07:41:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c71dc0c3-9853-5206-aea5-e722152d92e8 with identifier: FS91363 to the API
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:21:33Z',
 'fuel_type': 'diesel',
 'id': 'c71dc0c3-9853-5206-aea5-e722152d92e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS91363',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 134450,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-12',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 HDi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2009}
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS91363%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Saving data for FS91363: {'auction_closing_time': 1774884093.0, 'created_time': 1773230577.262544, 'last_price_update_time': 1774856487.915597}
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS91363') HTTP/1.1" 204 0
2026-03-30 07:41:27 [auto1.de] INFO: Channel: 24h | Page: 49 | totalHits: 8038 | hits on page: 40
2026-03-30 07:41:27 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ86702%27 HTTP/1.1" 200 None
2026-03-30 07:41:27 [auto1.de] INFO: Scrape type for AZ86702: 2
2026-03-30 07:41:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4085fc28-372d-558b-95ad-777b7badbeb6 with identifier: AZ86702
2026-03-30 07:41:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4085fc28-372d-558b-95ad-777b7badbeb6 with scrape type 2
2026-03-30 07:41:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4085fc28-372d-558b-95ad-777b7badbeb6 with scrape type 2
2026-03-30 07:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4085fc28-372d-558b-95ad-777b7badbeb6, identifier: AZ86702
2026-03-30 07:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4085fc28-372d-558b-95ad-777b7badbeb6 with identifier: AZ86702
2026-03-30 07:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4085fc28-372d-558b-95ad-777b7badbeb6 with identifier: AZ86702
2026-03-30 07:41:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4085fc28-372d-558b-95ad-777b7badbeb6 with identifier: AZ86702 to the API
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:42Z',
 'fuel_type': 'diesel',
 'id': '4085fc28-372d-558b-95ad-777b7badbeb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ86702',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 112472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-19',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2018}
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ86702%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Saving data for AZ86702: {'auction_closing_time': 1774886382.0, 'created_time': 1773229146.59889, 'last_price_update_time': 1774856488.446066}
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ86702') HTTP/1.1" 204 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: LT54057
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: VY54552
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: XV17111
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV17111%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for XV17111: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: DV01319
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV01319%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for DV01319: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: EW76820
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW76820%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for EW76820: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: JK52723
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK52723%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for JK52723: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: GJ78269
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: HW71141
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: GR38931
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR38931%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for GR38931: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: FS91363
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS91363%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for FS91363: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: AZ86702
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ86702%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for AZ86702: 0
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39968%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for ZR39968: 2
2026-03-30 07:41:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 836be76b-a6ba-5107-aaf9-dddbb4b82082 with identifier: ZR39968
2026-03-30 07:41:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 836be76b-a6ba-5107-aaf9-dddbb4b82082 with scrape type 2
2026-03-30 07:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 836be76b-a6ba-5107-aaf9-dddbb4b82082 with scrape type 2
2026-03-30 07:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 836be76b-a6ba-5107-aaf9-dddbb4b82082, identifier: ZR39968
2026-03-30 07:41:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: EM69554
2026-03-30 07:41:28 [auto1.de] INFO: Found listing with ID: ZR39968
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39968%27 HTTP/1.1" 200 None
2026-03-30 07:41:28 [auto1.de] INFO: Scrape type for ZR39968: 2
2026-03-30 07:41:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 836be76b-a6ba-5107-aaf9-dddbb4b82082 with scrape type 2
2026-03-30 07:41:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 836be76b-a6ba-5107-aaf9-dddbb4b82082 with scrape type 2
2026-03-30 07:41:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 836be76b-a6ba-5107-aaf9-dddbb4b82082, identifier: ZR39968
2026-03-30 07:41:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 836be76b-a6ba-5107-aaf9-dddbb4b82082 with identifier: ZR39968
2026-03-30 07:41:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 836be76b-a6ba-5107-aaf9-dddbb4b82082 with identifier: ZR39968
2026-03-30 07:41:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 836be76b-a6ba-5107-aaf9-dddbb4b82082 with identifier: ZR39968 to the API
2026-03-30 07:41:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:50Z',
 'fuel_type': 'petrol',
 'id': '836be76b-a6ba-5107-aaf9-dddbb4b82082',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR39968',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 190168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-01',
 'seller_name': None,
 'title': 'Opel Astra 1.8 CATCH ME',
 'transmission': 'manual',
 'trim': 'CATCH ME',
 'year': 2007}
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39968%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Saving data for ZR39968: {'auction_closing_time': 1774884110.0, 'created_time': 1773306592.653282, 'last_price_update_time': 1774856489.115115}
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR39968') HTTP/1.1" 204 0
2026-03-30 07:41:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 836be76b-a6ba-5107-aaf9-dddbb4b82082 with identifier: ZR39968
2026-03-30 07:41:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 836be76b-a6ba-5107-aaf9-dddbb4b82082 with identifier: ZR39968
2026-03-30 07:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 836be76b-a6ba-5107-aaf9-dddbb4b82082 with identifier: ZR39968 to the API
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:50Z',
 'fuel_type': 'petrol',
 'id': '836be76b-a6ba-5107-aaf9-dddbb4b82082',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR39968',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 190168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-01',
 'seller_name': None,
 'title': 'Opel Astra 1.8 CATCH ME',
 'transmission': 'manual',
 'trim': 'CATCH ME',
 'year': 2007}
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR39968%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Saving data for ZR39968: {'auction_closing_time': 1774884110.0, 'created_time': 1773306592.653282, 'last_price_update_time': 1774856489.504277}
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR39968') HTTP/1.1" 204 0
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: XT69734
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL85371%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for PL85371: 2
2026-03-30 07:41:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dabe069-e2aa-51ef-821c-2037146773e2 with identifier: PL85371
2026-03-30 07:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dabe069-e2aa-51ef-821c-2037146773e2 with scrape type 2
2026-03-30 07:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dabe069-e2aa-51ef-821c-2037146773e2 with scrape type 2
2026-03-30 07:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5dabe069-e2aa-51ef-821c-2037146773e2, identifier: PL85371
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: EU39655
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: RV72867
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: TX59054
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: XT69734
2026-03-30 07:41:29 [auto1.de] INFO: Found listing with ID: PL85371
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL85371%27 HTTP/1.1" 200 None
2026-03-30 07:41:29 [auto1.de] INFO: Scrape type for PL85371: 2
2026-03-30 07:41:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dabe069-e2aa-51ef-821c-2037146773e2 with scrape type 2
2026-03-30 07:41:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dabe069-e2aa-51ef-821c-2037146773e2 with scrape type 2
2026-03-30 07:41:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5dabe069-e2aa-51ef-821c-2037146773e2, identifier: PL85371
2026-03-30 07:41:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5dabe069-e2aa-51ef-821c-2037146773e2 with identifier: PL85371
2026-03-30 07:41:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5dabe069-e2aa-51ef-821c-2037146773e2 with identifier: PL85371
2026-03-30 07:41:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5dabe069-e2aa-51ef-821c-2037146773e2 with identifier: PL85371 to the API
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:52Z',
 'fuel_type': 'diesel',
 'id': '5dabe069-e2aa-51ef-821c-2037146773e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL85371',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 131599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-02',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2018}
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL85371%27 HTTP/1.1" 200 None
2026-03-30 07:41:30 [auto1.de] INFO: Saving data for PL85371: {'auction_closing_time': 1774883152.0, 'created_time': 1773136313.067798, 'last_price_update_time': 1774856490.062222}
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL85371') HTTP/1.1" 204 0
2026-03-30 07:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5dabe069-e2aa-51ef-821c-2037146773e2 with identifier: PL85371
2026-03-30 07:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5dabe069-e2aa-51ef-821c-2037146773e2 with identifier: PL85371
2026-03-30 07:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5dabe069-e2aa-51ef-821c-2037146773e2 with identifier: PL85371 to the API
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:52Z',
 'fuel_type': 'diesel',
 'id': '5dabe069-e2aa-51ef-821c-2037146773e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL85371',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 131599,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-02',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2018}
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL85371%27 HTTP/1.1" 200 None
2026-03-30 07:41:30 [auto1.de] INFO: Saving data for PL85371: {'auction_closing_time': 1774883152.0, 'created_time': 1773136313.067798, 'last_price_update_time': 1774856490.361546}
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL85371') HTTP/1.1" 204 0
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: UP89204
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: TZ11746
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: XF01324
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: SL35659
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL35659%27 HTTP/1.1" 200 None
2026-03-30 07:41:30 [auto1.de] INFO: Scrape type for SL35659: 2
2026-03-30 07:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c327c553-d7cb-5a1a-954f-ae7c4c45a70d with identifier: SL35659
2026-03-30 07:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c327c553-d7cb-5a1a-954f-ae7c4c45a70d with scrape type 2
2026-03-30 07:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c327c553-d7cb-5a1a-954f-ae7c4c45a70d with scrape type 2
2026-03-30 07:41:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c327c553-d7cb-5a1a-954f-ae7c4c45a70d, identifier: SL35659
2026-03-30 07:41:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c327c553-d7cb-5a1a-954f-ae7c4c45a70d with identifier: SL35659
2026-03-30 07:41:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c327c553-d7cb-5a1a-954f-ae7c4c45a70d with identifier: SL35659
2026-03-30 07:41:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c327c553-d7cb-5a1a-954f-ae7c4c45a70d with identifier: SL35659 to the API
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:21:23Z',
 'fuel_type': 'diesel',
 'id': 'c327c553-d7cb-5a1a-954f-ae7c4c45a70d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL35659',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 171509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-31',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Wildtrak',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Wildtrak',
 'year': 2019}
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL35659%27 HTTP/1.1" 200 None
2026-03-30 07:41:30 [auto1.de] INFO: Saving data for SL35659: {'auction_closing_time': 1774884083.0, 'created_time': 1773342857.357318, 'last_price_update_time': 1774856490.791792}
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL35659') HTTP/1.1" 204 0
2026-03-30 07:41:30 [auto1.de] INFO: Found listing with ID: GJ17165
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17165%27 HTTP/1.1" 200 None
2026-03-30 07:41:30 [auto1.de] INFO: Scrape type for GJ17165: 2
2026-03-30 07:41:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with identifier: GJ17165
2026-03-30 07:41:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with scrape type 2
2026-03-30 07:41:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with scrape type 2
2026-03-30 07:41:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed, identifier: GJ17165
2026-03-30 07:41:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with identifier: GJ17165
2026-03-30 07:41:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with identifier: GJ17165
2026-03-30 07:41:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3312acc6-51f5-5b01-a8b7-fa7ebd2513ed with identifier: GJ17165 to the API
2026-03-30 07:41:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 117,
 'expiration_date': '2026-03-30T15:32:06Z',
 'fuel_type': 'petrol',
 'id': '3312acc6-51f5-5b01-a8b7-fa7ebd2513ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ17165',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'ASX',
 'odometer': 89105,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-12',
 'seller_name': None,
 'title': 'Mitsubishi ASX 1.6 Diamant Edition+ 2WD',
 'transmission': 'manual',
 'trim': 'Diamant Edition+ 2WD',
 'year': 2018}
2026-03-30 07:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17165%27 HTTP/1.1" 200 None
2026-03-30 07:41:31 [auto1.de] INFO: Saving data for GJ17165: {'auction_closing_time': 1774884726.0, 'created_time': 1773380668.996596, 'last_price_update_time': 1774856491.785494}
2026-03-30 07:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ17165') HTTP/1.1" 204 0
2026-03-30 07:41:31 [auto1.de] INFO: Found listing with ID: VF37611
2026-03-30 07:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF37611%27 HTTP/1.1" 200 None
2026-03-30 07:41:31 [auto1.de] INFO: Scrape type for VF37611: 2
2026-03-30 07:41:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with identifier: VF37611
2026-03-30 07:41:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with scrape type 2
2026-03-30 07:41:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with scrape type 2
2026-03-30 07:41:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57a0f6cd-3f7a-5ed5-a643-3f52e072451f, identifier: VF37611
2026-03-30 07:41:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with identifier: VF37611
2026-03-30 07:41:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with identifier: VF37611
2026-03-30 07:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57a0f6cd-3f7a-5ed5-a643-3f52e072451f with identifier: VF37611 to the API
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:36:18Z',
 'fuel_type': 'petrol',
 'id': '57a0f6cd-3f7a-5ed5-a643-3f52e072451f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF37611',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 155495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-25',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF37611%27 HTTP/1.1" 200 None
2026-03-30 07:41:32 [auto1.de] INFO: Saving data for VF37611: {'auction_closing_time': 1774884978.0, 'created_time': 1773305150.441688, 'last_price_update_time': 1774856492.316948}
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VF37611') HTTP/1.1" 204 0
2026-03-30 07:41:32 [auto1.de] INFO: Found listing with ID: ZK08136
2026-03-30 07:41:32 [auto1.de] INFO: Found listing with ID: ZU15284
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU15284%27 HTTP/1.1" 200 None
2026-03-30 07:41:32 [auto1.de] INFO: Scrape type for ZU15284: 0
2026-03-30 07:41:32 [auto1.de] INFO: Found listing with ID: VS05622
2026-03-30 07:41:32 [auto1.de] INFO: Found listing with ID: CU27746
2026-03-30 07:41:32 [auto1.de] INFO: Found listing with ID: UN73859
2026-03-30 07:41:32 [auto1.de] INFO: Found listing with ID: VG22194
2026-03-30 07:41:32 [auto1.de] INFO: Found listing with ID: VH01397
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH01397%27 HTTP/1.1" 200 None
2026-03-30 07:41:32 [auto1.de] INFO: Scrape type for VH01397: 2
2026-03-30 07:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad2e186c-b480-5f79-847b-953c028dbf47 with identifier: VH01397
2026-03-30 07:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad2e186c-b480-5f79-847b-953c028dbf47 with scrape type 2
2026-03-30 07:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad2e186c-b480-5f79-847b-953c028dbf47 with scrape type 2
2026-03-30 07:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ad2e186c-b480-5f79-847b-953c028dbf47, identifier: VH01397
2026-03-30 07:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ad2e186c-b480-5f79-847b-953c028dbf47 with identifier: VH01397
2026-03-30 07:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ad2e186c-b480-5f79-847b-953c028dbf47 with identifier: VH01397
2026-03-30 07:41:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ad2e186c-b480-5f79-847b-953c028dbf47 with identifier: VH01397 to the API
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:33Z',
 'fuel_type': 'petrol',
 'id': 'ad2e186c-b480-5f79-847b-953c028dbf47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH01397',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 66558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH01397%27 HTTP/1.1" 200 None
2026-03-30 07:41:32 [auto1.de] INFO: Saving data for VH01397: {'auction_closing_time': 1774884813.0, 'created_time': 1773307120.436193, 'last_price_update_time': 1774856492.767968}
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH01397') HTTP/1.1" 204 0
2026-03-30 07:41:32 [auto1.de] INFO: Found listing with ID: FD54213
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD54213%27 HTTP/1.1" 200 None
2026-03-30 07:41:32 [auto1.de] INFO: Scrape type for FD54213: 2
2026-03-30 07:41:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with identifier: FD54213
2026-03-30 07:41:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with scrape type 2
2026-03-30 07:41:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with scrape type 2
2026-03-30 07:41:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c, identifier: FD54213
2026-03-30 07:41:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with identifier: FD54213
2026-03-30 07:41:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with identifier: FD54213
2026-03-30 07:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f0fd128-9a4b-5164-818f-ca54c1a5dd4c with identifier: FD54213 to the API
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:57:54Z',
 'fuel_type': 'petrol',
 'id': '8f0fd128-9a4b-5164-818f-ca54c1a5dd4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD54213',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 161551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-15',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 T Kinetic',
 'transmission': 'automatic',
 'trim': 'Kinetic',
 'year': 2010}
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD54213%27 HTTP/1.1" 200 None
2026-03-30 07:41:33 [auto1.de] INFO: Saving data for FD54213: {'auction_closing_time': 1774886274.0, 'created_time': 1773229186.694577, 'last_price_update_time': 1774856493.191696}
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FD54213') HTTP/1.1" 204 0
2026-03-30 07:41:33 [auto1.de] INFO: Found listing with ID: UR30493
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR30493%27 HTTP/1.1" 200 None
2026-03-30 07:41:33 [auto1.de] INFO: Scrape type for UR30493: 2
2026-03-30 07:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with identifier: UR30493
2026-03-30 07:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with scrape type 2
2026-03-30 07:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with scrape type 2
2026-03-30 07:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d42c80c-8f1d-5e61-aa50-545713ace3d5, identifier: UR30493
2026-03-30 07:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with identifier: UR30493
2026-03-30 07:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with identifier: UR30493
2026-03-30 07:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d42c80c-8f1d-5e61-aa50-545713ace3d5 with identifier: UR30493 to the API
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:06:53Z',
 'fuel_type': 'diesel',
 'id': '9d42c80c-8f1d-5e61-aa50-545713ace3d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR30493',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 37537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-09',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2024}
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR30493%27 HTTP/1.1" 200 None
2026-03-30 07:41:33 [auto1.de] INFO: Saving data for UR30493: {'auction_closing_time': 1774883213.0, 'created_time': 1773138482.550801, 'last_price_update_time': 1774856493.606383}
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR30493') HTTP/1.1" 204 0
2026-03-30 07:41:33 [auto1.de] INFO: Found listing with ID: JY95314
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY95314%27 HTTP/1.1" 200 None
2026-03-30 07:41:33 [auto1.de] INFO: Scrape type for JY95314: 2
2026-03-30 07:41:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1759de39-4886-5a05-abf4-3a5f6dd05d6a with identifier: JY95314
2026-03-30 07:41:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1759de39-4886-5a05-abf4-3a5f6dd05d6a with scrape type 2
2026-03-30 07:41:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1759de39-4886-5a05-abf4-3a5f6dd05d6a with scrape type 2
2026-03-30 07:41:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1759de39-4886-5a05-abf4-3a5f6dd05d6a, identifier: JY95314
2026-03-30 07:41:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1759de39-4886-5a05-abf4-3a5f6dd05d6a with identifier: JY95314
2026-03-30 07:41:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1759de39-4886-5a05-abf4-3a5f6dd05d6a with identifier: JY95314
2026-03-30 07:41:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1759de39-4886-5a05-abf4-3a5f6dd05d6a with identifier: JY95314 to the API
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-30T15:35:42Z',
 'fuel_type': 'petrol',
 'id': '1759de39-4886-5a05-abf4-3a5f6dd05d6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY95314',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 178544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-08',
 'seller_name': None,
 'title': 'Audi A6 3.2 V6 FSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY95314%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Saving data for JY95314: {'auction_closing_time': 1774884942.0, 'created_time': 1773341673.329699, 'last_price_update_time': 1774856494.115118}
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY95314') HTTP/1.1" 204 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: ZR98160
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98160%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for ZR98160: 2
2026-03-30 07:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5afa1e3-9307-5a51-990c-3822930180ab with identifier: ZR98160
2026-03-30 07:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5afa1e3-9307-5a51-990c-3822930180ab with scrape type 2
2026-03-30 07:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5afa1e3-9307-5a51-990c-3822930180ab with scrape type 2
2026-03-30 07:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5afa1e3-9307-5a51-990c-3822930180ab, identifier: ZR98160
2026-03-30 07:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5afa1e3-9307-5a51-990c-3822930180ab with identifier: ZR98160
2026-03-30 07:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5afa1e3-9307-5a51-990c-3822930180ab with identifier: ZR98160
2026-03-30 07:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5afa1e3-9307-5a51-990c-3822930180ab with identifier: ZR98160 to the API
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:26Z',
 'fuel_type': 'diesel',
 'id': 'c5afa1e3-9307-5a51-990c-3822930180ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZR98160',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 129590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-17',
 'seller_name': None,
 'title': 'Audi Q5 40 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR98160%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Saving data for ZR98160: {'auction_closing_time': 1774884446.0, 'created_time': 1772547039.918525, 'last_price_update_time': 1774856494.579771}
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZR98160') HTTP/1.1" 204 0
2026-03-30 07:41:34 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM33807%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Scrape type for AM33807: 2
2026-03-30 07:41:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e37e754-42b3-5ab1-b311-4b3b43ba8b67 with identifier: AM33807
2026-03-30 07:41:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e37e754-42b3-5ab1-b311-4b3b43ba8b67 with scrape type 2
2026-03-30 07:41:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e37e754-42b3-5ab1-b311-4b3b43ba8b67 with scrape type 2
2026-03-30 07:41:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e37e754-42b3-5ab1-b311-4b3b43ba8b67, identifier: AM33807
2026-03-30 07:41:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e37e754-42b3-5ab1-b311-4b3b43ba8b67 with identifier: AM33807
2026-03-30 07:41:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e37e754-42b3-5ab1-b311-4b3b43ba8b67 with identifier: AM33807
2026-03-30 07:41:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e37e754-42b3-5ab1-b311-4b3b43ba8b67 with identifier: AM33807 to the API
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:41:54Z',
 'fuel_type': 'petrol',
 'id': '4e37e754-42b3-5ab1-b311-4b3b43ba8b67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM33807',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 26921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-25',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI United',
 'transmission': 'automatic',
 'trim': 'United',
 'year': 2021}
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM33807%27 HTTP/1.1" 200 None
2026-03-30 07:41:34 [auto1.de] INFO: Saving data for AM33807: {'auction_closing_time': 1774885314.0, 'created_time': 1772728915.612293, 'last_price_update_time': 1774856494.995324}
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM33807') HTTP/1.1" 204 0
2026-03-30 07:41:35 [auto1.de] INFO: Channel: 24h | Page: 50 | totalHits: 8043 | hits on page: 40
2026-03-30 07:41:35 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-30 07:41:35 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG97845%27 HTTP/1.1" 200 None
2026-03-30 07:41:35 [auto1.de] INFO: Scrape type for MG97845: 2
2026-03-30 07:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 534bbd99-f448-5cf5-b1d9-c23780c8c2fe with identifier: MG97845
2026-03-30 07:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 534bbd99-f448-5cf5-b1d9-c23780c8c2fe with scrape type 2
2026-03-30 07:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 534bbd99-f448-5cf5-b1d9-c23780c8c2fe with scrape type 2
2026-03-30 07:41:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 534bbd99-f448-5cf5-b1d9-c23780c8c2fe, identifier: MG97845
2026-03-30 07:41:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 534bbd99-f448-5cf5-b1d9-c23780c8c2fe with identifier: MG97845
2026-03-30 07:41:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 534bbd99-f448-5cf5-b1d9-c23780c8c2fe with identifier: MG97845
2026-03-30 07:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 534bbd99-f448-5cf5-b1d9-c23780c8c2fe with identifier: MG97845 to the API
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:34Z',
 'fuel_type': 'diesel',
 'id': '534bbd99-f448-5cf5-b1d9-c23780c8c2fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG97845',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 California',
 'odometer': 53218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-23',
 'seller_name': None,
 'title': 'Volkswagen T6 California 2.0 TDI Ocean Edition FWD',
 'transmission': 'automatic',
 'trim': 'Ocean Edition FWD',
 'year': 2021}
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG97845%27 HTTP/1.1" 200 None
2026-03-30 07:41:35 [auto1.de] INFO: Saving data for MG97845: {'auction_closing_time': 1774883734.0, 'created_time': 1773831063.754788, 'last_price_update_time': 1774856495.455848}
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG97845') HTTP/1.1" 204 0
2026-03-30 07:41:35 [auto1.de] INFO: Found listing with ID: AM33807
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM33807%27 HTTP/1.1" 200 None
2026-03-30 07:41:35 [auto1.de] INFO: Scrape type for AM33807: 0
2026-03-30 07:41:35 [auto1.de] INFO: Found listing with ID: JT90882
2026-03-30 07:41:35 [auto1.de] INFO: Found listing with ID: MG97845
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG97845%27 HTTP/1.1" 200 None
2026-03-30 07:41:35 [auto1.de] INFO: Scrape type for MG97845: 0
2026-03-30 07:41:35 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-30 07:41:35 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM62946%27 HTTP/1.1" 200 None
2026-03-30 07:41:35 [auto1.de] INFO: Scrape type for UM62946: 2
2026-03-30 07:41:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ffb076a-be1f-5a50-9239-09399597b44f with identifier: UM62946
2026-03-30 07:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ffb076a-be1f-5a50-9239-09399597b44f with scrape type 2
2026-03-30 07:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ffb076a-be1f-5a50-9239-09399597b44f with scrape type 2
2026-03-30 07:41:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ffb076a-be1f-5a50-9239-09399597b44f, identifier: UM62946
2026-03-30 07:41:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:35 [auto1.de] INFO: Found listing with ID: AJ18698
2026-03-30 07:41:35 [auto1.de] INFO: Found listing with ID: UM62946
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM62946%27 HTTP/1.1" 200 None
2026-03-30 07:41:35 [auto1.de] INFO: Scrape type for UM62946: 2
2026-03-30 07:41:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ffb076a-be1f-5a50-9239-09399597b44f with scrape type 2
2026-03-30 07:41:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ffb076a-be1f-5a50-9239-09399597b44f with scrape type 2
2026-03-30 07:41:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ffb076a-be1f-5a50-9239-09399597b44f, identifier: UM62946
2026-03-30 07:41:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ffb076a-be1f-5a50-9239-09399597b44f with identifier: UM62946
2026-03-30 07:41:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ffb076a-be1f-5a50-9239-09399597b44f with identifier: UM62946
2026-03-30 07:41:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ffb076a-be1f-5a50-9239-09399597b44f with identifier: UM62946 to the API
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:52:51Z',
 'fuel_type': 'diesel',
 'id': '1ffb076a-be1f-5a50-9239-09399597b44f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM62946',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 87093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2019}
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM62946%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Saving data for UM62946: {'auction_closing_time': 1774885971.0, 'created_time': 1773138942.549437, 'last_price_update_time': 1774856496.063978}
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM62946') HTTP/1.1" 204 0
2026-03-30 07:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ffb076a-be1f-5a50-9239-09399597b44f with identifier: UM62946
2026-03-30 07:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ffb076a-be1f-5a50-9239-09399597b44f with identifier: UM62946
2026-03-30 07:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ffb076a-be1f-5a50-9239-09399597b44f with identifier: UM62946 to the API
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:52:51Z',
 'fuel_type': 'diesel',
 'id': '1ffb076a-be1f-5a50-9239-09399597b44f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM62946',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 87093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2019}
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM62946%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Saving data for UM62946: {'auction_closing_time': 1774885971.0, 'created_time': 1773138942.549437, 'last_price_update_time': 1774856496.436907}
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UM62946') HTTP/1.1" 204 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: EN76399
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN76399%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for EN76399: 2
2026-03-30 07:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bcdb091-1e35-5164-8f79-363f2eea5de1 with identifier: EN76399
2026-03-30 07:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bcdb091-1e35-5164-8f79-363f2eea5de1 with scrape type 2
2026-03-30 07:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bcdb091-1e35-5164-8f79-363f2eea5de1 with scrape type 2
2026-03-30 07:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bcdb091-1e35-5164-8f79-363f2eea5de1, identifier: EN76399
2026-03-30 07:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bcdb091-1e35-5164-8f79-363f2eea5de1 with identifier: EN76399
2026-03-30 07:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bcdb091-1e35-5164-8f79-363f2eea5de1 with identifier: EN76399
2026-03-30 07:41:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bcdb091-1e35-5164-8f79-363f2eea5de1 with identifier: EN76399 to the API
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 354,
 'expiration_date': '2026-03-30T15:40:57Z',
 'fuel_type': 'petrol',
 'id': '7bcdb091-1e35-5164-8f79-363f2eea5de1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN76399',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 108309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-23',
 'seller_name': None,
 'title': 'Porsche Macan S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN76399%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Saving data for EN76399: {'auction_closing_time': 1774885257.0, 'created_time': 1773135334.476189, 'last_price_update_time': 1774856496.84755}
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN76399') HTTP/1.1" 204 0
2026-03-30 07:41:36 [auto1.de] INFO: Found listing with ID: CL40632
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL40632%27 HTTP/1.1" 200 None
2026-03-30 07:41:36 [auto1.de] INFO: Scrape type for CL40632: 2
2026-03-30 07:41:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b7b9001-669a-5b1a-8851-f10126d4cf09 with identifier: CL40632
2026-03-30 07:41:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b7b9001-669a-5b1a-8851-f10126d4cf09 with scrape type 2
2026-03-30 07:41:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b7b9001-669a-5b1a-8851-f10126d4cf09 with scrape type 2
2026-03-30 07:41:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7b7b9001-669a-5b1a-8851-f10126d4cf09, identifier: CL40632
2026-03-30 07:41:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7b7b9001-669a-5b1a-8851-f10126d4cf09 with identifier: CL40632
2026-03-30 07:41:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7b7b9001-669a-5b1a-8851-f10126d4cf09 with identifier: CL40632
2026-03-30 07:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7b7b9001-669a-5b1a-8851-f10126d4cf09 with identifier: CL40632 to the API
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:35:11Z',
 'fuel_type': 'petrol',
 'id': '7b7b9001-669a-5b1a-8851-f10126d4cf09',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL40632',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 130952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-12',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2019}
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL40632%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Saving data for CL40632: {'auction_closing_time': 1774884911.0, 'created_time': 1773228306.765338, 'last_price_update_time': 1774856497.297491}
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL40632') HTTP/1.1" 204 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: AG68218
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: YZ27957
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: GA63896
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: YP19468
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: TW27373
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW27373%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for TW27373: 2
2026-03-30 07:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81312097-d6dd-54cc-9ffb-c2e782e30e1c with identifier: TW27373
2026-03-30 07:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81312097-d6dd-54cc-9ffb-c2e782e30e1c with scrape type 2
2026-03-30 07:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81312097-d6dd-54cc-9ffb-c2e782e30e1c with scrape type 2
2026-03-30 07:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81312097-d6dd-54cc-9ffb-c2e782e30e1c, identifier: TW27373
2026-03-30 07:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81312097-d6dd-54cc-9ffb-c2e782e30e1c with identifier: TW27373
2026-03-30 07:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81312097-d6dd-54cc-9ffb-c2e782e30e1c with identifier: TW27373
2026-03-30 07:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81312097-d6dd-54cc-9ffb-c2e782e30e1c with identifier: TW27373 to the API
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:41:51Z',
 'fuel_type': 'diesel',
 'id': '81312097-d6dd-54cc-9ffb-c2e782e30e1c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW27373',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 135369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-02',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro S line Sportpaket plus',
 'transmission': 'automatic',
 'trim': 'quattro S line Sportpaket plus',
 'year': 2015}
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW27373%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Saving data for TW27373: {'auction_closing_time': 1774885311.0, 'created_time': 1773137781.66658, 'last_price_update_time': 1774856497.726762}
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW27373') HTTP/1.1" 204 0
2026-03-30 07:41:37 [auto1.de] INFO: Found listing with ID: PR12496
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR12496%27 HTTP/1.1" 200 None
2026-03-30 07:41:37 [auto1.de] INFO: Scrape type for PR12496: 2
2026-03-30 07:41:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4401e743-e836-537b-8311-d33fd84a9e2b with identifier: PR12496
2026-03-30 07:41:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4401e743-e836-537b-8311-d33fd84a9e2b with scrape type 2
2026-03-30 07:41:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4401e743-e836-537b-8311-d33fd84a9e2b with scrape type 2
2026-03-30 07:41:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4401e743-e836-537b-8311-d33fd84a9e2b, identifier: PR12496
2026-03-30 07:41:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4401e743-e836-537b-8311-d33fd84a9e2b with identifier: PR12496
2026-03-30 07:41:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4401e743-e836-537b-8311-d33fd84a9e2b with identifier: PR12496
2026-03-30 07:41:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4401e743-e836-537b-8311-d33fd84a9e2b with identifier: PR12496 to the API
2026-03-30 07:41:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:26:38Z',
 'fuel_type': 'hybrid',
 'id': '4401e743-e836-537b-8311-d33fd84a9e2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PR12496',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 28279,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-26',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Y20 Club',
 'transmission': 'automatic',
 'trim': 'Y20 Club',
 'year': 2019}
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR12496%27 HTTP/1.1" 200 None
2026-03-30 07:41:38 [auto1.de] INFO: Saving data for PR12496: {'auction_closing_time': 1774884398.0, 'created_time': 1773429685.665684, 'last_price_update_time': 1774856498.179906}
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PR12496') HTTP/1.1" 204 0
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: PY00065
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY00065%27 HTTP/1.1" 200 None
2026-03-30 07:41:38 [auto1.de] INFO: Scrape type for PY00065: 0
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: NZ51315
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: HZ75916
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ75916%27 HTTP/1.1" 200 None
2026-03-30 07:41:38 [auto1.de] INFO: Scrape type for HZ75916: 2
2026-03-30 07:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f265c99f-1ac1-5457-9655-682c09b8d4b1 with identifier: HZ75916
2026-03-30 07:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f265c99f-1ac1-5457-9655-682c09b8d4b1 with scrape type 2
2026-03-30 07:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f265c99f-1ac1-5457-9655-682c09b8d4b1 with scrape type 2
2026-03-30 07:41:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f265c99f-1ac1-5457-9655-682c09b8d4b1, identifier: HZ75916
2026-03-30 07:41:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f265c99f-1ac1-5457-9655-682c09b8d4b1 with identifier: HZ75916
2026-03-30 07:41:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f265c99f-1ac1-5457-9655-682c09b8d4b1 with identifier: HZ75916
2026-03-30 07:41:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f265c99f-1ac1-5457-9655-682c09b8d4b1 with identifier: HZ75916 to the API
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:30:31Z',
 'fuel_type': 'diesel',
 'id': 'f265c99f-1ac1-5457-9655-682c09b8d4b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ75916',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Grand Cherokee',
 'odometer': 207260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-27',
 'seller_name': None,
 'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
 'transmission': 'automatic',
 'trim': 'Overland',
 'year': 2012}
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ75916%27 HTTP/1.1" 200 None
2026-03-30 07:41:38 [auto1.de] INFO: Saving data for HZ75916: {'auction_closing_time': 1774884631.0, 'created_time': 1773228719.270931, 'last_price_update_time': 1774856498.824781}
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ75916') HTTP/1.1" 204 0
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: VH44928
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: WC28645
2026-03-30 07:41:38 [auto1.de] INFO: Found listing with ID: DD41075
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD41075%27 HTTP/1.1" 200 None
2026-03-30 07:41:38 [auto1.de] INFO: Scrape type for DD41075: 2
2026-03-30 07:41:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with identifier: DD41075
2026-03-30 07:41:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with scrape type 2
2026-03-30 07:41:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with scrape type 2
2026-03-30 07:41:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5ef04ec1-5713-54a0-9b17-81dc641cb3a7, identifier: DD41075
2026-03-30 07:41:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with identifier: DD41075
2026-03-30 07:41:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with identifier: DD41075
2026-03-30 07:41:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5ef04ec1-5713-54a0-9b17-81dc641cb3a7 with identifier: DD41075 to the API
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:49:22Z',
 'fuel_type': 'petrol',
 'id': '5ef04ec1-5713-54a0-9b17-81dc641cb3a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD41075',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 134009,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-06',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.4 Turbo Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD41075%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Saving data for DD41075: {'auction_closing_time': 1774885762.0, 'created_time': 1773132738.163623, 'last_price_update_time': 1774856499.353481}
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD41075') HTTP/1.1" 204 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: LN11604
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: VL75204
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL75204%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for VL75204: 2
2026-03-30 07:41:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36b38b0a-54ad-571b-bcbf-48cb169af21c with identifier: VL75204
2026-03-30 07:41:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36b38b0a-54ad-571b-bcbf-48cb169af21c with scrape type 2
2026-03-30 07:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36b38b0a-54ad-571b-bcbf-48cb169af21c with scrape type 2
2026-03-30 07:41:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 36b38b0a-54ad-571b-bcbf-48cb169af21c, identifier: VL75204
2026-03-30 07:41:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 36b38b0a-54ad-571b-bcbf-48cb169af21c with identifier: VL75204
2026-03-30 07:41:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 36b38b0a-54ad-571b-bcbf-48cb169af21c with identifier: VL75204
2026-03-30 07:41:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 36b38b0a-54ad-571b-bcbf-48cb169af21c with identifier: VL75204 to the API
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:38:03Z',
 'fuel_type': 'petrol',
 'id': '36b38b0a-54ad-571b-bcbf-48cb169af21c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL75204',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 183596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-03',
 'seller_name': None,
 'title': 'BMW 5er 540i xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2019}
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL75204%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Saving data for VL75204: {'auction_closing_time': 1774885083.0, 'created_time': 1773306871.782916, 'last_price_update_time': 1774856499.76688}
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL75204') HTTP/1.1" 204 0
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: XR19518
2026-03-30 07:41:39 [auto1.de] INFO: Found listing with ID: JY40414
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY40414%27 HTTP/1.1" 200 None
2026-03-30 07:41:39 [auto1.de] INFO: Scrape type for JY40414: 2
2026-03-30 07:41:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11dfac74-6ffc-5248-af73-739168c1617d with identifier: JY40414
2026-03-30 07:41:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11dfac74-6ffc-5248-af73-739168c1617d with scrape type 2
2026-03-30 07:41:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11dfac74-6ffc-5248-af73-739168c1617d with scrape type 2
2026-03-30 07:41:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11dfac74-6ffc-5248-af73-739168c1617d, identifier: JY40414
2026-03-30 07:41:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11dfac74-6ffc-5248-af73-739168c1617d with identifier: JY40414
2026-03-30 07:41:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11dfac74-6ffc-5248-af73-739168c1617d with identifier: JY40414
2026-03-30 07:41:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11dfac74-6ffc-5248-af73-739168c1617d with identifier: JY40414 to the API
2026-03-30 07:41:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:15:57Z',
 'fuel_type': 'diesel',
 'id': '11dfac74-6ffc-5248-af73-739168c1617d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY40414',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 148255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-20',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY40414%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Saving data for JY40414: {'auction_closing_time': 1774883757.0, 'created_time': 1773226384.300881, 'last_price_update_time': 1774856500.194554}
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY40414') HTTP/1.1" 204 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: KG80613
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG80613%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for KG80613: 2
2026-03-30 07:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with identifier: KG80613
2026-03-30 07:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with scrape type 2
2026-03-30 07:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with scrape type 2
2026-03-30 07:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4, identifier: KG80613
2026-03-30 07:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with identifier: KG80613
2026-03-30 07:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with identifier: KG80613
2026-03-30 07:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4 with identifier: KG80613 to the API
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-30T15:40:52Z',
 'fuel_type': 'diesel',
 'id': '2dfa975c-4b66-5f29-9f6c-fdcbb93cb5e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG80613',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 130421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-01',
 'seller_name': None,
 'title': 'BMW 5er M550d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2017}
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG80613%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Saving data for KG80613: {'auction_closing_time': 1774885252.0, 'created_time': 1773343060.79328, 'last_price_update_time': 1774856500.597343}
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG80613') HTTP/1.1" 204 0
2026-03-30 07:41:40 [auto1.de] INFO: Found listing with ID: RB81159
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81159%27 HTTP/1.1" 200 None
2026-03-30 07:41:40 [auto1.de] INFO: Scrape type for RB81159: 2
2026-03-30 07:41:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with identifier: RB81159
2026-03-30 07:41:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with scrape type 2
2026-03-30 07:41:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with scrape type 2
2026-03-30 07:41:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8, identifier: RB81159
2026-03-30 07:41:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with identifier: RB81159
2026-03-30 07:41:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with identifier: RB81159
2026-03-30 07:41:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8 with identifier: RB81159 to the API
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:18:41Z',
 'fuel_type': 'petrol',
 'id': 'ed8f2f89-2bc1-533c-9f00-6ee8c5decfa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB81159',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 259090,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'Audi A3 1.2 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB81159%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Saving data for RB81159: {'auction_closing_time': 1774883921.0, 'created_time': 1773226445.702709, 'last_price_update_time': 1774856501.075843}
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB81159') HTTP/1.1" 204 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: FE98948
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: GT84792
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: GS84935
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: KM43405
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM43405%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for KM43405: 2
2026-03-30 07:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf042f6d-96b1-596b-babe-df609d9f7fa1 with identifier: KM43405
2026-03-30 07:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf042f6d-96b1-596b-babe-df609d9f7fa1 with scrape type 2
2026-03-30 07:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf042f6d-96b1-596b-babe-df609d9f7fa1 with scrape type 2
2026-03-30 07:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf042f6d-96b1-596b-babe-df609d9f7fa1, identifier: KM43405
2026-03-30 07:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf042f6d-96b1-596b-babe-df609d9f7fa1 with identifier: KM43405
2026-03-30 07:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf042f6d-96b1-596b-babe-df609d9f7fa1 with identifier: KM43405
2026-03-30 07:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf042f6d-96b1-596b-babe-df609d9f7fa1 with identifier: KM43405 to the API
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:57:21Z',
 'fuel_type': 'petrol',
 'id': 'cf042f6d-96b1-596b-babe-df609d9f7fa1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM43405',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 58638,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-02',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Advantage 2WD',
 'transmission': 'manual',
 'trim': 'Advantage 2WD',
 'year': 2020}
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM43405%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Saving data for KM43405: {'auction_closing_time': 1774886241.0, 'created_time': 1773307998.478078, 'last_price_update_time': 1774856501.493414}
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM43405') HTTP/1.1" 204 0
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-30 07:41:41 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM01437%27 HTTP/1.1" 200 None
2026-03-30 07:41:41 [auto1.de] INFO: Scrape type for JM01437: 2
2026-03-30 07:41:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f68b8892-01eb-54b3-8864-4cc2950a3d1b with identifier: JM01437
2026-03-30 07:41:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f68b8892-01eb-54b3-8864-4cc2950a3d1b with scrape type 2
2026-03-30 07:41:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f68b8892-01eb-54b3-8864-4cc2950a3d1b with scrape type 2
2026-03-30 07:41:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f68b8892-01eb-54b3-8864-4cc2950a3d1b, identifier: JM01437
2026-03-30 07:41:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f68b8892-01eb-54b3-8864-4cc2950a3d1b with identifier: JM01437
2026-03-30 07:41:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f68b8892-01eb-54b3-8864-4cc2950a3d1b with identifier: JM01437
2026-03-30 07:41:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f68b8892-01eb-54b3-8864-4cc2950a3d1b with identifier: JM01437 to the API
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:26Z',
 'fuel_type': 'diesel',
 'id': 'f68b8892-01eb-54b3-8864-4cc2950a3d1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM01437',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 324578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-30',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2014}
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM01437%27 HTTP/1.1" 200 None
2026-03-30 07:41:42 [auto1.de] INFO: Saving data for JM01437: {'auction_closing_time': 1774883246.0, 'created_time': 1774466285.740144, 'last_price_update_time': 1774856502.059147}
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM01437') HTTP/1.1" 204 0
2026-03-30 07:41:42 [auto1.de] INFO: Channel: 24h | Page: 51 | totalHits: 8054 | hits on page: 40
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF03838%27 HTTP/1.1" 200 None
2026-03-30 07:41:42 [auto1.de] INFO: Scrape type for YF03838: 2
2026-03-30 07:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc1cac93-0cce-553e-949a-950900b8d283 with identifier: YF03838
2026-03-30 07:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc1cac93-0cce-553e-949a-950900b8d283 with scrape type 2
2026-03-30 07:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc1cac93-0cce-553e-949a-950900b8d283 with scrape type 2
2026-03-30 07:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc1cac93-0cce-553e-949a-950900b8d283, identifier: YF03838
2026-03-30 07:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc1cac93-0cce-553e-949a-950900b8d283 with identifier: YF03838
2026-03-30 07:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc1cac93-0cce-553e-949a-950900b8d283 with identifier: YF03838
2026-03-30 07:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc1cac93-0cce-553e-949a-950900b8d283 with identifier: YF03838 to the API
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:33:58Z',
 'fuel_type': 'diesel',
 'id': 'bc1cac93-0cce-553e-949a-950900b8d283',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF03838',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 171039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-24',
 'seller_name': None,
 'title': 'Porsche Macan S Diesel',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF03838%27 HTTP/1.1" 200 None
2026-03-30 07:41:42 [auto1.de] INFO: Saving data for YF03838: {'auction_closing_time': 1774884838.0, 'created_time': 1773307849.303922, 'last_price_update_time': 1774856502.489995}
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF03838') HTTP/1.1" 204 0
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: UK22592
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: FU28651
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: JM01437
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM01437%27 HTTP/1.1" 200 None
2026-03-30 07:41:42 [auto1.de] INFO: Scrape type for JM01437: 0
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: GY36946
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: PV67596
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: ET29931
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: YF03838
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF03838%27 HTTP/1.1" 200 None
2026-03-30 07:41:42 [auto1.de] INFO: Scrape type for YF03838: 0
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL60178%27 HTTP/1.1" 200 None
2026-03-30 07:41:42 [auto1.de] INFO: Scrape type for CL60178: 2
2026-03-30 07:41:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with identifier: CL60178
2026-03-30 07:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with scrape type 2
2026-03-30 07:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with scrape type 2
2026-03-30 07:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e, identifier: CL60178
2026-03-30 07:41:42 [auto1.de] INFO: Found listing with ID: CL60178
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL60178%27 HTTP/1.1" 200 None
2026-03-30 07:41:42 [auto1.de] INFO: Scrape type for CL60178: 2
2026-03-30 07:41:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with scrape type 2
2026-03-30 07:41:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with scrape type 2
2026-03-30 07:41:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e, identifier: CL60178
2026-03-30 07:41:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with identifier: CL60178
2026-03-30 07:41:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with identifier: CL60178
2026-03-30 07:41:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with identifier: CL60178 to the API
2026-03-30 07:41:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:59:10Z',
 'fuel_type': 'diesel',
 'id': '2a430a13-c0fb-51e9-8ffc-94d5f025fb3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL60178',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 109881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-19',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.5 TDI DPF Pritsche 50 langer Radstand',
 'transmission': 'manual',
 'trim': 'Pritsche 50 langer Radstand',
 'year': 2009}
2026-03-30 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL60178%27 HTTP/1.1" 200 None
2026-03-30 07:41:43 [auto1.de] INFO: Saving data for CL60178: {'auction_closing_time': 1774886350.0, 'created_time': 1773308114.779299, 'last_price_update_time': 1774856503.689768}
2026-03-30 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL60178') HTTP/1.1" 204 0
2026-03-30 07:41:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with identifier: CL60178
2026-03-30 07:41:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with identifier: CL60178
2026-03-30 07:41:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a430a13-c0fb-51e9-8ffc-94d5f025fb3e with identifier: CL60178 to the API
2026-03-30 07:41:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:59:10Z',
 'fuel_type': 'diesel',
 'id': '2a430a13-c0fb-51e9-8ffc-94d5f025fb3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL60178',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Crafter',
 'odometer': 109881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-19',
 'seller_name': None,
 'title': 'Volkswagen Crafter 2.5 TDI DPF Pritsche 50 langer Radstand',
 'transmission': 'manual',
 'trim': 'Pritsche 50 langer Radstand',
 'year': 2009}
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL60178%27 HTTP/1.1" 200 None
2026-03-30 07:41:44 [auto1.de] INFO: Saving data for CL60178: {'auction_closing_time': 1774886350.0, 'created_time': 1773308114.779299, 'last_price_update_time': 1774856504.09035}
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CL60178') HTTP/1.1" 204 0
2026-03-30 07:41:44 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-30 07:41:44 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH10770%27 HTTP/1.1" 200 None
2026-03-30 07:41:44 [auto1.de] INFO: Scrape type for AH10770: 2
2026-03-30 07:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5c5354d-d995-5909-ac66-84c98abe5aae with identifier: AH10770
2026-03-30 07:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c5354d-d995-5909-ac66-84c98abe5aae with scrape type 2
2026-03-30 07:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5c5354d-d995-5909-ac66-84c98abe5aae with scrape type 2
2026-03-30 07:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5c5354d-d995-5909-ac66-84c98abe5aae, identifier: AH10770
2026-03-30 07:41:44 [auto1.de] INFO: Found listing with ID: BP04527
2026-03-30 07:41:44 [auto1.de] INFO: Found listing with ID: AH10770
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH10770%27 HTTP/1.1" 200 None
2026-03-30 07:41:44 [auto1.de] INFO: Scrape type for AH10770: 2
2026-03-30 07:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5c5354d-d995-5909-ac66-84c98abe5aae with scrape type 2
2026-03-30 07:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5c5354d-d995-5909-ac66-84c98abe5aae with scrape type 2
2026-03-30 07:41:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5c5354d-d995-5909-ac66-84c98abe5aae, identifier: AH10770
2026-03-30 07:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5c5354d-d995-5909-ac66-84c98abe5aae with identifier: AH10770
2026-03-30 07:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5c5354d-d995-5909-ac66-84c98abe5aae with identifier: AH10770
2026-03-30 07:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5c5354d-d995-5909-ac66-84c98abe5aae with identifier: AH10770 to the API
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:10:52Z',
 'fuel_type': 'petrol',
 'id': 'c5c5354d-d995-5909-ac66-84c98abe5aae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH10770',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 103045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-20',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2020}
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH10770%27 HTTP/1.1" 200 None
2026-03-30 07:41:44 [auto1.de] INFO: Saving data for AH10770: {'auction_closing_time': 1774883452.0, 'created_time': 1773138680.83585, 'last_price_update_time': 1774856504.626287}
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH10770') HTTP/1.1" 204 0
2026-03-30 07:41:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5c5354d-d995-5909-ac66-84c98abe5aae with identifier: AH10770
2026-03-30 07:41:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5c5354d-d995-5909-ac66-84c98abe5aae with identifier: AH10770
2026-03-30 07:41:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5c5354d-d995-5909-ac66-84c98abe5aae with identifier: AH10770 to the API
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:10:52Z',
 'fuel_type': 'petrol',
 'id': 'c5c5354d-d995-5909-ac66-84c98abe5aae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AH10770',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 103045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-20',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2020}
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH10770%27 HTTP/1.1" 200 None
2026-03-30 07:41:44 [auto1.de] INFO: Saving data for AH10770: {'auction_closing_time': 1774883452.0, 'created_time': 1773138680.83585, 'last_price_update_time': 1774856504.928819}
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AH10770') HTTP/1.1" 204 0
2026-03-30 07:41:44 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-30 07:41:44 [auto1.de] INFO: Found listing with ID: GE40777
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE40777%27 HTTP/1.1" 200 None
2026-03-30 07:41:44 [auto1.de] INFO: Scrape type for GE40777: 2
2026-03-30 07:41:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with identifier: GE40777
2026-03-30 07:41:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with scrape type 2
2026-03-30 07:41:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with scrape type 2
2026-03-30 07:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6c276f8-e681-5bee-bd4c-cd492c15cfa3, identifier: GE40777
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: PW13353
2026-03-30 07:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with identifier: GE40777
2026-03-30 07:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with identifier: GE40777
2026-03-30 07:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6c276f8-e681-5bee-bd4c-cd492c15cfa3 with identifier: GE40777 to the API
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:21:04Z',
 'fuel_type': 'petrol',
 'id': 'b6c276f8-e681-5bee-bd4c-cd492c15cfa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE40777',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i40',
 'odometer': 145731,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Hyundai i40 1.6 Trend Blue',
 'transmission': 'manual',
 'trim': 'Trend Blue',
 'year': 2016}
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE40777%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Saving data for GE40777: {'auction_closing_time': 1774884064.0, 'created_time': 1773341449.229302, 'last_price_update_time': 1774856505.34234}
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE40777') HTTP/1.1" 204 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: JG07802
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: TA43023
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA43023%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for TA43023: 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: RC29433
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: LP47085
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP47085%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for LP47085: 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: VD46825
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD46825%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for VD46825: 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: YE68062
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: MP83511
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP83511%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for MP83511: 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: FV18032
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: AK95286
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK95286%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for AK95286: 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: JG50197
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG50197%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for JG50197: 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: XH92207
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH92207%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for XH92207: 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX71998%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for AX71998: 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN72943%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for MN72943: 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH87632%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for PH87632: 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47334%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for NT47334: 0
2026-03-30 07:41:45 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK51297%27 HTTP/1.1" 200 None
2026-03-30 07:41:45 [auto1.de] INFO: Scrape type for DK51297: 2
2026-03-30 07:41:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with identifier: DK51297
2026-03-30 07:41:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with scrape type 2
2026-03-30 07:41:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with scrape type 2
2026-03-30 07:41:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3, identifier: DK51297
2026-03-30 07:41:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with identifier: DK51297
2026-03-30 07:41:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with identifier: DK51297
2026-03-30 07:41:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ac9bbd5-9f82-5095-a25c-72ef9739b4f3 with identifier: DK51297 to the API
2026-03-30 07:41:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:06:16Z',
 'fuel_type': 'petrol',
 'id': '8ac9bbd5-9f82-5095-a25c-72ef9739b4f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK51297',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 99820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-17',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Active Business',
 'transmission': 'automatic',
 'trim': 'Active Business',
 'year': 2019}
2026-03-30 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK51297%27 HTTP/1.1" 200 None
2026-03-30 07:41:46 [auto1.de] INFO: Saving data for DK51297: {'auction_closing_time': 1774883176.0, 'created_time': 1774552995.875226, 'last_price_update_time': 1774856506.657155}
2026-03-30 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK51297') HTTP/1.1" 204 0
2026-03-30 07:41:46 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-30 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV07522%27 HTTP/1.1" 200 None
2026-03-30 07:41:46 [auto1.de] INFO: Scrape type for AV07522: 0
2026-03-30 07:41:46 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-30 07:41:46 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-30 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA25327%27 HTTP/1.1" 200 None
2026-03-30 07:41:46 [auto1.de] INFO: Scrape type for ZA25327: 2
2026-03-30 07:41:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e906ecf4-da75-50bf-82a9-e0f59b071cce with identifier: ZA25327
2026-03-30 07:41:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e906ecf4-da75-50bf-82a9-e0f59b071cce with scrape type 2
2026-03-30 07:41:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e906ecf4-da75-50bf-82a9-e0f59b071cce with scrape type 2
2026-03-30 07:41:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e906ecf4-da75-50bf-82a9-e0f59b071cce, identifier: ZA25327
2026-03-30 07:41:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e906ecf4-da75-50bf-82a9-e0f59b071cce with identifier: ZA25327
2026-03-30 07:41:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e906ecf4-da75-50bf-82a9-e0f59b071cce with identifier: ZA25327
2026-03-30 07:41:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e906ecf4-da75-50bf-82a9-e0f59b071cce with identifier: ZA25327 to the API
2026-03-30 07:41:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:20Z',
 'fuel_type': 'petrol',
 'id': 'e906ecf4-da75-50bf-82a9-e0f59b071cce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZA25327',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 115776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-18',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA25327%27 HTTP/1.1" 200 None
2026-03-30 07:41:47 [auto1.de] INFO: Saving data for ZA25327: {'auction_closing_time': 1774885580.0, 'created_time': 1774552959.745301, 'last_price_update_time': 1774856507.176282}
2026-03-30 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZA25327') HTTP/1.1" 204 0
2026-03-30 07:41:47 [auto1.de] INFO: Found listing with ID: YE47766
2026-03-30 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE47766%27 HTTP/1.1" 200 None
2026-03-30 07:41:47 [auto1.de] INFO: Scrape type for YE47766: 0
2026-03-30 07:41:47 [auto1.de] INFO: Found listing with ID: AY52280
2026-03-30 07:41:47 [auto1.de] INFO: Found listing with ID: ST92465
2026-03-30 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST92465%27 HTTP/1.1" 200 None
2026-03-30 07:41:47 [auto1.de] INFO: Scrape type for ST92465: 0
2026-03-30 07:41:47 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-30 07:41:47 [auto1.de] INFO: Found listing with ID: MT94431
2026-03-30 07:41:47 [auto1.de] INFO: Found listing with ID: ZF33601
2026-03-30 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF33601%27 HTTP/1.1" 200 None
2026-03-30 07:41:47 [auto1.de] INFO: Scrape type for ZF33601: 0
2026-03-30 07:41:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:48 [auto1.de] INFO: Channel: 24h | Page: 52 | totalHits: 8071 | hits on page: 40
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: JA02220
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: AX71998
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX71998%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for AX71998: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: JN21638
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: MN72943
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN72943%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for MN72943: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: PH87632
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH87632%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for PH87632: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: MA84823
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: NT47334
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT47334%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for NT47334: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: DK51297
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK51297%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for DK51297: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: AV07522
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV07522%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for AV07522: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: MN30127
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: ZA25327
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA25327%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for ZA25327: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: YE47766
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE47766%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for YE47766: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: AY52280
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: ST92465
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST92465%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for ST92465: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: EY37424
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: MT94431
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: ZF33601
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF33601%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for ZF33601: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: BP69387
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69387%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for BP69387: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: PF83814
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF83814%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for PF83814: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: PS96844
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: DH90644
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: UX35771
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX35771%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for UX35771: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: LC73868
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC73868%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for LC73868: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: JX17903
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: YE89715
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE89715%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for YE89715: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: NX25429
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: FB30616
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: PZ87651
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ87651%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for PZ87651: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: WR49956
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR49956%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for WR49956: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: EU48519
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU48519%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for EU48519: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: EM09444
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: HS59554
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS59554%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for HS59554: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: VU90894
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU90894%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for VU90894: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: AL66084
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL66084%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for AL66084: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: WF31027
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF31027%27 HTTP/1.1" 200 None
2026-03-30 07:41:48 [auto1.de] INFO: Scrape type for WF31027: 0
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: KJ73179
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: VM07579
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: XH18940
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: UZ89172
2026-03-30 07:41:48 [auto1.de] INFO: Found listing with ID: EF06925
2026-03-30 07:41:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:50 [auto1.de] INFO: Channel: 24h | Page: 53 | totalHits: 8071 | hits on page: 40
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: KR46332
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR46332%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for KR46332: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: UE56505
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: YS85982
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS85982%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for YS85982: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: KC50337
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC50337%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for KC50337: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: TR93945
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: EP14807
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP14807%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for EP14807: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: XG49869
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG49869%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for XG49869: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: ZW53829
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW53829%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for ZW53829: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: UF10359
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: CE58616
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE58616%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for CE58616: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: KS98119
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS98119%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for KS98119: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: HW05295
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW05295%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for HW05295: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: BN60503
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: BG41279
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: DK12229
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK12229%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for DK12229: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: ND89828
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: YB47390
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB47390%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for YB47390: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: VX00455
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX00455%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for VX00455: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: VW07399
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW07399%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for VW07399: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: SZ67140
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ67140%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for SZ67140: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: CK62820
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: HT40242
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT40242%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for HT40242: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: FC82221
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: MF60875
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: KT60854
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: AC96507
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC96507%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for AC96507: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: YS65782
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS65782%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for YS65782: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: MG42603
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: FK12887
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: ZU40023
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40023%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for ZU40023: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: CH93645
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: PE55813
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE55813%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for PE55813: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: JP33538
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: YT05280
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: RF07068
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: MU49508
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY96814%27 HTTP/1.1" 200 None
2026-03-30 07:41:50 [auto1.de] INFO: Scrape type for AY96814: 0
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-30 07:41:50 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-30 07:41:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:51 [auto1.de] INFO: Channel: 24h | Page: 54 | totalHits: 8075 | hits on page: 40
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: KD86114
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: AY96814
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY96814%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for AY96814: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: EF75873
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: HZ55109
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: UR98067
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: PT29857
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT29857%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for PT29857: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: CX74060
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: LA18154
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: WA25791
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA25791%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for WA25791: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: LN99770
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN99770%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for LN99770: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: NK17990
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK17990%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for NK17990: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: CY43451
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY43451%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for CY43451: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: ZX96561
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX96561%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for ZX96561: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: LX79709
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX79709%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for LX79709: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: KC50640
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC50640%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for KC50640: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: VR60747
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR60747%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for VR60747: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: SZ06147
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ06147%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for SZ06147: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: CW95568
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: NV70278
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV70278%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for NV70278: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: ZL59344
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL59344%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for ZL59344: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: GD26044
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: EE96817
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: NH06338
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: DS59005
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59005%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for DS59005: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: MF86039
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: JV48558
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV48558%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for JV48558: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: SJ64604
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: LH54346
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH54346%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for LH54346: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: DT57257
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: VT63649
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: JX79740
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: FR69109
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: BS19118
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: JX21647
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX21647%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for JX21647: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: VU30885
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU30885%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for VU30885: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: MM90627
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM90627%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for MM90627: 0
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: UP11609
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: SL92984
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-30 07:41:51 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG03809%27 HTTP/1.1" 200 None
2026-03-30 07:41:51 [auto1.de] INFO: Scrape type for JG03809: 0
2026-03-30 07:41:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:53 [auto1.de] INFO: Channel: 24h | Page: 55 | totalHits: 8077 | hits on page: 40
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: GH39731
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: JG03809
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG03809%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for JG03809: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: SN42334
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: NV30450
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: ZW50012
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: LE50284
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LE50284%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for LE50284: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: YV85598
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV85598%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for YV85598: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: AB49133
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: FN52751
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN52751%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for FN52751: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: KB67170
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: SC23766
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC23766%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for SC23766: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: CL73395
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL73395%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for CL73395: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: ZU96971
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU96971%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for ZU96971: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: KF93262
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: BP80209
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: FR18143
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: FP56300
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP56300%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for FP56300: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: WF13702
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: DU56840
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU56840%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for DU56840: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: HJ42862
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ42862%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for HJ42862: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: HH06006
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: LU46217
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: NC63257
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC63257%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for NC63257: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: HA49497
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA49497%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for HA49497: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: GN25688
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN25688%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for GN25688: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: DC32299
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: SD24294
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD24294%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for SD24294: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: JY97697
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY97697%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for JY97697: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: ZM10504
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: CH24864
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: NA60022
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: GX79735
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX79735%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for GX79735: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: ZY33636
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY33636%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for ZY33636: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ92241%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for HJ92241: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL18278%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for FL18278: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81012%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for TE81012: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37224%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for CG37224: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE55111%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for BE55111: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV65947%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for LV65947: 0
2026-03-30 07:41:53 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN71215%27 HTTP/1.1" 200 None
2026-03-30 07:41:53 [auto1.de] INFO: Scrape type for VN71215: 0
2026-03-30 07:41:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:55 [auto1.de] INFO: Channel: 24h | Page: 56 | totalHits: 8084 | hits on page: 40
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: HJ92241
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ92241%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for HJ92241: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: FL18278
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL18278%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for FL18278: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: TE81012
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE81012%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for TE81012: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: CG37224
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37224%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for CG37224: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: BE55111
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE55111%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for BE55111: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: LV65947
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV65947%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for LV65947: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: VN71215
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN71215%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for VN71215: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: FY57331
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57331%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for FY57331: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: GS42870
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS42870%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for GS42870: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: MT54263
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT54263%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for MT54263: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: AK26500
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: ZZ49081
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ49081%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for ZZ49081: 0
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: JL32962
2026-03-30 07:41:55 [auto1.de] INFO: Found listing with ID: GY35476
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY35476%27 HTTP/1.1" 200 None
2026-03-30 07:41:55 [auto1.de] INFO: Scrape type for GY35476: 2
2026-03-30 07:41:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with identifier: GY35476
2026-03-30 07:41:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with scrape type 2
2026-03-30 07:41:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with scrape type 2
2026-03-30 07:41:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fdcb2e31-1c78-56df-a3ae-91565a08f6c6, identifier: GY35476
2026-03-30 07:41:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with identifier: GY35476
2026-03-30 07:41:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with identifier: GY35476
2026-03-30 07:41:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fdcb2e31-1c78-56df-a3ae-91565a08f6c6 with identifier: GY35476 to the API
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:18:18Z',
 'fuel_type': 'petrol',
 'id': 'fdcb2e31-1c78-56df-a3ae-91565a08f6c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY35476',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 86898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-08',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY35476%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Saving data for GY35476: {'auction_closing_time': 1774883898.0, 'created_time': 1774552976.090875, 'last_price_update_time': 1774856516.177689}
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY35476') HTTP/1.1" 204 0
2026-03-30 07:41:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: UN88738
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: TV18525
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: GB49809
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB49809%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for GB49809: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: LT85175
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT85175%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for LT85175: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: MU81714
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: ZL07582
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: PW12377
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: RD52099
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: LX33649
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX33649%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for LX33649: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: CX30934
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: KT37105
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: NT69326
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT69326%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for NT69326: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: MP45750
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP45750%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for MP45750: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: BS14329
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS14329%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for BS14329: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: HW62804
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW62804%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for HW62804: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: BS91998
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS91998%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for BS91998: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: WW27591
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW27591%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for WW27591: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: ZM46839
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM46839%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for ZM46839: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: SS07399
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: PL16151
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL16151%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for PL16151: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: GT44390
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT44390%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for GT44390: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: NK02034
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK02034%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for NK02034: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: RR54011
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN39432%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for PN39432: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB31619%27 HTTP/1.1" 200 None
2026-03-30 07:41:56 [auto1.de] INFO: Scrape type for XB31619: 0
2026-03-30 07:41:56 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-30 07:41:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:57 [auto1.de] INFO: Channel: 24h | Page: 57 | totalHits: 8087 | hits on page: 40
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: PN39432
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN39432%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for PN39432: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: XB31619
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB31619%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for XB31619: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: JL12737
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: YA55481
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA55481%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for YA55481: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: KP96972
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: YW59624
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: LW18163
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW18163%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for LW18163: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: NX68514
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: AM69365
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: GX41654
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX41654%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for GX41654: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: VV46079
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: DW75956
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: EP30050
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP30050%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for EP30050: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: DJ56711
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ56711%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for DJ56711: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: AR05539
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: DS69815
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: TG96584
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG96584%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for TG96584: 0
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: XB74234
2026-03-30 07:41:57 [auto1.de] INFO: Found listing with ID: RC23376
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC23376%27 HTTP/1.1" 200 None
2026-03-30 07:41:57 [auto1.de] INFO: Scrape type for RC23376: 2
2026-03-30 07:41:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with identifier: RC23376
2026-03-30 07:41:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with scrape type 2
2026-03-30 07:41:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with scrape type 2
2026-03-30 07:41:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04e9276b-2a63-5e8a-b776-b69d3245a5a3, identifier: RC23376
2026-03-30 07:41:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with identifier: RC23376
2026-03-30 07:41:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with identifier: RC23376
2026-03-30 07:41:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04e9276b-2a63-5e8a-b776-b69d3245a5a3 with identifier: RC23376 to the API
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:39:24Z',
 'fuel_type': 'petrol',
 'id': '04e9276b-2a63-5e8a-b776-b69d3245a5a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC23376',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 96475,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-26',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC23376%27 HTTP/1.1" 200 None
2026-03-30 07:41:58 [auto1.de] INFO: Saving data for RC23376: {'auction_closing_time': 1774885164.0, 'created_time': 1774552898.706366, 'last_price_update_time': 1774856518.0936}
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC23376') HTTP/1.1" 204 0
2026-03-30 07:41:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: BD16858
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: VG72840
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: FR19321
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: TF63689
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: GS08469
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: BM86036
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM86036%27 HTTP/1.1" 200 None
2026-03-30 07:41:58 [auto1.de] INFO: Scrape type for BM86036: 0
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: NU91903
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: BP45840
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP45840%27 HTTP/1.1" 200 None
2026-03-30 07:41:58 [auto1.de] INFO: Scrape type for BP45840: 0
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: KH12936
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: YD12579
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: KG33917
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: FA63852
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA63852%27 HTTP/1.1" 200 None
2026-03-30 07:41:58 [auto1.de] INFO: Scrape type for FA63852: 0
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: FL79995
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL79995%27 HTTP/1.1" 200 None
2026-03-30 07:41:58 [auto1.de] INFO: Scrape type for FL79995: 0
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: BE44691
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: AR18568
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: ZK29983
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: FC63717
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: RD35466
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35466%27 HTTP/1.1" 200 None
2026-03-30 07:41:58 [auto1.de] INFO: Scrape type for RD35466: 0
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: PM92730
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM92730%27 HTTP/1.1" 200 None
2026-03-30 07:41:58 [auto1.de] INFO: Scrape type for PM92730: 0
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: YF63409
2026-03-30 07:41:58 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-30 07:41:58 [auto1.de] INFO: Scrape type for SK60410: 0
2026-03-30 07:41:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:41:59 [auto1.de] INFO: Channel: 24h | Page: 58 | totalHits: 8088 | hits on page: 40
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: SK60410
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK60410%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for SK60410: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: TS01373
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS01373%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for TS01373: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: FH64312
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH64312%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for FH64312: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: KH96137
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH96137%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for KH96137: 0
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: ST88871
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST88871%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for ST88871: 2
2026-03-30 07:41:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with identifier: ST88871
2026-03-30 07:41:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with scrape type 2
2026-03-30 07:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with scrape type 2
2026-03-30 07:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6504cb85-5ea6-5219-89c1-5cd1c4bfac28, identifier: ST88871
2026-03-30 07:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with identifier: ST88871
2026-03-30 07:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with identifier: ST88871
2026-03-30 07:41:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6504cb85-5ea6-5219-89c1-5cd1c4bfac28 with identifier: ST88871 to the API
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:41:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:40:15Z',
 'fuel_type': 'petrol',
 'id': '6504cb85-5ea6-5219-89c1-5cd1c4bfac28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST88871',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 187004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-27',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Center-Line 2WD',
 'transmission': 'manual',
 'trim': 'Center-Line 2WD',
 'year': 2012}
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST88871%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Saving data for ST88871: {'auction_closing_time': 1774885215.0, 'created_time': 1774551118.560065, 'last_price_update_time': 1774856519.726575}
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST88871') HTTP/1.1" 204 0
2026-03-30 07:41:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:41:59 [auto1.de] INFO: Found listing with ID: VX41895
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:41:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41895%27 HTTP/1.1" 200 None
2026-03-30 07:41:59 [auto1.de] INFO: Scrape type for VX41895: 2
2026-03-30 07:41:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a88e9926-bcaa-53be-8fea-ea9cddbfce25 with identifier: VX41895
2026-03-30 07:41:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a88e9926-bcaa-53be-8fea-ea9cddbfce25 with scrape type 2
2026-03-30 07:41:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a88e9926-bcaa-53be-8fea-ea9cddbfce25 with scrape type 2
2026-03-30 07:41:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a88e9926-bcaa-53be-8fea-ea9cddbfce25, identifier: VX41895
2026-03-30 07:41:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a88e9926-bcaa-53be-8fea-ea9cddbfce25 with identifier: VX41895
2026-03-30 07:41:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a88e9926-bcaa-53be-8fea-ea9cddbfce25 with identifier: VX41895
2026-03-30 07:42:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a88e9926-bcaa-53be-8fea-ea9cddbfce25 with identifier: VX41895 to the API
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:12Z',
 'fuel_type': 'petrol',
 'id': 'a88e9926-bcaa-53be-8fea-ea9cddbfce25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX41895',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 135198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-10',
 'seller_name': None,
 'title': 'Audi A4 1.4 TFSI ACT',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX41895%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Saving data for VX41895: {'auction_closing_time': 1774884852.0, 'created_time': 1774551402.960277, 'last_price_update_time': 1774856520.260961}
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX41895') HTTP/1.1" 204 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: BE37865
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37865%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for BE37865: 2
2026-03-30 07:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d21a91ea-0db2-5256-9edd-d303bfbe78c3 with identifier: BE37865
2026-03-30 07:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d21a91ea-0db2-5256-9edd-d303bfbe78c3 with scrape type 2
2026-03-30 07:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d21a91ea-0db2-5256-9edd-d303bfbe78c3 with scrape type 2
2026-03-30 07:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d21a91ea-0db2-5256-9edd-d303bfbe78c3, identifier: BE37865
2026-03-30 07:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d21a91ea-0db2-5256-9edd-d303bfbe78c3 with identifier: BE37865
2026-03-30 07:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d21a91ea-0db2-5256-9edd-d303bfbe78c3 with identifier: BE37865
2026-03-30 07:42:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d21a91ea-0db2-5256-9edd-d303bfbe78c3 with identifier: BE37865 to the API
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:04:53Z',
 'fuel_type': 'petrol',
 'id': 'd21a91ea-0db2-5256-9edd-d303bfbe78c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE37865',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 96528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-18',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE37865%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Saving data for BE37865: {'auction_closing_time': 1774883093.0, 'created_time': 1774552613.773653, 'last_price_update_time': 1774856520.661901}
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE37865') HTTP/1.1" 204 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: JJ82398
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: HN51683
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN51683%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for HN51683: 0
2026-03-30 07:42:00 [auto1.de] INFO: Found listing with ID: GV12841
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV12841%27 HTTP/1.1" 200 None
2026-03-30 07:42:00 [auto1.de] INFO: Scrape type for GV12841: 2
2026-03-30 07:42:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 323c9358-fa13-5594-82e4-3787ff0bfce1 with identifier: GV12841
2026-03-30 07:42:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 323c9358-fa13-5594-82e4-3787ff0bfce1 with scrape type 2
2026-03-30 07:42:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 323c9358-fa13-5594-82e4-3787ff0bfce1 with scrape type 2
2026-03-30 07:42:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 323c9358-fa13-5594-82e4-3787ff0bfce1, identifier: GV12841
2026-03-30 07:42:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 323c9358-fa13-5594-82e4-3787ff0bfce1 with identifier: GV12841
2026-03-30 07:42:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 323c9358-fa13-5594-82e4-3787ff0bfce1 with identifier: GV12841
2026-03-30 07:42:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 323c9358-fa13-5594-82e4-3787ff0bfce1 with identifier: GV12841 to the API
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:48Z',
 'fuel_type': 'diesel',
 'id': '323c9358-fa13-5594-82e4-3787ff0bfce1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV12841',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 182043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Allstar BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV12841%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Saving data for GV12841: {'auction_closing_time': 1774885068.0, 'created_time': 1774552979.809654, 'last_price_update_time': 1774856521.09468}
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV12841') HTTP/1.1" 204 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: KT58980
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: UP80660
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: JF69032
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: ML63417
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML63417%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for ML63417: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: FP71706
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP71706%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for FP71706: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: VV17039
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: TU49821
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: RU02977
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU02977%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for RU02977: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: RW26653
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW26653%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for RW26653: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: AZ23740
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23740%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for AZ23740: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: JE51939
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: JL44277
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: MN42254
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42254%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for MN42254: 2
2026-03-30 07:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with identifier: MN42254
2026-03-30 07:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with scrape type 2
2026-03-30 07:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with scrape type 2
2026-03-30 07:42:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8, identifier: MN42254
2026-03-30 07:42:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with identifier: MN42254
2026-03-30 07:42:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with identifier: MN42254
2026-03-30 07:42:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8 with identifier: MN42254 to the API
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:27Z',
 'fuel_type': 'petrol',
 'id': '9ec4ae94-da8b-508b-a6e9-8d4a64eee0a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN42254',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 47387,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI advanced',
 'transmission': 'automatic',
 'trim': 'advanced',
 'year': 2020}
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN42254%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Saving data for MN42254: {'auction_closing_time': 1774883487.0, 'created_time': 1774553085.533316, 'last_price_update_time': 1774856521.669121}
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN42254') HTTP/1.1" 204 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: ZY72717
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY72717%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for ZY72717: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: BK94674
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: AS86297
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: GF81751
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF81751%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for GF81751: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: UV04147
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV04147%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for UV04147: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: GS01911
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS01911%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for GS01911: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: CR11100
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: JN93492
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN93492%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for JN93492: 0
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: WN56158
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: KC39120
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-30 07:42:01 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08614%27 HTTP/1.1" 200 None
2026-03-30 07:42:01 [auto1.de] INFO: Scrape type for AJ08614: 2
2026-03-30 07:42:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1261c42-a09f-5dc0-a746-c2dba11ccda8 with identifier: AJ08614
2026-03-30 07:42:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1261c42-a09f-5dc0-a746-c2dba11ccda8 with scrape type 2
2026-03-30 07:42:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1261c42-a09f-5dc0-a746-c2dba11ccda8 with scrape type 2
2026-03-30 07:42:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1261c42-a09f-5dc0-a746-c2dba11ccda8, identifier: AJ08614
2026-03-30 07:42:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1261c42-a09f-5dc0-a746-c2dba11ccda8 with identifier: AJ08614
2026-03-30 07:42:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1261c42-a09f-5dc0-a746-c2dba11ccda8 with identifier: AJ08614
2026-03-30 07:42:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1261c42-a09f-5dc0-a746-c2dba11ccda8 with identifier: AJ08614 to the API
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:38:22Z',
 'fuel_type': 'diesel',
 'id': 'b1261c42-a09f-5dc0-a746-c2dba11ccda8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ08614',
 'listing': 'auction',
 'make': 'DS Automobiles',
 'model': 'DS7 Crossback',
 'odometer': 154709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-22',
 'seller_name': None,
 'title': 'DS Automobiles DS7 Crossback 2.0 Blue-HDi Performance Line',
 'transmission': 'automatic',
 'trim': 'Performance Line',
 'year': 2018}
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08614%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Saving data for AJ08614: {'auction_closing_time': 1774885102.0, 'created_time': 1774552680.140897, 'last_price_update_time': 1774856522.289587}
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AJ08614') HTTP/1.1" 204 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH31418%27 HTTP/1.1" 200 None
2026-03-30 07:42:02 [auto1.de] INFO: Scrape type for KH31418: 0
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-30 07:42:02 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-30 07:42:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:03 [auto1.de] INFO: Channel: 24h | Page: 59 | totalHits: 8095 | hits on page: 40
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: LM88961
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: AJ08614
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ08614%27 HTTP/1.1" 200 None
2026-03-30 07:42:03 [auto1.de] INFO: Scrape type for AJ08614: 0
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: AN54197
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: KH31418
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH31418%27 HTTP/1.1" 200 None
2026-03-30 07:42:03 [auto1.de] INFO: Scrape type for KH31418: 0
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: HM10464
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: HW22525
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: RB81391
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: DJ54071
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: DB44844
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: GC63268
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: UY73943
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: JB75617
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: TN59671
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: KJ86247
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ86247%27 HTTP/1.1" 200 None
2026-03-30 07:42:03 [auto1.de] INFO: Scrape type for KJ86247: 0
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: AF22062
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF22062%27 HTTP/1.1" 200 None
2026-03-30 07:42:03 [auto1.de] INFO: Scrape type for AF22062: 0
2026-03-30 07:42:03 [auto1.de] INFO: Found listing with ID: XS27718
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27718%27 HTTP/1.1" 200 None
2026-03-30 07:42:03 [auto1.de] INFO: Scrape type for XS27718: 2
2026-03-30 07:42:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bee8070-daa2-5a18-986a-e5538de28975 with identifier: XS27718
2026-03-30 07:42:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bee8070-daa2-5a18-986a-e5538de28975 with scrape type 2
2026-03-30 07:42:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bee8070-daa2-5a18-986a-e5538de28975 with scrape type 2
2026-03-30 07:42:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bee8070-daa2-5a18-986a-e5538de28975, identifier: XS27718
2026-03-30 07:42:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bee8070-daa2-5a18-986a-e5538de28975 with identifier: XS27718
2026-03-30 07:42:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bee8070-daa2-5a18-986a-e5538de28975 with identifier: XS27718
2026-03-30 07:42:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bee8070-daa2-5a18-986a-e5538de28975 with identifier: XS27718 to the API
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:14Z',
 'fuel_type': 'diesel',
 'id': '5bee8070-daa2-5a18-986a-e5538de28975',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS27718',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 189725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-03',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six',
 'transmission': 'automatic',
 'trim': 'Generation Six',
 'year': 2017}
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS27718%27 HTTP/1.1" 200 None
2026-03-30 07:42:03 [auto1.de] INFO: Saving data for XS27718: {'auction_closing_time': 1774884434.0, 'created_time': 1774553071.888138, 'last_price_update_time': 1774856523.934071}
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS27718') HTTP/1.1" 204 0
2026-03-30 07:42:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: VB40940
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: YS06113
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: BD68188
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD68188%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for BD68188: 2
2026-03-30 07:42:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db49fcff-ef2c-5e21-997c-439f6711ea39 with identifier: BD68188
2026-03-30 07:42:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db49fcff-ef2c-5e21-997c-439f6711ea39 with scrape type 2
2026-03-30 07:42:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db49fcff-ef2c-5e21-997c-439f6711ea39 with scrape type 2
2026-03-30 07:42:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: db49fcff-ef2c-5e21-997c-439f6711ea39, identifier: BD68188
2026-03-30 07:42:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: db49fcff-ef2c-5e21-997c-439f6711ea39 with identifier: BD68188
2026-03-30 07:42:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: db49fcff-ef2c-5e21-997c-439f6711ea39 with identifier: BD68188
2026-03-30 07:42:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: db49fcff-ef2c-5e21-997c-439f6711ea39 with identifier: BD68188 to the API
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:52Z',
 'fuel_type': 'petrol',
 'id': 'db49fcff-ef2c-5e21-997c-439f6711ea39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD68188',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 60221,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-16',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2020}
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD68188%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Saving data for BD68188: {'auction_closing_time': 1774883812.0, 'created_time': 1774550754.954602, 'last_price_update_time': 1774856524.497078}
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD68188') HTTP/1.1" 204 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: PC09054
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: YJ30839
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ30839%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for YJ30839: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: FH59067
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH59067%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for FH59067: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: VX34650
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: VU87810
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU87810%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for VU87810: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: ZK39912
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: MU83359
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU83359%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for MU83359: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: UN58886
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: FA27220
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA27220%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for FA27220: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: YS81106
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS81106%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for YS81106: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: HN35762
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN35762%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for HN35762: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: FZ50846
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: JN76212
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: TD63054
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD63054%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for TD63054: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: PU72162
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU72162%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for PU72162: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA55761%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for BA55761: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for WP48993: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR54362%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for NR54362: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS51511%27 HTTP/1.1" 200 None
2026-03-30 07:42:04 [auto1.de] INFO: Scrape type for WS51511: 0
2026-03-30 07:42:04 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-30 07:42:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:05 [auto1.de] INFO: Channel: 24h | Page: 60 | totalHits: 8101 | hits on page: 40
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: BA55761
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA55761%27 HTTP/1.1" 200 None
2026-03-30 07:42:05 [auto1.de] INFO: Scrape type for BA55761: 0
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: TU29288
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: WP48993
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP48993%27 HTTP/1.1" 200 None
2026-03-30 07:42:05 [auto1.de] INFO: Scrape type for WP48993: 0
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: NR54362
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR54362%27 HTTP/1.1" 200 None
2026-03-30 07:42:05 [auto1.de] INFO: Scrape type for NR54362: 0
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: WS51511
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS51511%27 HTTP/1.1" 200 None
2026-03-30 07:42:05 [auto1.de] INFO: Scrape type for WS51511: 0
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: TF08287
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: LS95970
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS95970%27 HTTP/1.1" 200 None
2026-03-30 07:42:05 [auto1.de] INFO: Scrape type for LS95970: 0
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: GJ26621
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ26621%27 HTTP/1.1" 200 None
2026-03-30 07:42:05 [auto1.de] INFO: Scrape type for GJ26621: 0
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: BU40538
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU40538%27 HTTP/1.1" 200 None
2026-03-30 07:42:05 [auto1.de] INFO: Scrape type for BU40538: 0
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: AG77275
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: KT21278
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT21278%27 HTTP/1.1" 200 None
2026-03-30 07:42:05 [auto1.de] INFO: Scrape type for KT21278: 0
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: MG37810
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: BY58400
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: LM03290
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: ZZ75608
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ75608%27 HTTP/1.1" 200 None
2026-03-30 07:42:05 [auto1.de] INFO: Scrape type for ZZ75608: 0
2026-03-30 07:42:05 [auto1.de] INFO: Found listing with ID: WT11127
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT11127%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for WT11127: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: DV41377
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: DJ32425
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: NB76223
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB76223%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for NB76223: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: PC86421
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86421%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for PC86421: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: BZ42521
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42521%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for BZ42521: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: BP32495
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: NY81856
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY81856%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for NY81856: 2
2026-03-30 07:42:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with identifier: NY81856
2026-03-30 07:42:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with scrape type 2
2026-03-30 07:42:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with scrape type 2
2026-03-30 07:42:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0, identifier: NY81856
2026-03-30 07:42:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with identifier: NY81856
2026-03-30 07:42:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with identifier: NY81856
2026-03-30 07:42:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b8e70ca-5a1c-5323-ae27-0a2931fb98d0 with identifier: NY81856 to the API
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:49:17Z',
 'fuel_type': 'petrol',
 'id': '9b8e70ca-5a1c-5323-ae27-0a2931fb98d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY81856',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 185557,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-06',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY81856%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Saving data for NY81856: {'auction_closing_time': 1774885757.0, 'created_time': 1774552811.73772, 'last_price_update_time': 1774856526.487453}
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY81856') HTTP/1.1" 204 0
2026-03-30 07:42:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: UV10868
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV10868%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for UV10868: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: ZM52655
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: ZZ74816
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ74816%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for ZZ74816: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: PA10723
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA10723%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for PA10723: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: SY55546
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY55546%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for SY55546: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: DG23161
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: HT55268
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: RP43844
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP43844%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for RP43844: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: GP28928
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: BB33034
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: JH84206
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: YD55328
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD55328%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for YD55328: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: WG27498
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG27498%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for WG27498: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: UT27249
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT27249%27 HTTP/1.1" 200 None
2026-03-30 07:42:06 [auto1.de] INFO: Scrape type for UT27249: 0
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-30 07:42:06 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-30 07:42:06 [scrapy.extensions.logstats] INFO: Crawled 256 pages (at 14 pages/min), scraped 609 items (at 92 items/min)
2026-03-30 07:42:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:42:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:07 [auto1.de] INFO: Channel: 24h | Page: 61 | totalHits: 8104 | hits on page: 40
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: RB85475
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: AF35013
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: JV22464
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: XM82116
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: GY48177
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: SL47086
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: SV18867
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: SZ74678
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: JT14864
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: JR97371
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: EJ65167
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: VS79881
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: JC14398
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC14398%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for JC14398: 0
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: HC88789
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC88789%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for HC88789: 0
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: ZZ71304
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ71304%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for ZZ71304: 0
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: LS56228
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS56228%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for LS56228: 0
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: PH65688
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: LN76006
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN76006%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for LN76006: 0
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: JM14062
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM14062%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for JM14062: 0
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: JM99769
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: CU86908
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU86908%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for CU86908: 0
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for ZE36621: 0
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for SA96746: 0
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for HJ79355: 0
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for HB27474: 0
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-30 07:42:07 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ86499%27 HTTP/1.1" 200 None
2026-03-30 07:42:07 [auto1.de] INFO: Scrape type for BZ86499: 2
2026-03-30 07:42:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd5dd392-befd-5b3a-998f-9814cfb75955 with identifier: BZ86499
2026-03-30 07:42:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd5dd392-befd-5b3a-998f-9814cfb75955 with scrape type 2
2026-03-30 07:42:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd5dd392-befd-5b3a-998f-9814cfb75955 with scrape type 2
2026-03-30 07:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd5dd392-befd-5b3a-998f-9814cfb75955, identifier: BZ86499
2026-03-30 07:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd5dd392-befd-5b3a-998f-9814cfb75955 with identifier: BZ86499
2026-03-30 07:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd5dd392-befd-5b3a-998f-9814cfb75955 with identifier: BZ86499
2026-03-30 07:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd5dd392-befd-5b3a-998f-9814cfb75955 with identifier: BZ86499 to the API
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:28:21Z',
 'fuel_type': 'petrol',
 'id': 'dd5dd392-befd-5b3a-998f-9814cfb75955',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ86499',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 34079,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2016}
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ86499%27 HTTP/1.1" 200 None
2026-03-30 07:42:08 [auto1.de] INFO: Saving data for BZ86499: {'auction_closing_time': 1774884501.0, 'created_time': 1774552609.543102, 'last_price_update_time': 1774856528.391352}
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ86499') HTTP/1.1" 204 0
2026-03-30 07:42:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:08 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-30 07:42:08 [auto1.de] INFO: Scrape type for XZ46710: 0
2026-03-30 07:42:08 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-30 07:42:08 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-30 07:42:08 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-30 07:42:08 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-30 07:42:08 [auto1.de] INFO: Scrape type for EG31023: 0
2026-03-30 07:42:08 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-30 07:42:08 [auto1.de] INFO: Scrape type for NZ72675: 0
2026-03-30 07:42:08 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-30 07:42:08 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27175%27 HTTP/1.1" 200 None
2026-03-30 07:42:08 [auto1.de] INFO: Scrape type for PE27175: 2
2026-03-30 07:42:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with identifier: PE27175
2026-03-30 07:42:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with scrape type 2
2026-03-30 07:42:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with scrape type 2
2026-03-30 07:42:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9, identifier: PE27175
2026-03-30 07:42:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with identifier: PE27175
2026-03-30 07:42:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with identifier: PE27175
2026-03-30 07:42:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e828bf2-af05-5b37-9cfa-6052d5a0b2b9 with identifier: PE27175 to the API
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:38Z',
 'fuel_type': 'petrol',
 'id': '7e828bf2-af05-5b37-9cfa-6052d5a0b2b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PE27175',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 122502,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-12',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Turbo Rocks S',
 'transmission': 'manual',
 'trim': 'Rocks S',
 'year': 2018}
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27175%27 HTTP/1.1" 200 None
2026-03-30 07:42:08 [auto1.de] INFO: Saving data for PE27175: {'auction_closing_time': 1774885598.0, 'created_time': 1774551625.868936, 'last_price_update_time': 1774856528.98332}
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PE27175') HTTP/1.1" 204 0
2026-03-30 07:42:09 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-30 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB93098%27 HTTP/1.1" 200 None
2026-03-30 07:42:09 [auto1.de] INFO: Scrape type for WB93098: 0
2026-03-30 07:42:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:25 [auto1.de] INFO: Channel: 24h | Page: 62 | totalHits: 8123 | hits on page: 40
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: MF41784
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: XR81453
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: ZE36621
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE36621%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for ZE36621: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: SC06812
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: SA96746
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA96746%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for SA96746: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: RY72669
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: HJ79355
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ79355%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for HJ79355: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: HB27474
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB27474%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for HB27474: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: FK00341
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: BZ86499
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ86499%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for BZ86499: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: XZ46710
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ46710%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for XZ46710: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: MY28321
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: MX26895
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: LE46493
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: EG31023
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG31023%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for EG31023: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: NZ72675
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ72675%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for NZ72675: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: LT72401
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: PE27175
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE27175%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for PE27175: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: WB93098
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB93098%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for WB93098: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: XR69964
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR69964%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for XR69964: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: LJ65077
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: EY45109
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY45109%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for EY45109: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: SB37681
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: CS81826
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: PD80009
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: HJ62454
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: BN78852
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: KL70058
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL70058%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for KL70058: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: PL48246
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: DJ80434
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ80434%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for DJ80434: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: EF82631
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: TN86054
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN86054%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for TN86054: 0
2026-03-30 07:42:25 [auto1.de] INFO: Found listing with ID: LZ26330
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ26330%27 HTTP/1.1" 200 None
2026-03-30 07:42:25 [auto1.de] INFO: Scrape type for LZ26330: 2
2026-03-30 07:42:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4c4a5af-835e-59a4-bf6f-f03be9920f08 with identifier: LZ26330
2026-03-30 07:42:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4c4a5af-835e-59a4-bf6f-f03be9920f08 with scrape type 2
2026-03-30 07:42:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4c4a5af-835e-59a4-bf6f-f03be9920f08 with scrape type 2
2026-03-30 07:42:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4c4a5af-835e-59a4-bf6f-f03be9920f08, identifier: LZ26330
2026-03-30 07:42:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4c4a5af-835e-59a4-bf6f-f03be9920f08 with identifier: LZ26330
2026-03-30 07:42:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4c4a5af-835e-59a4-bf6f-f03be9920f08 with identifier: LZ26330
2026-03-30 07:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4c4a5af-835e-59a4-bf6f-f03be9920f08 with identifier: LZ26330 to the API
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:06:14Z',
 'fuel_type': 'petrol',
 'id': 'b4c4a5af-835e-59a4-bf6f-f03be9920f08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ26330',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 34369,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-14',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 160 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2012}
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ26330%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Saving data for LZ26330: {'auction_closing_time': 1774883174.0, 'created_time': 1774553179.420278, 'last_price_update_time': 1774856546.294739}
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ26330') HTTP/1.1" 204 0
2026-03-30 07:42:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: SP41663
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: CS56497
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS56497%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for CS56497: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: LS72141
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: ZZ01082
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ01082%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for ZZ01082: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: ZB97674
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB97674%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for ZB97674: 0
2026-03-30 07:42:26 [auto1.de] INFO: Found listing with ID: MB83489
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB83489%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Scrape type for MB83489: 2
2026-03-30 07:42:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with identifier: MB83489
2026-03-30 07:42:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with scrape type 2
2026-03-30 07:42:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with scrape type 2
2026-03-30 07:42:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d31d88e2-c520-5211-aaab-e3d7d0bc08e1, identifier: MB83489
2026-03-30 07:42:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with identifier: MB83489
2026-03-30 07:42:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with identifier: MB83489
2026-03-30 07:42:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d31d88e2-c520-5211-aaab-e3d7d0bc08e1 with identifier: MB83489 to the API
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:00:14Z',
 'fuel_type': 'diesel',
 'id': 'd31d88e2-c520-5211-aaab-e3d7d0bc08e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB83489',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 67368,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-10',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2020}
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB83489%27 HTTP/1.1" 200 None
2026-03-30 07:42:26 [auto1.de] INFO: Saving data for MB83489: {'auction_closing_time': 1774882814.0, 'created_time': 1774553057.533437, 'last_price_update_time': 1774856546.866131}
2026-03-30 07:42:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB83489') HTTP/1.1" 204 0
2026-03-30 07:42:27 [auto1.de] INFO: Found listing with ID: DV51967
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV51967%27 HTTP/1.1" 200 None
2026-03-30 07:42:27 [auto1.de] INFO: Scrape type for DV51967: 0
2026-03-30 07:42:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:28 [auto1.de] INFO: Channel: 24h | Page: 63 | totalHits: 8123 | hits on page: 40
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: TM98978
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM98978%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for TM98978: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: GE94001
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: TD26953
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD26953%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for TD26953: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: BZ96817
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: CM83282
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: EJ40099
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: UJ33462
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: CV29491
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: BS44912
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS44912%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for BS44912: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: RS52465
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: AC85459
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC85459%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for AC85459: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: BN23533
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN23533%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for BN23533: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: NU76337
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU76337%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for NU76337: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: HA98993
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98993%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for HA98993: 2
2026-03-30 07:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f9907a0-5637-56b4-8919-da25d17c3dc2 with identifier: HA98993
2026-03-30 07:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f9907a0-5637-56b4-8919-da25d17c3dc2 with scrape type 2
2026-03-30 07:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f9907a0-5637-56b4-8919-da25d17c3dc2 with scrape type 2
2026-03-30 07:42:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f9907a0-5637-56b4-8919-da25d17c3dc2, identifier: HA98993
2026-03-30 07:42:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f9907a0-5637-56b4-8919-da25d17c3dc2 with identifier: HA98993
2026-03-30 07:42:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f9907a0-5637-56b4-8919-da25d17c3dc2 with identifier: HA98993
2026-03-30 07:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f9907a0-5637-56b4-8919-da25d17c3dc2 with identifier: HA98993 to the API
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:49:37Z',
 'fuel_type': 'petrol',
 'id': '4f9907a0-5637-56b4-8919-da25d17c3dc2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA98993',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 155342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-16',
 'seller_name': None,
 'title': 'Opel Zafira 1.8 Edition "111 Jahre"',
 'transmission': 'automatic',
 'trim': 'Edition "111 Jahre"',
 'year': 2012}
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98993%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Saving data for HA98993: {'auction_closing_time': 1774885777.0, 'created_time': 1774552381.338861, 'last_price_update_time': 1774856548.634613}
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA98993') HTTP/1.1" 204 0
2026-03-30 07:42:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: WE78461
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: SA82708
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA82708%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for SA82708: 0
2026-03-30 07:42:28 [auto1.de] INFO: Found listing with ID: XT50939
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT50939%27 HTTP/1.1" 200 None
2026-03-30 07:42:28 [auto1.de] INFO: Scrape type for XT50939: 2
2026-03-30 07:42:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da9375a0-3816-530a-a38f-0239cbec1197 with identifier: XT50939
2026-03-30 07:42:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da9375a0-3816-530a-a38f-0239cbec1197 with scrape type 2
2026-03-30 07:42:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da9375a0-3816-530a-a38f-0239cbec1197 with scrape type 2
2026-03-30 07:42:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da9375a0-3816-530a-a38f-0239cbec1197, identifier: XT50939
2026-03-30 07:42:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da9375a0-3816-530a-a38f-0239cbec1197 with identifier: XT50939
2026-03-30 07:42:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da9375a0-3816-530a-a38f-0239cbec1197 with identifier: XT50939
2026-03-30 07:42:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da9375a0-3816-530a-a38f-0239cbec1197 with identifier: XT50939 to the API
2026-03-30 07:42:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:23:08Z',
 'fuel_type': 'petrol',
 'id': 'da9375a0-3816-530a-a38f-0239cbec1197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT50939',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 61113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-07',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 35 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2019}
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT50939%27 HTTP/1.1" 200 None
2026-03-30 07:42:29 [auto1.de] INFO: Saving data for XT50939: {'auction_closing_time': 1774884188.0, 'created_time': 1774464036.90567, 'last_price_update_time': 1774856549.15314}
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT50939') HTTP/1.1" 204 0
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: GJ72633
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: BB70854
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: XW85438
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: PC67993
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC67993%27 HTTP/1.1" 200 None
2026-03-30 07:42:29 [auto1.de] INFO: Scrape type for PC67993: 0
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: GS38799
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS38799%27 HTTP/1.1" 200 None
2026-03-30 07:42:29 [auto1.de] INFO: Scrape type for GS38799: 0
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: JA25299
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA25299%27 HTTP/1.1" 200 None
2026-03-30 07:42:29 [auto1.de] INFO: Scrape type for JA25299: 0
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: HA43942
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: VP85116
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: FN85650
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN85650%27 HTTP/1.1" 200 None
2026-03-30 07:42:29 [auto1.de] INFO: Scrape type for FN85650: 0
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: ZC13254
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC13254%27 HTTP/1.1" 200 None
2026-03-30 07:42:29 [auto1.de] INFO: Scrape type for ZC13254: 0
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: AJ88373
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: WW51915
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW51915%27 HTTP/1.1" 200 None
2026-03-30 07:42:29 [auto1.de] INFO: Scrape type for WW51915: 2
2026-03-30 07:42:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba8ca480-cc53-53cb-8d52-b70ca3d6072c with identifier: WW51915
2026-03-30 07:42:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba8ca480-cc53-53cb-8d52-b70ca3d6072c with scrape type 2
2026-03-30 07:42:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba8ca480-cc53-53cb-8d52-b70ca3d6072c with scrape type 2
2026-03-30 07:42:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba8ca480-cc53-53cb-8d52-b70ca3d6072c, identifier: WW51915
2026-03-30 07:42:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba8ca480-cc53-53cb-8d52-b70ca3d6072c with identifier: WW51915
2026-03-30 07:42:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba8ca480-cc53-53cb-8d52-b70ca3d6072c with identifier: WW51915
2026-03-30 07:42:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba8ca480-cc53-53cb-8d52-b70ca3d6072c with identifier: WW51915 to the API
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:14Z',
 'fuel_type': 'petrol',
 'id': 'ba8ca480-cc53-53cb-8d52-b70ca3d6072c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW51915',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Leon',
 'odometer': 59835,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-07',
 'seller_name': None,
 'title': 'Cupra Leon 1.5 eTSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2023}
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW51915%27 HTTP/1.1" 200 None
2026-03-30 07:42:29 [auto1.de] INFO: Saving data for WW51915: {'auction_closing_time': 1774884554.0, 'created_time': 1774552723.959915, 'last_price_update_time': 1774856549.752052}
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WW51915') HTTP/1.1" 204 0
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: ZM17001
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: CU54451
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU54451%27 HTTP/1.1" 200 None
2026-03-30 07:42:29 [auto1.de] INFO: Scrape type for CU54451: 0
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: DU31630
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: WX50182
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: KF91285
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: FV09122
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV09122%27 HTTP/1.1" 200 None
2026-03-30 07:42:29 [auto1.de] INFO: Scrape type for FV09122: 0
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: DF17432
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: SA80165
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA80165%27 HTTP/1.1" 200 None
2026-03-30 07:42:29 [auto1.de] INFO: Scrape type for SA80165: 0
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-30 07:42:29 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-30 07:42:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:31 [auto1.de] INFO: Channel: 24h | Page: 64 | totalHits: 8126 | hits on page: 40
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: SE25361
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: CD93100
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: EN46705
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: WA68072
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: HD36706
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD36706%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for HD36706: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: XY49734
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY49734%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for XY49734: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: RU29030
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU29030%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for RU29030: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: NN32284
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN32284%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for NN32284: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: LV55209
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: RU43264
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU43264%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for RU43264: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: JV32404
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: LC33794
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: VF70690
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF70690%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for VF70690: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: HP02844
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: MM33078
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33078%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for MM33078: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: LD01626
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD01626%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for LD01626: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: FG21922
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG21922%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for FG21922: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: JY04435
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: CP54704
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP54704%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for CP54704: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: JB35967
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB35967%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for JB35967: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: SE90361
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE90361%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for SE90361: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: TA32254
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: RD63050
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: FK33509
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: RM28655
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: DH40869
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: CF89653
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF89653%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for CF89653: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: WX73478
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: EV72489
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV72489%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for EV72489: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: ZS56665
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS56665%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for ZS56665: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: KC35382
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: YM40569
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM40569%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for YM40569: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: WB04317
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB04317%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for WB04317: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: WG70910
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: CK29715
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET31330%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for ET31330: 0
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-30 07:42:31 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-30 07:42:31 [auto1.de] INFO: Scrape type for RC50586: 0
2026-03-30 07:42:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:33 [auto1.de] INFO: Channel: 24h | Page: 65 | totalHits: 8131 | hits on page: 40
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: WT17427
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: LB57303
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: ET31330
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET31330%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for ET31330: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: JH21308
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: RC50586
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC50586%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for RC50586: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: VY38504
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: DX86501
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: SJ63454
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ63454%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for SJ63454: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: TB88794
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: BB54670
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: XY94981
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: LD78025
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78025%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for LD78025: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: SA69574
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: FA01437
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: AR19685
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR19685%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for AR19685: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: HD83134
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD83134%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for HD83134: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: DB25597
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: NG28413
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG28413%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for NG28413: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: JH65606
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: YZ38333
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: ZN44804
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN44804%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for ZN44804: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: JV68298
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68298%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for JV68298: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: SP19687
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP19687%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for SP19687: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: DR66726
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: BP33481
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP33481%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for BP33481: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: JM73266
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM73266%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for JM73266: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: VG84958
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: GG14507
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: LB09285
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB09285%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for LB09285: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: WG00954
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: ME09470
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME09470%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for ME09470: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: WL40040
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: EH25554
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: CM50859
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM50859%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for CM50859: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: YK88723
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: JT97344
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: AW26352
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW26352%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for AW26352: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: WW45885
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW45885%27 HTTP/1.1" 200 None
2026-03-30 07:42:33 [auto1.de] INFO: Scrape type for WW45885: 0
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: TF89419
2026-03-30 07:42:33 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-30 07:42:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:35 [auto1.de] INFO: Channel: 24h | Page: 66 | totalHits: 8132 | hits on page: 40
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: HJ54596
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: MR23018
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: HP18010
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: LF15442
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: RM40239
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM40239%27 HTTP/1.1" 200 None
2026-03-30 07:42:35 [auto1.de] INFO: Scrape type for RM40239: 0
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: GG36618
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG36618%27 HTTP/1.1" 200 None
2026-03-30 07:42:35 [auto1.de] INFO: Scrape type for GG36618: 0
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: JL88490
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL88490%27 HTTP/1.1" 200 None
2026-03-30 07:42:35 [auto1.de] INFO: Scrape type for JL88490: 0
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: PH48180
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH48180%27 HTTP/1.1" 200 None
2026-03-30 07:42:35 [auto1.de] INFO: Scrape type for PH48180: 0
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: HP87000
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: RE53759
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE53759%27 HTTP/1.1" 200 None
2026-03-30 07:42:35 [auto1.de] INFO: Scrape type for RE53759: 0
2026-03-30 07:42:35 [auto1.de] INFO: Found listing with ID: NV31897
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV31897%27 HTTP/1.1" 200 None
2026-03-30 07:42:35 [auto1.de] INFO: Scrape type for NV31897: 2
2026-03-30 07:42:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbf75116-e709-5a20-a5de-ce0429eb7835 with identifier: NV31897
2026-03-30 07:42:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbf75116-e709-5a20-a5de-ce0429eb7835 with scrape type 2
2026-03-30 07:42:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbf75116-e709-5a20-a5de-ce0429eb7835 with scrape type 2
2026-03-30 07:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cbf75116-e709-5a20-a5de-ce0429eb7835, identifier: NV31897
2026-03-30 07:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cbf75116-e709-5a20-a5de-ce0429eb7835 with identifier: NV31897
2026-03-30 07:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cbf75116-e709-5a20-a5de-ce0429eb7835 with identifier: NV31897
2026-03-30 07:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cbf75116-e709-5a20-a5de-ce0429eb7835 with identifier: NV31897 to the API
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:15Z',
 'fuel_type': 'petrol',
 'id': 'cbf75116-e709-5a20-a5de-ce0429eb7835',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV31897',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 207287,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-30',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV31897%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Saving data for NV31897: {'auction_closing_time': 1774883535.0, 'created_time': 1774553114.885353, 'last_price_update_time': 1774856556.36188}
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV31897') HTTP/1.1" 204 0
2026-03-30 07:42:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: BU23510
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU23510%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for BU23510: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: HZ35615
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: SK99321
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: ZT89563
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT89563%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for ZT89563: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: VW42745
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW42745%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for VW42745: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: YJ99770
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ99770%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for YJ99770: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: HJ11294
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: ER42295
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: PW77910
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW77910%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for PW77910: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: TE93454
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE93454%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for TE93454: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: FH45720
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH45720%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for FH45720: 0
2026-03-30 07:42:36 [auto1.de] INFO: Found listing with ID: MR37276
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37276%27 HTTP/1.1" 200 None
2026-03-30 07:42:36 [auto1.de] INFO: Scrape type for MR37276: 2
2026-03-30 07:42:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f626eca-b5cc-51c7-9b10-eda04952bce9 with identifier: MR37276
2026-03-30 07:42:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f626eca-b5cc-51c7-9b10-eda04952bce9 with scrape type 2
2026-03-30 07:42:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f626eca-b5cc-51c7-9b10-eda04952bce9 with scrape type 2
2026-03-30 07:42:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f626eca-b5cc-51c7-9b10-eda04952bce9, identifier: MR37276
2026-03-30 07:42:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f626eca-b5cc-51c7-9b10-eda04952bce9 with identifier: MR37276
2026-03-30 07:42:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f626eca-b5cc-51c7-9b10-eda04952bce9 with identifier: MR37276
2026-03-30 07:42:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f626eca-b5cc-51c7-9b10-eda04952bce9 with identifier: MR37276 to the API
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:24:09Z',
 'fuel_type': 'petrol',
 'id': '0f626eca-b5cc-51c7-9b10-eda04952bce9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR37276',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 140373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-09',
 'seller_name': None,
 'title': 'Volkswagen Passat 3.2 V6 FSI Highline 4Motion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion',
 'year': 2008}
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR37276%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Saving data for MR37276: {'auction_closing_time': 1774884249.0, 'created_time': 1774552211.225791, 'last_price_update_time': 1774856557.152807}
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR37276') HTTP/1.1" 204 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: PU00921
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU00921%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for PU00921: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: SL53901
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: VY10648
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY10648%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for VY10648: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: UY72197
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY72197%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for UY72197: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: PH88741
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH88741%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for PH88741: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: HF07638
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF07638%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for HF07638: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: BF26414
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF26414%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for BF26414: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: FY91836
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY91836%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for FY91836: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: DC59357
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: DW94281
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: VD47640
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: VK44645
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK44645%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for VK44645: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP46416%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for VP46416: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for RJ47669: 0
2026-03-30 07:42:37 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-30 07:42:37 [auto1.de] INFO: Scrape type for CF53394: 0
2026-03-30 07:42:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:38 [auto1.de] INFO: Channel: 24h | Page: 67 | totalHits: 8137 | hits on page: 40
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: UV26569
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: VP46416
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP46416%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for VP46416: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: KV36004
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: RJ47669
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ47669%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for RJ47669: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: CF53394
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF53394%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for CF53394: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: LD15809
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: MV55154
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV55154%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for MV55154: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: TW15848
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW15848%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for TW15848: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: WZ38880
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ38880%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for WZ38880: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: CZ73559
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ73559%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for CZ73559: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: TH75068
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: JZ25562
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: DV41165
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV41165%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for DV41165: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: GA31373
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31373%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for GA31373: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: AK64805
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK64805%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for AK64805: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: ZF74811
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: KE98572
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: EX84018
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: EP44160
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP44160%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for EP44160: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: JZ96778
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: JC98855
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC98855%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for JC98855: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: HE96933
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: AL93555
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: WE09519
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: TC06569
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC06569%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for TC06569: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: JD70113
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: CF84548
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: SX95086
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: LP44310
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP44310%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for LP44310: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: TH33543
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH33543%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for TH33543: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: BP97465
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP97465%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for BP97465: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: CL90320
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL90320%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for CL90320: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: NS14523
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: TD06456
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-30 07:42:38 [auto1.de] INFO: Scrape type for LS65332: 0
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-30 07:42:38 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-30 07:42:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:39 [auto1.de] INFO: Channel: 24h | Page: 68 | totalHits: 8143 | hits on page: 40
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: XT71149
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: NU38157
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: LS65332
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS65332%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for LS65332: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: JV77194
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: DG73044
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: AB72988
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: LJ53831
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: ND38532
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND38532%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for ND38532: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: UL11203
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: US43373
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US43373%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for US43373: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: ZL30949
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: BA31495
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: PL79897
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL79897%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for PL79897: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: AE93045
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: XN26589
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: BZ78567
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: SA82608
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: PW65541
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW65541%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for PW65541: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: ZC62608
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: WG96363
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: PS52652
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: VV98956
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV98956%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for VV98956: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: HY33546
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY33546%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for HY33546: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: XP82440
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP82440%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for XP82440: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: CP99772
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: CS48399
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS48399%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for CS48399: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: PF77212
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF77212%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for PF77212: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: WZ92700
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ92700%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for WZ92700: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: FM08350
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM08350%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for FM08350: 0
2026-03-30 07:42:39 [auto1.de] INFO: Found listing with ID: BJ29098
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ29098%27 HTTP/1.1" 200 None
2026-03-30 07:42:39 [auto1.de] INFO: Scrape type for BJ29098: 2
2026-03-30 07:42:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42801f89-0201-5eb3-a5b4-bc63e9600db1 with identifier: BJ29098
2026-03-30 07:42:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42801f89-0201-5eb3-a5b4-bc63e9600db1 with scrape type 2
2026-03-30 07:42:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42801f89-0201-5eb3-a5b4-bc63e9600db1 with scrape type 2
2026-03-30 07:42:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 42801f89-0201-5eb3-a5b4-bc63e9600db1, identifier: BJ29098
2026-03-30 07:42:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 42801f89-0201-5eb3-a5b4-bc63e9600db1 with identifier: BJ29098
2026-03-30 07:42:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 42801f89-0201-5eb3-a5b4-bc63e9600db1 with identifier: BJ29098
2026-03-30 07:42:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 42801f89-0201-5eb3-a5b4-bc63e9600db1 with identifier: BJ29098 to the API
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:47:41Z',
 'fuel_type': 'diesel',
 'id': '42801f89-0201-5eb3-a5b4-bc63e9600db1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ29098',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 137410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-18',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2015}
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ29098%27 HTTP/1.1" 200 None
2026-03-30 07:42:40 [auto1.de] INFO: Saving data for BJ29098: {'auction_closing_time': 1774885661.0, 'created_time': 1774552723.170192, 'last_price_update_time': 1774856560.427849}
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ29098') HTTP/1.1" 204 0
2026-03-30 07:42:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:40 [auto1.de] INFO: Found listing with ID: MU77879
2026-03-30 07:42:40 [auto1.de] INFO: Found listing with ID: VJ44121
2026-03-30 07:42:40 [auto1.de] INFO: Found listing with ID: NN28121
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN28121%27 HTTP/1.1" 200 None
2026-03-30 07:42:40 [auto1.de] INFO: Scrape type for NN28121: 0
2026-03-30 07:42:40 [auto1.de] INFO: Found listing with ID: SY16661
2026-03-30 07:42:40 [auto1.de] INFO: Found listing with ID: DW77262
2026-03-30 07:42:40 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-30 07:42:40 [auto1.de] INFO: Scrape type for FD93722: 0
2026-03-30 07:42:40 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-30 07:42:40 [auto1.de] INFO: Scrape type for PA80529: 0
2026-03-30 07:42:40 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-30 07:42:40 [auto1.de] INFO: Scrape type for ZU03053: 0
2026-03-30 07:42:40 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-30 07:42:40 [auto1.de] INFO: Scrape type for WG69866: 0
2026-03-30 07:42:40 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-30 07:42:40 [auto1.de] INFO: Scrape type for RD35105: 0
2026-03-30 07:42:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:41 [auto1.de] INFO: Channel: 24h | Page: 69 | totalHits: 8148 | hits on page: 40
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: FD93722
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD93722%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for FD93722: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: PA80529
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA80529%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for PA80529: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: ZU03053
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU03053%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for ZU03053: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: WG69866
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG69866%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for WG69866: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: RD35105
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD35105%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for RD35105: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: FZ49091
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: SJ72681
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ72681%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for SJ72681: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: VN95277
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: SX14499
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX14499%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for SX14499: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: KS48100
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS48100%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for KS48100: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: GW52920
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW52920%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for GW52920: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: PW56805
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: ZV21910
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV21910%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for ZV21910: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: BA65327
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA65327%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for BA65327: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: TA56984
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA56984%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for TA56984: 0
2026-03-30 07:42:41 [auto1.de] INFO: Found listing with ID: ZC04825
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC04825%27 HTTP/1.1" 200 None
2026-03-30 07:42:41 [auto1.de] INFO: Scrape type for ZC04825: 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: GF62239
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: XB91859
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: UL81757
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: HL01818
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: CS17953
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS17953%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for CS17953: 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: BH53134
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH53134%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for BH53134: 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: VJ38627
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ38627%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for VJ38627: 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: BV55429
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: EL73218
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: EC33073
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: HV61627
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: VJ57461
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: WK71622
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK71622%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for WK71622: 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: ZW06761
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: XP46424
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP46424%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for XP46424: 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: ZE48308
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE48308%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for ZE48308: 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: KB43733
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61703%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for KZ61703: 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for TY49191: 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY55773%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for BY55773: 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-30 07:42:42 [auto1.de] INFO: Scrape type for UH96912: 0
2026-03-30 07:42:42 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-30 07:42:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:46 [auto1.de] INFO: Channel: 24h | Page: 70 | totalHits: 8155 | hits on page: 40
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: KZ61703
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ61703%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for KZ61703: 0
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: TY49191
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY49191%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for TY49191: 0
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: BY55773
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY55773%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for BY55773: 0
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: XC13487
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: JL05117
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: UH96912
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH96912%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for UH96912: 0
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: AZ14861
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: UH00039
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH00039%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for UH00039: 0
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: AZ92098
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: HV25811
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV25811%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for HV25811: 0
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: JP14233
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: MY92722
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY92722%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for MY92722: 0
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: LU22691
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: GA28860
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA28860%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for GA28860: 0
2026-03-30 07:42:46 [auto1.de] INFO: Found listing with ID: RF22787
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF22787%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Scrape type for RF22787: 2
2026-03-30 07:42:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c170e4c-8714-56e3-a319-107793e738c4 with identifier: RF22787
2026-03-30 07:42:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c170e4c-8714-56e3-a319-107793e738c4 with scrape type 2
2026-03-30 07:42:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c170e4c-8714-56e3-a319-107793e738c4 with scrape type 2
2026-03-30 07:42:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c170e4c-8714-56e3-a319-107793e738c4, identifier: RF22787
2026-03-30 07:42:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c170e4c-8714-56e3-a319-107793e738c4 with identifier: RF22787
2026-03-30 07:42:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c170e4c-8714-56e3-a319-107793e738c4 with identifier: RF22787
2026-03-30 07:42:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c170e4c-8714-56e3-a319-107793e738c4 with identifier: RF22787 to the API
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:22:13Z',
 'fuel_type': 'petrol',
 'id': '8c170e4c-8714-56e3-a319-107793e738c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF22787',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 130926,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-16',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'manual',
 'trim': 'Stepway Prestige',
 'year': 2016}
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF22787%27 HTTP/1.1" 200 None
2026-03-30 07:42:46 [auto1.de] INFO: Saving data for RF22787: {'auction_closing_time': 1774884133.0, 'created_time': 1774551884.670844, 'last_price_update_time': 1774856566.892315}
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF22787') HTTP/1.1" 204 0
2026-03-30 07:42:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: KS23837
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: HG25993
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG25993%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for HG25993: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: GA19207
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: UF45337
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF45337%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for UF45337: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: HM43288
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM43288%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for HM43288: 2
2026-03-30 07:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with identifier: HM43288
2026-03-30 07:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with scrape type 2
2026-03-30 07:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with scrape type 2
2026-03-30 07:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4e3f8b5-f9c2-5ebe-976c-296986d694e1, identifier: HM43288
2026-03-30 07:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with identifier: HM43288
2026-03-30 07:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with identifier: HM43288
2026-03-30 07:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4e3f8b5-f9c2-5ebe-976c-296986d694e1 with identifier: HM43288 to the API
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:33:08Z',
 'fuel_type': 'hybrid',
 'id': 'f4e3f8b5-f9c2-5ebe-976c-296986d694e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM43288',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 47832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-22',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM43288%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Saving data for HM43288: {'auction_closing_time': 1774884788.0, 'created_time': 1774550992.961841, 'last_price_update_time': 1774856567.474979}
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM43288') HTTP/1.1" 204 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: PR95726
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR95726%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for PR95726: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: CR29385
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: JH35819
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH35819%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for JH35819: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: LB66833
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB66833%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for LB66833: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: BZ12111
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ12111%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for BZ12111: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: HF53882
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: SS89253
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: MG70959
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG70959%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for MG70959: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: WN72573
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: GA77532
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: HV14674
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: ZF28924
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF28924%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for ZF28924: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: DJ14237
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ14237%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for DJ14237: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: AE42693
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: VN01043
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN01043%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for VN01043: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: DN26053
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for LN88860: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV58982%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for EV58982: 0
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-30 07:42:47 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN56757%27 HTTP/1.1" 200 None
2026-03-30 07:42:47 [auto1.de] INFO: Scrape type for PN56757: 2
2026-03-30 07:42:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4172f75-4525-5e28-acee-47c42dbd55fc with identifier: PN56757
2026-03-30 07:42:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4172f75-4525-5e28-acee-47c42dbd55fc with scrape type 2
2026-03-30 07:42:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4172f75-4525-5e28-acee-47c42dbd55fc with scrape type 2
2026-03-30 07:42:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4172f75-4525-5e28-acee-47c42dbd55fc, identifier: PN56757
2026-03-30 07:42:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4172f75-4525-5e28-acee-47c42dbd55fc with identifier: PN56757
2026-03-30 07:42:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4172f75-4525-5e28-acee-47c42dbd55fc with identifier: PN56757
2026-03-30 07:42:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4172f75-4525-5e28-acee-47c42dbd55fc with identifier: PN56757 to the API
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:07Z',
 'fuel_type': 'diesel',
 'id': 'f4172f75-4525-5e28-acee-47c42dbd55fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN56757',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 180218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-01',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D3 Kinetic 2WD',
 'transmission': 'manual',
 'trim': 'Kinetic 2WD',
 'year': 2017}
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN56757%27 HTTP/1.1" 200 None
2026-03-30 07:42:48 [auto1.de] INFO: Saving data for PN56757: {'auction_closing_time': 1774885087.0, 'created_time': 1773917518.051252, 'last_price_update_time': 1774856568.081236}
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN56757') HTTP/1.1" 204 0
2026-03-30 07:42:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:49 [auto1.de] INFO: Channel: 24h | Page: 71 | totalHits: 8159 | hits on page: 40
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: LN88860
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN88860%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for LN88860: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: EV58982
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV58982%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for EV58982: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: PC60624
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: PN56757
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN56757%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for PN56757: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: NY21217
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY21217%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for NY21217: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: PJ54145
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ54145%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for PJ54145: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: CH75769
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH75769%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for CH75769: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: KH16310
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: UH34905
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: NJ46216
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: BH48904
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH48904%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for BH48904: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: AN13363
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: KE72170
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: ZV61779
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV61779%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for ZV61779: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: VB62953
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: YM02183
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM02183%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for YM02183: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: TZ67975
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ67975%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for TZ67975: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: AE20511
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE20511%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for AE20511: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: WS48624
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: LC91854
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: WV15803
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV15803%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for WV15803: 0
2026-03-30 07:42:49 [auto1.de] INFO: Found listing with ID: HM75653
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM75653%27 HTTP/1.1" 200 None
2026-03-30 07:42:49 [auto1.de] INFO: Scrape type for HM75653: 2
2026-03-30 07:42:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfb42351-35d3-599d-bafc-9b069019dea3 with identifier: HM75653
2026-03-30 07:42:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfb42351-35d3-599d-bafc-9b069019dea3 with scrape type 2
2026-03-30 07:42:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfb42351-35d3-599d-bafc-9b069019dea3 with scrape type 2
2026-03-30 07:42:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfb42351-35d3-599d-bafc-9b069019dea3, identifier: HM75653
2026-03-30 07:42:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfb42351-35d3-599d-bafc-9b069019dea3 with identifier: HM75653
2026-03-30 07:42:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfb42351-35d3-599d-bafc-9b069019dea3 with identifier: HM75653
2026-03-30 07:42:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfb42351-35d3-599d-bafc-9b069019dea3 with identifier: HM75653 to the API
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:37:52Z',
 'fuel_type': 'diesel',
 'id': 'cfb42351-35d3-599d-bafc-9b069019dea3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM75653',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 194371,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-06',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM75653%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Saving data for HM75653: {'auction_closing_time': 1774885072.0, 'created_time': 1774553240.810425, 'last_price_update_time': 1774856570.108648}
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM75653') HTTP/1.1" 204 0
2026-03-30 07:42:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: YY45695
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: PF14640
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF14640%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Scrape type for PF14640: 0
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: UB45914
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Scrape type for DF94308: 0
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Scrape type for EE00996: 0
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT28876%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Scrape type for NT28876: 0
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Scrape type for PS83332: 0
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Scrape type for FS00408: 0
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-30 07:42:50 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT83472%27 HTTP/1.1" 200 None
2026-03-30 07:42:50 [auto1.de] INFO: Scrape type for TT83472: 0
2026-03-30 07:42:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:42:59 [auto1.de] INFO: Channel: 24h | Page: 72 | totalHits: 8174 | hits on page: 40
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: DF94308
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF94308%27 HTTP/1.1" 200 None
2026-03-30 07:42:59 [auto1.de] INFO: Scrape type for DF94308: 0
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: ZM88975
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: SY85938
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: EB91533
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: EE00996
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE00996%27 HTTP/1.1" 200 None
2026-03-30 07:42:59 [auto1.de] INFO: Scrape type for EE00996: 0
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: UH43382
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: NT28876
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT28876%27 HTTP/1.1" 200 None
2026-03-30 07:42:59 [auto1.de] INFO: Scrape type for NT28876: 0
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: WN92632
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: NW86422
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: PS83332
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS83332%27 HTTP/1.1" 200 None
2026-03-30 07:42:59 [auto1.de] INFO: Scrape type for PS83332: 0
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: LJ18760
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: FS00408
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS00408%27 HTTP/1.1" 200 None
2026-03-30 07:42:59 [auto1.de] INFO: Scrape type for FS00408: 0
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: YH81029
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: EU98596
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: TT83472
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT83472%27 HTTP/1.1" 200 None
2026-03-30 07:42:59 [auto1.de] INFO: Scrape type for TT83472: 0
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: BY26961
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: WE65713
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE65713%27 HTTP/1.1" 200 None
2026-03-30 07:42:59 [auto1.de] INFO: Scrape type for WE65713: 0
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: CX50338
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX50338%27 HTTP/1.1" 200 None
2026-03-30 07:42:59 [auto1.de] INFO: Scrape type for CX50338: 2
2026-03-30 07:42:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d115ce54-34c9-5b42-81f1-b677f7d4edca with identifier: CX50338
2026-03-30 07:42:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d115ce54-34c9-5b42-81f1-b677f7d4edca with scrape type 2
2026-03-30 07:42:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d115ce54-34c9-5b42-81f1-b677f7d4edca with scrape type 2
2026-03-30 07:42:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d115ce54-34c9-5b42-81f1-b677f7d4edca, identifier: CX50338
2026-03-30 07:42:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d115ce54-34c9-5b42-81f1-b677f7d4edca with identifier: CX50338
2026-03-30 07:42:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d115ce54-34c9-5b42-81f1-b677f7d4edca with identifier: CX50338
2026-03-30 07:42:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d115ce54-34c9-5b42-81f1-b677f7d4edca with identifier: CX50338 to the API
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:42:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:42:59Z',
 'fuel_type': 'petrol',
 'id': 'd115ce54-34c9-5b42-81f1-b677f7d4edca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX50338',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Arkana',
 'odometer': 116303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seller_name': None,
 'title': 'Renault Arkana 1.3 TCe R.S. Line',
 'transmission': 'automatic',
 'trim': 'R.S. Line',
 'year': 2022}
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX50338%27 HTTP/1.1" 200 None
2026-03-30 07:42:59 [auto1.de] INFO: Saving data for CX50338: {'auction_closing_time': 1774885379.0, 'created_time': 1774553109.210902, 'last_price_update_time': 1774856579.879303}
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:42:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX50338') HTTP/1.1" 204 0
2026-03-30 07:42:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: RR77511
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: FD81187
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: HW87137
2026-03-30 07:42:59 [auto1.de] INFO: Found listing with ID: AR04951
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR04951%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for AR04951: 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: HM36828
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM36828%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for HM36828: 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: CD05825
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD05825%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for CD05825: 2
2026-03-30 07:43:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82385f4a-a469-54cf-871c-94cd190d0b3d with identifier: CD05825
2026-03-30 07:43:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82385f4a-a469-54cf-871c-94cd190d0b3d with scrape type 2
2026-03-30 07:43:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82385f4a-a469-54cf-871c-94cd190d0b3d with scrape type 2
2026-03-30 07:43:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82385f4a-a469-54cf-871c-94cd190d0b3d, identifier: CD05825
2026-03-30 07:43:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82385f4a-a469-54cf-871c-94cd190d0b3d with identifier: CD05825
2026-03-30 07:43:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82385f4a-a469-54cf-871c-94cd190d0b3d with identifier: CD05825
2026-03-30 07:43:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82385f4a-a469-54cf-871c-94cd190d0b3d with identifier: CD05825 to the API
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:30:18Z',
 'fuel_type': 'diesel',
 'id': '82385f4a-a469-54cf-871c-94cd190d0b3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD05825',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 166873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-13',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD05825%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Saving data for CD05825: {'auction_closing_time': 1774884618.0, 'created_time': 1774552880.470542, 'last_price_update_time': 1774856580.498783}
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD05825') HTTP/1.1" 204 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: LN75673
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN75673%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for LN75673: 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: UM10671
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UM10671%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for UM10671: 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: VH61709
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: MT08770
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: JM39243
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: TD54604
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: RD48040
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD48040%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for RD48040: 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: JV89856
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV89856%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for JV89856: 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: CD09262
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: SG95649
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: GX08405
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX08405%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for GX08405: 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: BL21282
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL21282%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for BL21282: 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: GT07597
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT07597%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for GT07597: 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for MY79904: 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-30 07:43:00 [auto1.de] INFO: Scrape type for HD41373: 0
2026-03-30 07:43:00 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-30 07:43:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:01 [auto1.de] INFO: Channel: 24h | Page: 73 | totalHits: 8177 | hits on page: 40
2026-03-30 07:43:01 [auto1.de] INFO: Found listing with ID: MY79904
2026-03-30 07:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY79904%27 HTTP/1.1" 200 None
2026-03-30 07:43:01 [auto1.de] INFO: Scrape type for MY79904: 0
2026-03-30 07:43:01 [auto1.de] INFO: Found listing with ID: HD41373
2026-03-30 07:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD41373%27 HTTP/1.1" 200 None
2026-03-30 07:43:01 [auto1.de] INFO: Scrape type for HD41373: 0
2026-03-30 07:43:01 [auto1.de] INFO: Found listing with ID: RG01801
2026-03-30 07:43:01 [auto1.de] INFO: Found listing with ID: VU47138
2026-03-30 07:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU47138%27 HTTP/1.1" 200 None
2026-03-30 07:43:01 [auto1.de] INFO: Scrape type for VU47138: 0
2026-03-30 07:43:01 [auto1.de] INFO: Found listing with ID: SH55749
2026-03-30 07:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH55749%27 HTTP/1.1" 200 None
2026-03-30 07:43:01 [auto1.de] INFO: Scrape type for SH55749: 0
2026-03-30 07:43:01 [auto1.de] INFO: Found listing with ID: KU58060
2026-03-30 07:43:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU58060%27 HTTP/1.1" 200 None
2026-03-30 07:43:02 [auto1.de] INFO: Scrape type for KU58060: 0
2026-03-30 07:43:02 [auto1.de] INFO: Found listing with ID: DT85879
2026-03-30 07:43:02 [auto1.de] INFO: Found listing with ID: AZ40865
2026-03-30 07:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ40865%27 HTTP/1.1" 200 None
2026-03-30 07:43:02 [auto1.de] INFO: Scrape type for AZ40865: 2
2026-03-30 07:43:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c415e5b8-2858-5d50-96d3-8a63713106b3 with identifier: AZ40865
2026-03-30 07:43:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c415e5b8-2858-5d50-96d3-8a63713106b3 with scrape type 2
2026-03-30 07:43:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c415e5b8-2858-5d50-96d3-8a63713106b3 with scrape type 2
2026-03-30 07:43:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c415e5b8-2858-5d50-96d3-8a63713106b3, identifier: AZ40865
2026-03-30 07:43:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c415e5b8-2858-5d50-96d3-8a63713106b3 with identifier: AZ40865
2026-03-30 07:43:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c415e5b8-2858-5d50-96d3-8a63713106b3 with identifier: AZ40865
2026-03-30 07:43:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c415e5b8-2858-5d50-96d3-8a63713106b3 with identifier: AZ40865 to the API
2026-03-30 07:43:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:08:34Z',
 'fuel_type': 'petrol',
 'id': 'c415e5b8-2858-5d50-96d3-8a63713106b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AZ40865',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 172768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-30',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 VTi Family',
 'transmission': 'manual',
 'trim': 'Family',
 'year': 2012}
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ40865%27 HTTP/1.1" 200 None
2026-03-30 07:43:03 [auto1.de] INFO: Saving data for AZ40865: {'auction_closing_time': 1774883314.0, 'created_time': 1774552946.378104, 'last_price_update_time': 1774856583.152091}
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AZ40865') HTTP/1.1" 204 0
2026-03-30 07:43:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: YA93761
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: JS20731
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: SG62181
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG62181%27 HTTP/1.1" 200 None
2026-03-30 07:43:03 [auto1.de] INFO: Scrape type for SG62181: 0
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: TD57805
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD57805%27 HTTP/1.1" 200 None
2026-03-30 07:43:03 [auto1.de] INFO: Scrape type for TD57805: 0
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: SP41921
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP41921%27 HTTP/1.1" 200 None
2026-03-30 07:43:03 [auto1.de] INFO: Scrape type for SP41921: 0
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: BC03765
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC03765%27 HTTP/1.1" 200 None
2026-03-30 07:43:03 [auto1.de] INFO: Scrape type for BC03765: 0
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: AB35938
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB35938%27 HTTP/1.1" 200 None
2026-03-30 07:43:03 [auto1.de] INFO: Scrape type for AB35938: 0
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: GS69685
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: GA75258
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: SD97689
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: XB58662
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB58662%27 HTTP/1.1" 200 None
2026-03-30 07:43:03 [auto1.de] INFO: Scrape type for XB58662: 2
2026-03-30 07:43:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with identifier: XB58662
2026-03-30 07:43:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with scrape type 2
2026-03-30 07:43:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with scrape type 2
2026-03-30 07:43:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9, identifier: XB58662
2026-03-30 07:43:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with identifier: XB58662
2026-03-30 07:43:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with identifier: XB58662
2026-03-30 07:43:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9 with identifier: XB58662 to the API
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:55Z',
 'fuel_type': 'diesel',
 'id': 'a6d5ff90-c4e9-5f7c-ad0b-dce71626f8f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB58662',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 127954,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-16',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion',
 'year': 2013}
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB58662%27 HTTP/1.1" 200 None
2026-03-30 07:43:03 [auto1.de] INFO: Saving data for XB58662: {'auction_closing_time': 1774883515.0, 'created_time': 1774552214.764045, 'last_price_update_time': 1774856583.881357}
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB58662') HTTP/1.1" 204 0
2026-03-30 07:43:03 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Scrape type for YR74432: 0
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Scrape type for SG66874: 0
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ05672%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Scrape type for CZ05672: 0
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Scrape type for BT34315: 0
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL77544%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Scrape type for DL77544: 0
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Scrape type for SL44411: 0
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Scrape type for BK53036: 0
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB26744%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Scrape type for GB26744: 0
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF43434%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Scrape type for CF43434: 2
2026-03-30 07:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3224462b-f399-577e-a3ce-1665bd337466 with identifier: CF43434
2026-03-30 07:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3224462b-f399-577e-a3ce-1665bd337466 with scrape type 2
2026-03-30 07:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3224462b-f399-577e-a3ce-1665bd337466 with scrape type 2
2026-03-30 07:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3224462b-f399-577e-a3ce-1665bd337466, identifier: CF43434
2026-03-30 07:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3224462b-f399-577e-a3ce-1665bd337466 with identifier: CF43434
2026-03-30 07:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3224462b-f399-577e-a3ce-1665bd337466 with identifier: CF43434
2026-03-30 07:43:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3224462b-f399-577e-a3ce-1665bd337466 with identifier: CF43434 to the API
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:31:45Z',
 'fuel_type': 'diesel',
 'id': '3224462b-f399-577e-a3ce-1665bd337466',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF43434',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 173320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF43434%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Saving data for CF43434: {'auction_closing_time': 1774884705.0, 'created_time': 1774553228.83908, 'last_price_update_time': 1774856584.655962}
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF43434') HTTP/1.1" 204 0
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU90865%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Scrape type for CU90865: 0
2026-03-30 07:43:04 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE47693%27 HTTP/1.1" 200 None
2026-03-30 07:43:04 [auto1.de] INFO: Scrape type for BE47693: 2
2026-03-30 07:43:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with identifier: BE47693
2026-03-30 07:43:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with scrape type 2
2026-03-30 07:43:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with scrape type 2
2026-03-30 07:43:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1, identifier: BE47693
2026-03-30 07:43:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with identifier: BE47693
2026-03-30 07:43:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with identifier: BE47693
2026-03-30 07:43:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1 with identifier: BE47693 to the API
2026-03-30 07:43:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:46:53Z',
 'fuel_type': 'diesel',
 'id': 'ae3684eb-f8c7-5d59-b239-1bac9e1c8ee1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE47693',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Talento',
 'odometer': 68297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-08',
 'seller_name': None,
 'title': 'Fiat Talento 2.0 Turbodiesel Ecojet L1H1 1,0t SX',
 'transmission': 'manual',
 'trim': 'L1H1 1,0t SX',
 'year': 2020}
2026-03-30 07:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE47693%27 HTTP/1.1" 200 None
2026-03-30 07:43:05 [auto1.de] INFO: Saving data for BE47693: {'auction_closing_time': 1774885613.0, 'created_time': 1774552608.08393, 'last_price_update_time': 1774856585.208018}
2026-03-30 07:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE47693') HTTP/1.1" 204 0
2026-03-30 07:43:06 [scrapy.extensions.logstats] INFO: Crawled 269 pages (at 13 pages/min), scraped 629 items (at 20 items/min)
2026-03-30 07:43:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:43:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:12 [auto1.de] INFO: Channel: 24h | Page: 74 | totalHits: 8198 | hits on page: 40
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: ZJ78917
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: SG28437
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: JP57699
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: LB22457
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: YR74432
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR74432%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for YR74432: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: AA51921
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: TE89273
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: SG66874
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG66874%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for SG66874: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: CZ05672
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ05672%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for CZ05672: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: ZT71502
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: BT34315
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT34315%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for BT34315: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: HT62005
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: DL77544
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL77544%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for DL77544: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: SL44411
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL44411%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for SL44411: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: HB66964
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: LU00556
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: BK53036
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK53036%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for BK53036: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: GB26744
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB26744%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for GB26744: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: CF43434
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF43434%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for CF43434: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: CU90865
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU90865%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for CU90865: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: BE47693
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE47693%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for BE47693: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: NU04580
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU04580%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for NU04580: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: KH74255
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH74255%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for KH74255: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: RC68587
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: TL23560
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL23560%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for TL23560: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: KA82816
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA82816%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for KA82816: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: UT22988
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT22988%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for UT22988: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: VZ25719
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ25719%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for VZ25719: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: NX86319
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: NM84530
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: BJ97003
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ97003%27 HTTP/1.1" 200 None
2026-03-30 07:43:12 [auto1.de] INFO: Scrape type for BJ97003: 0
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: KY27003
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: TU42295
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: WZ51755
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: XV87595
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-30 07:43:12 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-30 07:43:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:14 [auto1.de] INFO: Channel: 24h | Page: 75 | totalHits: 8203 | hits on page: 40
2026-03-30 07:43:14 [auto1.de] INFO: Found listing with ID: KR20197
2026-03-30 07:43:14 [auto1.de] INFO: Found listing with ID: ZX84007
2026-03-30 07:43:14 [auto1.de] INFO: Found listing with ID: FV50908
2026-03-30 07:43:14 [auto1.de] INFO: Found listing with ID: CC55438
2026-03-30 07:43:14 [auto1.de] INFO: Found listing with ID: NT47170
2026-03-30 07:43:14 [auto1.de] INFO: Found listing with ID: LP76245
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP76245%27 HTTP/1.1" 200 None
2026-03-30 07:43:14 [auto1.de] INFO: Scrape type for LP76245: 2
2026-03-30 07:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11ba641a-6239-58f8-920f-96852ec825d0 with identifier: LP76245
2026-03-30 07:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11ba641a-6239-58f8-920f-96852ec825d0 with scrape type 2
2026-03-30 07:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11ba641a-6239-58f8-920f-96852ec825d0 with scrape type 2
2026-03-30 07:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11ba641a-6239-58f8-920f-96852ec825d0, identifier: LP76245
2026-03-30 07:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11ba641a-6239-58f8-920f-96852ec825d0 with identifier: LP76245
2026-03-30 07:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11ba641a-6239-58f8-920f-96852ec825d0 with identifier: LP76245
2026-03-30 07:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11ba641a-6239-58f8-920f-96852ec825d0 with identifier: LP76245 to the API
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:12:58Z',
 'fuel_type': 'petrol',
 'id': '11ba641a-6239-58f8-920f-96852ec825d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP76245',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Lodgy',
 'odometer': 54984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-16',
 'seller_name': None,
 'title': 'Dacia Lodgy 1.3 TCe Stepway Plus',
 'transmission': 'manual',
 'trim': 'Stepway Plus',
 'year': 2020}
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP76245%27 HTTP/1.1" 200 None
2026-03-30 07:43:14 [auto1.de] INFO: Saving data for LP76245: {'auction_closing_time': 1774883578.0, 'created_time': 1774552948.51638, 'last_price_update_time': 1774856594.460964}
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP76245') HTTP/1.1" 204 0
2026-03-30 07:43:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:14 [auto1.de] INFO: Found listing with ID: SC87676
2026-03-30 07:43:14 [auto1.de] INFO: Found listing with ID: EC33750
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC33750%27 HTTP/1.1" 200 None
2026-03-30 07:43:14 [auto1.de] INFO: Scrape type for EC33750: 0
2026-03-30 07:43:14 [auto1.de] INFO: Found listing with ID: WP14042
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP14042%27 HTTP/1.1" 200 None
2026-03-30 07:43:14 [auto1.de] INFO: Scrape type for WP14042: 2
2026-03-30 07:43:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with identifier: WP14042
2026-03-30 07:43:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with scrape type 2
2026-03-30 07:43:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with scrape type 2
2026-03-30 07:43:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f383db9-fdf3-5e58-a5f2-c1e57deaa170, identifier: WP14042
2026-03-30 07:43:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with identifier: WP14042
2026-03-30 07:43:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with identifier: WP14042
2026-03-30 07:43:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f383db9-fdf3-5e58-a5f2-c1e57deaa170 with identifier: WP14042 to the API
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:30:10Z',
 'fuel_type': 'petrol',
 'id': '9f383db9-fdf3-5e58-a5f2-c1e57deaa170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP14042',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 103171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-08-31',
 'seller_name': None,
 'title': 'Audi A3 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2004}
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP14042%27 HTTP/1.1" 200 None
2026-03-30 07:43:14 [auto1.de] INFO: Saving data for WP14042: {'auction_closing_time': 1774884610.0, 'created_time': 1774553056.918231, 'last_price_update_time': 1774856594.987996}
2026-03-30 07:43:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP14042') HTTP/1.1" 204 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: MH70992
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH70992%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for MH70992: 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: RN81514
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: AB27737
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB27737%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for AB27737: 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: HN44091
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN44091%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for HN44091: 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: JC28332
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC28332%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for JC28332: 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: AB91647
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB91647%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for AB91647: 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: GY96570
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: HM57840
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM57840%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for HM57840: 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: DX68266
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: FY99153
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: YE15667
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE15667%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for YE15667: 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: MF52928
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF52928%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for MF52928: 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: AM15816
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM15816%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for AM15816: 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: PG24864
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: AX08023
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX08023%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for AX08023: 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: SA10285
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: MM43491
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: UC60552
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: NV16003
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV16003%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for NV16003: 2
2026-03-30 07:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3ad063b-d86f-58bb-8504-c7ca8d13f88e with identifier: NV16003
2026-03-30 07:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ad063b-d86f-58bb-8504-c7ca8d13f88e with scrape type 2
2026-03-30 07:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3ad063b-d86f-58bb-8504-c7ca8d13f88e with scrape type 2
2026-03-30 07:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3ad063b-d86f-58bb-8504-c7ca8d13f88e, identifier: NV16003
2026-03-30 07:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3ad063b-d86f-58bb-8504-c7ca8d13f88e with identifier: NV16003
2026-03-30 07:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3ad063b-d86f-58bb-8504-c7ca8d13f88e with identifier: NV16003
2026-03-30 07:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3ad063b-d86f-58bb-8504-c7ca8d13f88e with identifier: NV16003 to the API
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:40:16Z',
 'fuel_type': 'diesel',
 'id': 'd3ad063b-d86f-58bb-8504-c7ca8d13f88e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV16003',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 64077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-31',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d EDITION lang',
 'transmission': 'automatic',
 'trim': 'EDITION lang',
 'year': 2022}
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV16003%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Saving data for NV16003: {'auction_closing_time': 1774885216.0, 'created_time': 1774552830.150485, 'last_price_update_time': 1774856595.60046}
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV16003') HTTP/1.1" 204 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: VH75951
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH75951%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for VH75951: 0
2026-03-30 07:43:15 [auto1.de] INFO: Found listing with ID: XZ81913
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ81913%27 HTTP/1.1" 200 None
2026-03-30 07:43:15 [auto1.de] INFO: Scrape type for XZ81913: 2
2026-03-30 07:43:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3e26894-70a6-51f3-8577-97077a50e469 with identifier: XZ81913
2026-03-30 07:43:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3e26894-70a6-51f3-8577-97077a50e469 with scrape type 2
2026-03-30 07:43:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3e26894-70a6-51f3-8577-97077a50e469 with scrape type 2
2026-03-30 07:43:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3e26894-70a6-51f3-8577-97077a50e469, identifier: XZ81913
2026-03-30 07:43:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3e26894-70a6-51f3-8577-97077a50e469 with identifier: XZ81913
2026-03-30 07:43:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3e26894-70a6-51f3-8577-97077a50e469 with identifier: XZ81913
2026-03-30 07:43:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3e26894-70a6-51f3-8577-97077a50e469 with identifier: XZ81913 to the API
2026-03-30 07:43:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:12:50Z',
 'fuel_type': 'diesel',
 'id': 'd3e26894-70a6-51f3-8577-97077a50e469',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ81913',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 216191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-03',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business Edition BlueMotion',
 'transmission': 'manual',
 'trim': 'Business Edition BlueMotion',
 'year': 2014}
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ81913%27 HTTP/1.1" 200 None
2026-03-30 07:43:16 [auto1.de] INFO: Saving data for XZ81913: {'auction_closing_time': 1774883570.0, 'created_time': 1774550716.329423, 'last_price_update_time': 1774856596.136465}
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XZ81913') HTTP/1.1" 204 0
2026-03-30 07:43:16 [auto1.de] INFO: Found listing with ID: FN00007
2026-03-30 07:43:16 [auto1.de] INFO: Found listing with ID: VJ41763
2026-03-30 07:43:16 [auto1.de] INFO: Found listing with ID: BN05463
2026-03-30 07:43:16 [auto1.de] INFO: Found listing with ID: ZP35673
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP35673%27 HTTP/1.1" 200 None
2026-03-30 07:43:16 [auto1.de] INFO: Scrape type for ZP35673: 2
2026-03-30 07:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 908147d1-9630-5a6e-861e-b3e99c79dd3c with identifier: ZP35673
2026-03-30 07:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 908147d1-9630-5a6e-861e-b3e99c79dd3c with scrape type 2
2026-03-30 07:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 908147d1-9630-5a6e-861e-b3e99c79dd3c with scrape type 2
2026-03-30 07:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 908147d1-9630-5a6e-861e-b3e99c79dd3c, identifier: ZP35673
2026-03-30 07:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 908147d1-9630-5a6e-861e-b3e99c79dd3c with identifier: ZP35673
2026-03-30 07:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 908147d1-9630-5a6e-861e-b3e99c79dd3c with identifier: ZP35673
2026-03-30 07:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 908147d1-9630-5a6e-861e-b3e99c79dd3c with identifier: ZP35673 to the API
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:52:29Z',
 'fuel_type': 'petrol',
 'id': '908147d1-9630-5a6e-861e-b3e99c79dd3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP35673',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 30877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-18',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 2.0 TSI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2022}
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP35673%27 HTTP/1.1" 200 None
2026-03-30 07:43:16 [auto1.de] INFO: Saving data for ZP35673: {'auction_closing_time': 1774885949.0, 'created_time': 1774553054.933137, 'last_price_update_time': 1774856596.534607}
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP35673') HTTP/1.1" 204 0
2026-03-30 07:43:16 [auto1.de] INFO: Found listing with ID: LY63644
2026-03-30 07:43:16 [auto1.de] INFO: Found listing with ID: KE01132
2026-03-30 07:43:16 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-30 07:43:16 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ97529%27 HTTP/1.1" 200 None
2026-03-30 07:43:16 [auto1.de] INFO: Scrape type for NZ97529: 0
2026-03-30 07:43:16 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76409%27 HTTP/1.1" 200 None
2026-03-30 07:43:16 [auto1.de] INFO: Scrape type for EZ76409: 2
2026-03-30 07:43:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with identifier: EZ76409
2026-03-30 07:43:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with scrape type 2
2026-03-30 07:43:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with scrape type 2
2026-03-30 07:43:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21e488e8-2903-5799-a9e2-3fb29a2f7a4b, identifier: EZ76409
2026-03-30 07:43:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with identifier: EZ76409
2026-03-30 07:43:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with identifier: EZ76409
2026-03-30 07:43:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21e488e8-2903-5799-a9e2-3fb29a2f7a4b with identifier: EZ76409 to the API
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 455,
 'expiration_date': '2026-03-30T15:22:49Z',
 'fuel_type': 'petrol',
 'id': '21e488e8-2903-5799-a9e2-3fb29a2f7a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ76409',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLS-Klasse',
 'odometer': 112843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-14',
 'seller_name': None,
 'title': 'Mercedes-Benz GLS-Klasse GLS 500 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 07:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76409%27 HTTP/1.1" 200 None
2026-03-30 07:43:17 [auto1.de] INFO: Saving data for EZ76409: {'auction_closing_time': 1774884169.0, 'created_time': 1774552272.914799, 'last_price_update_time': 1774856597.044565}
2026-03-30 07:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ76409') HTTP/1.1" 204 0
2026-03-30 07:43:17 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-30 07:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-30 07:43:17 [auto1.de] INFO: Scrape type for EJ47676: 0
2026-03-30 07:43:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:19 [auto1.de] INFO: Channel: 24h | Page: 76 | totalHits: 8207 | hits on page: 40
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: KU33020
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: NZ97529
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ97529%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for NZ97529: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: EZ76409
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ76409%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for EZ76409: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: EJ47676
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47676%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for EJ47676: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: DE98094
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE98094%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for DE98094: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: SC90935
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC90935%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for SC90935: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: ES42650
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: UE61705
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: ZE90376
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE90376%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for ZE90376: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: LH20515
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: ED89448
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: XR74072
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: PR56411
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR56411%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for PR56411: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: NK09609
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK09609%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for NK09609: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: SF00681
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: SA81936
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: ZE41577
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: UL75790
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL75790%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for UL75790: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: JE00015
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: UM95943
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: ZS46633
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: US49854
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US49854%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for US49854: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: FC97863
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC97863%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for FC97863: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: BE14691
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE14691%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for BE14691: 2
2026-03-30 07:43:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43523717-8620-5647-a8f0-7bdafcccb13e with identifier: BE14691
2026-03-30 07:43:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43523717-8620-5647-a8f0-7bdafcccb13e with scrape type 2
2026-03-30 07:43:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43523717-8620-5647-a8f0-7bdafcccb13e with scrape type 2
2026-03-30 07:43:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43523717-8620-5647-a8f0-7bdafcccb13e, identifier: BE14691
2026-03-30 07:43:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43523717-8620-5647-a8f0-7bdafcccb13e with identifier: BE14691
2026-03-30 07:43:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43523717-8620-5647-a8f0-7bdafcccb13e with identifier: BE14691
2026-03-30 07:43:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43523717-8620-5647-a8f0-7bdafcccb13e with identifier: BE14691 to the API
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:13:11Z',
 'fuel_type': 'petrol',
 'id': '43523717-8620-5647-a8f0-7bdafcccb13e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE14691',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 134029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-11',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'manual',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE14691%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Saving data for BE14691: {'auction_closing_time': 1774883591.0, 'created_time': 1774589754.582756, 'last_price_update_time': 1774856599.77721}
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE14691') HTTP/1.1" 204 0
2026-03-30 07:43:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: NZ32972
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: UD14847
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: MR34714
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR34714%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for MR34714: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: ZB74366
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: JS64432
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: CE15038
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE15038%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for CE15038: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: GY11970
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: RG49246
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG49246%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for RG49246: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: KF39713
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: BD66077
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: XR26970
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: AG64287
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: SJ64041
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ64041%27 HTTP/1.1" 200 None
2026-03-30 07:43:19 [auto1.de] INFO: Scrape type for SJ64041: 0
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: VU33733
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-30 07:43:19 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-30 07:43:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:21 [auto1.de] INFO: Channel: 24h | Page: 77 | totalHits: 8209 | hits on page: 40
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: FK95510
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: MY48468
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: LR49989
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR49989%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for LR49989: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: BF57036
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: XT91998
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT91998%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for XT91998: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: ET94101
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET94101%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for ET94101: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: MF75644
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: SZ97715
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ97715%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for SZ97715: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: BP39068
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39068%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for BP39068: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: DL95738
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95738%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for DL95738: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: WA46959
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46959%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for WA46959: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: BS37801
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: UC57196
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: GG93130
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: BJ34801
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ34801%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for BJ34801: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: TU08005
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: VJ57746
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ57746%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for VJ57746: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: YV03143
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV03143%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for YV03143: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: ML06015
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: NR35268
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: AZ42176
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ42176%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for AZ42176: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: MK66887
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK66887%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for MK66887: 0
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: UC31654
2026-03-30 07:43:21 [auto1.de] INFO: Found listing with ID: VH61695
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61695%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Scrape type for VH61695: 2
2026-03-30 07:43:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with identifier: VH61695
2026-03-30 07:43:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with scrape type 2
2026-03-30 07:43:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with scrape type 2
2026-03-30 07:43:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8, identifier: VH61695
2026-03-30 07:43:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with identifier: VH61695
2026-03-30 07:43:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with identifier: VH61695
2026-03-30 07:43:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57e99e5a-9ef8-50c2-9cc3-3160297b4fa8 with identifier: VH61695 to the API
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:56:15Z',
 'fuel_type': 'gas',
 'id': '57e99e5a-9ef8-50c2-9cc3-3160297b4fa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH61695',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 221524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-24',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 BIFuel Roncalli',
 'transmission': 'manual',
 'trim': 'Roncalli',
 'year': 2012}
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH61695%27 HTTP/1.1" 200 None
2026-03-30 07:43:21 [auto1.de] INFO: Saving data for VH61695: {'auction_closing_time': 1774886175.0, 'created_time': 1773917436.671797, 'last_price_update_time': 1774856601.904841}
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VH61695') HTTP/1.1" 204 0
2026-03-30 07:43:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: BD51611
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD51611%27 HTTP/1.1" 200 None
2026-03-30 07:43:22 [auto1.de] INFO: Scrape type for BD51611: 0
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: BG37163
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG37163%27 HTTP/1.1" 200 None
2026-03-30 07:43:22 [auto1.de] INFO: Scrape type for BG37163: 0
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: CD76809
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: TV18739
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: NZ89642
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ89642%27 HTTP/1.1" 200 None
2026-03-30 07:43:22 [auto1.de] INFO: Scrape type for NZ89642: 0
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: YK98725
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK98725%27 HTTP/1.1" 200 None
2026-03-30 07:43:22 [auto1.de] INFO: Scrape type for YK98725: 0
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: EE77460
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: KF96010
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96010%27 HTTP/1.1" 200 None
2026-03-30 07:43:22 [auto1.de] INFO: Scrape type for KF96010: 0
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: JM79272
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM79272%27 HTTP/1.1" 200 None
2026-03-30 07:43:22 [auto1.de] INFO: Scrape type for JM79272: 0
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: KS26285
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: KH46132
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: EG39650
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: XF55006
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: GJ42738
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-30 07:43:22 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-30 07:43:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:23 [auto1.de] INFO: Channel: 24h | Page: 78 | totalHits: 8211 | hits on page: 40
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: AF88464
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: HA89104
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: VT53198
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT53198%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for VT53198: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: DM27996
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: UA99950
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA99950%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for UA99950: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: PP83297
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP83297%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for PP83297: 2
2026-03-30 07:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with identifier: PP83297
2026-03-30 07:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with scrape type 2
2026-03-30 07:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with scrape type 2
2026-03-30 07:43:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3cd9b5d-1a54-55cc-984d-ee40ee8b0701, identifier: PP83297
2026-03-30 07:43:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with identifier: PP83297
2026-03-30 07:43:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with identifier: PP83297
2026-03-30 07:43:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3cd9b5d-1a54-55cc-984d-ee40ee8b0701 with identifier: PP83297 to the API
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:12Z',
 'fuel_type': 'diesel',
 'id': 'b3cd9b5d-1a54-55cc-984d-ee40ee8b0701',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP83297',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 133302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-11',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 D3 Momentum Pro AWD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro AWD',
 'year': 2019}
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP83297%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Saving data for PP83297: {'auction_closing_time': 1774883232.0, 'created_time': 1774552910.607487, 'last_price_update_time': 1774856603.56328}
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP83297') HTTP/1.1" 204 0
2026-03-30 07:43:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: EL92267
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL92267%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for EL92267: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: JN95479
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN95479%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for JN95479: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: AA46272
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: RK12981
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK12981%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for RK12981: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: ES37621
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES37621%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for ES37621: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: HC77687
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC77687%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for HC77687: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: FV67492
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV67492%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for FV67492: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: ZT53548
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: VC64340
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC64340%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for VC64340: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: AM78577
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: XG77480
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: FR92717
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: DT94754
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT94754%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for DT94754: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: RL19832
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: TX63688
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX63688%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for TX63688: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: MR65343
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR65343%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for MR65343: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: DB36710
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB36710%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for DB36710: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: FB02841
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: PW12132
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: NT04254
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: HK50070
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK50070%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for HK50070: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: SU14525
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU14525%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for SU14525: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: CD56647
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD56647%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for CD56647: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: KP48554
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP48554%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for KP48554: 0
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: JV68921
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: CL62984
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: GV91786
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: FE12352
2026-03-30 07:43:23 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY74749%27 HTTP/1.1" 200 None
2026-03-30 07:43:23 [auto1.de] INFO: Scrape type for AY74749: 2
2026-03-30 07:43:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acc13f13-4c4a-58df-a257-56c19e997d7f with identifier: AY74749
2026-03-30 07:43:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acc13f13-4c4a-58df-a257-56c19e997d7f with scrape type 2
2026-03-30 07:43:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acc13f13-4c4a-58df-a257-56c19e997d7f with scrape type 2
2026-03-30 07:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acc13f13-4c4a-58df-a257-56c19e997d7f, identifier: AY74749
2026-03-30 07:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acc13f13-4c4a-58df-a257-56c19e997d7f with identifier: AY74749
2026-03-30 07:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acc13f13-4c4a-58df-a257-56c19e997d7f with identifier: AY74749
2026-03-30 07:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acc13f13-4c4a-58df-a257-56c19e997d7f with identifier: AY74749 to the API
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:51:47Z',
 'fuel_type': 'petrol',
 'id': 'acc13f13-4c4a-58df-a257-56c19e997d7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY74749',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 180055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-14',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Maxi Kasten',
 'transmission': 'manual',
 'trim': 'Maxi Kasten',
 'year': 2013}
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY74749%27 HTTP/1.1" 200 None
2026-03-30 07:43:24 [auto1.de] INFO: Saving data for AY74749: {'auction_closing_time': 1774885907.0, 'created_time': 1774553000.231953, 'last_price_update_time': 1774856604.336282}
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY74749') HTTP/1.1" 204 0
2026-03-30 07:43:24 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-30 07:43:24 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-30 07:43:24 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-30 07:43:24 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-30 07:43:24 [auto1.de] INFO: Scrape type for JJ83769: 0
2026-03-30 07:43:24 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-30 07:43:24 [auto1.de] INFO: Scrape type for DM07006: 2
2026-03-30 07:43:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with identifier: DM07006
2026-03-30 07:43:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with scrape type 2
2026-03-30 07:43:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with scrape type 2
2026-03-30 07:43:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 47351ab2-ca2d-5b1b-96d7-09accc1a6e96, identifier: DM07006
2026-03-30 07:43:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with identifier: DM07006
2026-03-30 07:43:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with identifier: DM07006
2026-03-30 07:43:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 47351ab2-ca2d-5b1b-96d7-09accc1a6e96 with identifier: DM07006 to the API
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:33Z',
 'fuel_type': 'diesel',
 'id': '47351ab2-ca2d-5b1b-96d7-09accc1a6e96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DM07006',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 216692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-14',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Freestyle BlueMotion',
 'transmission': 'manual',
 'trim': 'Freestyle BlueMotion',
 'year': 2011}
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-30 07:43:24 [auto1.de] INFO: Saving data for DM07006: {'auction_closing_time': 1774883313.0, 'created_time': 1774552700.366709, 'last_price_update_time': 1774856604.895393}
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DM07006') HTTP/1.1" 204 0
2026-03-30 07:43:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:25 [auto1.de] INFO: Channel: 24h | Page: 79 | totalHits: 8217 | hits on page: 40
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: AY74749
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY74749%27 HTTP/1.1" 200 None
2026-03-30 07:43:25 [auto1.de] INFO: Scrape type for AY74749: 0
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: GH02109
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: FP33840
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: CM74095
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: JJ83769
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ83769%27 HTTP/1.1" 200 None
2026-03-30 07:43:25 [auto1.de] INFO: Scrape type for JJ83769: 0
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: DM07006
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM07006%27 HTTP/1.1" 200 None
2026-03-30 07:43:25 [auto1.de] INFO: Scrape type for DM07006: 0
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: RZ99970
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ99970%27 HTTP/1.1" 200 None
2026-03-30 07:43:25 [auto1.de] INFO: Scrape type for RZ99970: 0
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: LM10122
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: SD32112
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD32112%27 HTTP/1.1" 200 None
2026-03-30 07:43:25 [auto1.de] INFO: Scrape type for SD32112: 0
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: ZE40568
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: AU35390
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU35390%27 HTTP/1.1" 200 None
2026-03-30 07:43:25 [auto1.de] INFO: Scrape type for AU35390: 0
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: VU50436
2026-03-30 07:43:25 [auto1.de] INFO: Found listing with ID: HR96195
2026-03-30 07:43:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR96195%27 HTTP/1.1" 200 None
2026-03-30 07:43:26 [auto1.de] INFO: Scrape type for HR96195: 0
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: EA74334
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA74334%27 HTTP/1.1" 200 None
2026-03-30 07:43:26 [auto1.de] INFO: Scrape type for EA74334: 0
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: HG45518
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: FC83292
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: YH59538
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH59538%27 HTTP/1.1" 200 None
2026-03-30 07:43:26 [auto1.de] INFO: Scrape type for YH59538: 0
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: GN89832
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: VH10355
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH10355%27 HTTP/1.1" 200 None
2026-03-30 07:43:26 [auto1.de] INFO: Scrape type for VH10355: 0
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: GJ82118
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: HB62696
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: UP66494
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: BF27156
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: RE17232
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: RA54991
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA54991%27 HTTP/1.1" 200 None
2026-03-30 07:43:26 [auto1.de] INFO: Scrape type for RA54991: 0
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: DR38241
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: ED74506
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED74506%27 HTTP/1.1" 200 None
2026-03-30 07:43:26 [auto1.de] INFO: Scrape type for ED74506: 0
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: KE52706
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: FK87284
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: MJ60689
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ60689%27 HTTP/1.1" 200 None
2026-03-30 07:43:26 [auto1.de] INFO: Scrape type for MJ60689: 0
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: BP78735
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: VX13516
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: YP61369
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: KK19800
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: XZ94866
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: DV91076
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: DP29257
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP29257%27 HTTP/1.1" 200 None
2026-03-30 07:43:26 [auto1.de] INFO: Scrape type for DP29257: 0
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: JN34969
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-30 07:43:26 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-30 07:43:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:27 [auto1.de] INFO: Channel: 24h | Page: 80 | totalHits: 8219 | hits on page: 40
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: NC36065
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: ET79003
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: EW47494
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: UJ12211
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ12211%27 HTTP/1.1" 200 None
2026-03-30 07:43:27 [auto1.de] INFO: Scrape type for UJ12211: 0
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: VL85665
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: WY09596
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: PN64599
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN64599%27 HTTP/1.1" 200 None
2026-03-30 07:43:27 [auto1.de] INFO: Scrape type for PN64599: 0
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: NP37775
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP37775%27 HTTP/1.1" 200 None
2026-03-30 07:43:27 [auto1.de] INFO: Scrape type for NP37775: 0
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: NG80154
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG80154%27 HTTP/1.1" 200 None
2026-03-30 07:43:27 [auto1.de] INFO: Scrape type for NG80154: 0
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: CY44920
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY44920%27 HTTP/1.1" 200 None
2026-03-30 07:43:27 [auto1.de] INFO: Scrape type for CY44920: 0
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: LM85706
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: LA05422
2026-03-30 07:43:27 [auto1.de] INFO: Found listing with ID: UR14264
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14264%27 HTTP/1.1" 200 None
2026-03-30 07:43:27 [auto1.de] INFO: Scrape type for UR14264: 2
2026-03-30 07:43:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f608519a-5619-5bf6-98f8-8d63dc615d0b with identifier: UR14264
2026-03-30 07:43:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f608519a-5619-5bf6-98f8-8d63dc615d0b with scrape type 2
2026-03-30 07:43:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f608519a-5619-5bf6-98f8-8d63dc615d0b with scrape type 2
2026-03-30 07:43:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f608519a-5619-5bf6-98f8-8d63dc615d0b, identifier: UR14264
2026-03-30 07:43:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f608519a-5619-5bf6-98f8-8d63dc615d0b with identifier: UR14264
2026-03-30 07:43:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f608519a-5619-5bf6-98f8-8d63dc615d0b with identifier: UR14264
2026-03-30 07:43:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f608519a-5619-5bf6-98f8-8d63dc615d0b with identifier: UR14264 to the API
2026-03-30 07:43:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:20:35Z',
 'fuel_type': 'petrol',
 'id': 'f608519a-5619-5bf6-98f8-8d63dc615d0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR14264',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 95614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2017}
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR14264%27 HTTP/1.1" 200 None
2026-03-30 07:43:28 [auto1.de] INFO: Saving data for UR14264: {'auction_closing_time': 1774884035.0, 'created_time': 1774552924.887492, 'last_price_update_time': 1774856608.155615}
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR14264') HTTP/1.1" 204 0
2026-03-30 07:43:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: NM50493
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: AC69838
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC69838%27 HTTP/1.1" 200 None
2026-03-30 07:43:28 [auto1.de] INFO: Scrape type for AC69838: 0
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: RF79085
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: KN80130
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: KX50860
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: VE16712
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE16712%27 HTTP/1.1" 200 None
2026-03-30 07:43:28 [auto1.de] INFO: Scrape type for VE16712: 0
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: BE25239
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: FT64336
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT64336%27 HTTP/1.1" 200 None
2026-03-30 07:43:28 [auto1.de] INFO: Scrape type for FT64336: 0
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: JM07569
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM07569%27 HTTP/1.1" 200 None
2026-03-30 07:43:28 [auto1.de] INFO: Scrape type for JM07569: 0
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: JG35367
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35367%27 HTTP/1.1" 200 None
2026-03-30 07:43:28 [auto1.de] INFO: Scrape type for JG35367: 0
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: LK12001
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: XJ52823
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ52823%27 HTTP/1.1" 200 None
2026-03-30 07:43:28 [auto1.de] INFO: Scrape type for XJ52823: 0
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: UR98494
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98494%27 HTTP/1.1" 200 None
2026-03-30 07:43:28 [auto1.de] INFO: Scrape type for UR98494: 2
2026-03-30 07:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f38544af-9d7b-507e-931b-e0eebea7646f with identifier: UR98494
2026-03-30 07:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f38544af-9d7b-507e-931b-e0eebea7646f with scrape type 2
2026-03-30 07:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f38544af-9d7b-507e-931b-e0eebea7646f with scrape type 2
2026-03-30 07:43:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f38544af-9d7b-507e-931b-e0eebea7646f, identifier: UR98494
2026-03-30 07:43:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f38544af-9d7b-507e-931b-e0eebea7646f with identifier: UR98494
2026-03-30 07:43:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f38544af-9d7b-507e-931b-e0eebea7646f with identifier: UR98494
2026-03-30 07:43:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f38544af-9d7b-507e-931b-e0eebea7646f with identifier: UR98494 to the API
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:43:44Z',
 'fuel_type': 'petrol',
 'id': 'f38544af-9d7b-507e-931b-e0eebea7646f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR98494',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 257313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR98494%27 HTTP/1.1" 200 None
2026-03-30 07:43:28 [auto1.de] INFO: Saving data for UR98494: {'auction_closing_time': 1774885424.0, 'created_time': 1774553184.708836, 'last_price_update_time': 1774856608.787511}
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR98494') HTTP/1.1" 204 0
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: GH47357
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: GU30537
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU30537%27 HTTP/1.1" 200 None
2026-03-30 07:43:28 [auto1.de] INFO: Scrape type for GU30537: 0
2026-03-30 07:43:28 [auto1.de] INFO: Found listing with ID: CC57472
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC57472%27 HTTP/1.1" 200 None
2026-03-30 07:43:28 [auto1.de] INFO: Scrape type for CC57472: 2
2026-03-30 07:43:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5164ab3d-e632-583f-8bd0-dfbd53336dfc with identifier: CC57472
2026-03-30 07:43:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5164ab3d-e632-583f-8bd0-dfbd53336dfc with scrape type 2
2026-03-30 07:43:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5164ab3d-e632-583f-8bd0-dfbd53336dfc with scrape type 2
2026-03-30 07:43:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5164ab3d-e632-583f-8bd0-dfbd53336dfc, identifier: CC57472
2026-03-30 07:43:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5164ab3d-e632-583f-8bd0-dfbd53336dfc with identifier: CC57472
2026-03-30 07:43:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5164ab3d-e632-583f-8bd0-dfbd53336dfc with identifier: CC57472
2026-03-30 07:43:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5164ab3d-e632-583f-8bd0-dfbd53336dfc with identifier: CC57472 to the API
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:53:02Z',
 'fuel_type': 'diesel',
 'id': '5164ab3d-e632-583f-8bd0-dfbd53336dfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CC57472',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 114533,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-24',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 250 CDI BlueEfficiency Elegance',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Elegance',
 'year': 2013}
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC57472%27 HTTP/1.1" 200 None
2026-03-30 07:43:29 [auto1.de] INFO: Saving data for CC57472: {'auction_closing_time': 1774885982.0, 'created_time': 1774552896.480804, 'last_price_update_time': 1774856609.30778}
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CC57472') HTTP/1.1" 204 0
2026-03-30 07:43:29 [auto1.de] INFO: Found listing with ID: RU25678
2026-03-30 07:43:29 [auto1.de] INFO: Found listing with ID: YY13521
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY13521%27 HTTP/1.1" 200 None
2026-03-30 07:43:29 [auto1.de] INFO: Scrape type for YY13521: 0
2026-03-30 07:43:29 [auto1.de] INFO: Found listing with ID: ZM88762
2026-03-30 07:43:29 [auto1.de] INFO: Found listing with ID: BU00695
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00695%27 HTTP/1.1" 200 None
2026-03-30 07:43:29 [auto1.de] INFO: Scrape type for BU00695: 0
2026-03-30 07:43:29 [auto1.de] INFO: Found listing with ID: GV09290
2026-03-30 07:43:29 [auto1.de] INFO: Found listing with ID: GH30720
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH30720%27 HTTP/1.1" 200 None
2026-03-30 07:43:29 [auto1.de] INFO: Scrape type for GH30720: 0
2026-03-30 07:43:29 [auto1.de] INFO: Found listing with ID: ER31380
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER31380%27 HTTP/1.1" 200 None
2026-03-30 07:43:29 [auto1.de] INFO: Scrape type for ER31380: 0
2026-03-30 07:43:29 [auto1.de] INFO: Found listing with ID: YS02767
2026-03-30 07:43:29 [auto1.de] INFO: Found listing with ID: CJ94642
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94642%27 HTTP/1.1" 200 None
2026-03-30 07:43:29 [auto1.de] INFO: Scrape type for CJ94642: 0
2026-03-30 07:43:29 [auto1.de] INFO: Found listing with ID: WF16745
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF16745%27 HTTP/1.1" 200 None
2026-03-30 07:43:29 [auto1.de] INFO: Scrape type for WF16745: 0
2026-03-30 07:43:29 [auto1.de] INFO: Found listing with ID: KL90594
2026-03-30 07:43:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:30 [auto1.de] INFO: Channel: 24h | Page: 81 | totalHits: 8219 | hits on page: 40
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: ZP86837
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP86837%27 HTTP/1.1" 200 None
2026-03-30 07:43:30 [auto1.de] INFO: Scrape type for ZP86837: 0
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: TL07964
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL07964%27 HTTP/1.1" 200 None
2026-03-30 07:43:30 [auto1.de] INFO: Scrape type for TL07964: 0
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: JZ68133
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: YW15548
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: SR15436
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR15436%27 HTTP/1.1" 200 None
2026-03-30 07:43:30 [auto1.de] INFO: Scrape type for SR15436: 0
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: DF45808
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF45808%27 HTTP/1.1" 200 None
2026-03-30 07:43:30 [auto1.de] INFO: Scrape type for DF45808: 0
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: UC84662
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC84662%27 HTTP/1.1" 200 None
2026-03-30 07:43:30 [auto1.de] INFO: Scrape type for UC84662: 0
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: SW57264
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW57264%27 HTTP/1.1" 200 None
2026-03-30 07:43:30 [auto1.de] INFO: Scrape type for SW57264: 0
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: DX01657
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: KW12270
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: CP43977
2026-03-30 07:43:30 [auto1.de] INFO: Found listing with ID: PH27110
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH27110%27 HTTP/1.1" 200 None
2026-03-30 07:43:30 [auto1.de] INFO: Scrape type for PH27110: 2
2026-03-30 07:43:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with identifier: PH27110
2026-03-30 07:43:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with scrape type 2
2026-03-30 07:43:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with scrape type 2
2026-03-30 07:43:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d, identifier: PH27110
2026-03-30 07:43:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with identifier: PH27110
2026-03-30 07:43:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with identifier: PH27110
2026-03-30 07:43:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fc0e5d1-5469-54bd-a54f-04c84f2dba3d with identifier: PH27110 to the API
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:41:27Z',
 'fuel_type': 'diesel',
 'id': '2fc0e5d1-5469-54bd-a54f-04c84f2dba3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PH27110',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 67245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-20',
 'seller_name': None,
 'title': 'Hyundai Tucson 2.0 CRDi Intro Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Intro Edition 4WD',
 'year': 2017}
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH27110%27 HTTP/1.1" 200 None
2026-03-30 07:43:30 [auto1.de] INFO: Saving data for PH27110: {'auction_closing_time': 1774885287.0, 'created_time': 1774552916.608733, 'last_price_update_time': 1774856610.935046}
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PH27110') HTTP/1.1" 204 0
2026-03-30 07:43:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: FT91695
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT91695%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Scrape type for FT91695: 0
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: DT77440
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: VV46432
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV46432%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Scrape type for VV46432: 0
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: DP90284
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: LZ58710
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ58710%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Scrape type for LZ58710: 0
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: SJ26339
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ26339%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Scrape type for SJ26339: 0
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: KM87247
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: ME45713
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: EG39576
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG39576%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Scrape type for EG39576: 0
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: WK97473
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK97473%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Scrape type for WK97473: 2
2026-03-30 07:43:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with identifier: WK97473
2026-03-30 07:43:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with scrape type 2
2026-03-30 07:43:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with scrape type 2
2026-03-30 07:43:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fe2c93e-939e-5999-8a8d-39c04e73ca01, identifier: WK97473
2026-03-30 07:43:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with identifier: WK97473
2026-03-30 07:43:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with identifier: WK97473
2026-03-30 07:43:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fe2c93e-939e-5999-8a8d-39c04e73ca01 with identifier: WK97473 to the API
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:06Z',
 'fuel_type': 'diesel',
 'id': '7fe2c93e-939e-5999-8a8d-39c04e73ca01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK97473',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 96358,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-30',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Beach BlueMotion',
 'transmission': 'automatic',
 'trim': 'Maxi Beach BlueMotion',
 'year': 2017}
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK97473%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Saving data for WK97473: {'auction_closing_time': 1774885866.0, 'created_time': 1774552637.633485, 'last_price_update_time': 1774856611.875191}
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK97473') HTTP/1.1" 204 0
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: VG38985
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG38985%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Scrape type for VG38985: 0
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: SN99491
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN99491%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Scrape type for SN99491: 0
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: RM44288
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM44288%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Scrape type for RM44288: 0
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: UZ90391
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: KR04535
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: RT10354
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: KV78740
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: ZN20301
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: YN10477
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: WP28886
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: FL12267
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL12267%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Scrape type for FL12267: 0
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: AB87355
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: PY92753
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY92753%27 HTTP/1.1" 200 None
2026-03-30 07:43:31 [auto1.de] INFO: Scrape type for PY92753: 0
2026-03-30 07:43:31 [auto1.de] INFO: Found listing with ID: LJ04369
2026-03-30 07:43:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ04369%27 HTTP/1.1" 200 None
2026-03-30 07:43:32 [auto1.de] INFO: Scrape type for LJ04369: 0
2026-03-30 07:43:32 [auto1.de] INFO: Found listing with ID: RZ52630
2026-03-30 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ52630%27 HTTP/1.1" 200 None
2026-03-30 07:43:32 [auto1.de] INFO: Scrape type for RZ52630: 0
2026-03-30 07:43:32 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-30 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-30 07:43:32 [auto1.de] INFO: Scrape type for SD72223: 0
2026-03-30 07:43:32 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-30 07:43:32 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-30 07:43:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:33 [auto1.de] INFO: Channel: 24h | Page: 82 | totalHits: 8222 | hits on page: 40
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: SD72223
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD72223%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for SD72223: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: ZD28576
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: EC78476
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: FB31140
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: BA95413
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: FU53159
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU53159%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for FU53159: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: RE63795
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: XL62342
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: JX37368
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX37368%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for JX37368: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: MZ72792
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: DW76497
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW76497%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for DW76497: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: WV94095
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: HU57590
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: PD00543
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: HB06049
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: VL06718
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: BJ60837
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: YP91741
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP91741%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for YP91741: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: LJ93781
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: DU27539
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: DF63833
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF63833%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for DF63833: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: BP81340
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP81340%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for BP81340: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: RN03307
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: FU39624
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU39624%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for FU39624: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: UR77035
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: EM22494
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM22494%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for EM22494: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: UD59606
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD59606%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for UD59606: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: SW83321
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW83321%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for SW83321: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: PA37640
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA37640%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for PA37640: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: NN66597
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: MU50288
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU50288%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for MU50288: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: MV18053
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV18053%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for MV18053: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: KA22944
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA22944%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for KA22944: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: YN95759
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: JR17780
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: VG14564
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: EZ35619
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ35619%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for EZ35619: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: AP27918
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27918%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for AP27918: 0
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: PV27021
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV27021%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Scrape type for PV27021: 2
2026-03-30 07:43:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 591715ae-761e-5767-ba64-3f563f5f9da5 with identifier: PV27021
2026-03-30 07:43:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 591715ae-761e-5767-ba64-3f563f5f9da5 with scrape type 2
2026-03-30 07:43:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 591715ae-761e-5767-ba64-3f563f5f9da5 with scrape type 2
2026-03-30 07:43:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 591715ae-761e-5767-ba64-3f563f5f9da5, identifier: PV27021
2026-03-30 07:43:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 591715ae-761e-5767-ba64-3f563f5f9da5 with identifier: PV27021
2026-03-30 07:43:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 591715ae-761e-5767-ba64-3f563f5f9da5 with identifier: PV27021
2026-03-30 07:43:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 591715ae-761e-5767-ba64-3f563f5f9da5 with identifier: PV27021 to the API
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:57:00Z',
 'fuel_type': 'diesel',
 'id': '591715ae-761e-5767-ba64-3f563f5f9da5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV27021',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 161836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-14',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2017}
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV27021%27 HTTP/1.1" 200 None
2026-03-30 07:43:33 [auto1.de] INFO: Saving data for PV27021: {'auction_closing_time': 1774886220.0, 'created_time': 1774552809.127063, 'last_price_update_time': 1774856613.825175}
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV27021') HTTP/1.1" 204 0
2026-03-30 07:43:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:33 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-30 07:43:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:35 [auto1.de] INFO: Channel: 24h | Page: 83 | totalHits: 8223 | hits on page: 40
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: HB13325
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: WY54008
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: FU04810
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: GV91046
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: HB67029
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB67029%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for HB67029: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: ED00109
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: PK38056
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK38056%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for PK38056: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: GM08795
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM08795%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for GM08795: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: LR95574
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR95574%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for LR95574: 2
2026-03-30 07:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f9888e9-5198-55d5-bf70-5a63223f2854 with identifier: LR95574
2026-03-30 07:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f9888e9-5198-55d5-bf70-5a63223f2854 with scrape type 2
2026-03-30 07:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f9888e9-5198-55d5-bf70-5a63223f2854 with scrape type 2
2026-03-30 07:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f9888e9-5198-55d5-bf70-5a63223f2854, identifier: LR95574
2026-03-30 07:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f9888e9-5198-55d5-bf70-5a63223f2854 with identifier: LR95574
2026-03-30 07:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f9888e9-5198-55d5-bf70-5a63223f2854 with identifier: LR95574
2026-03-30 07:43:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f9888e9-5198-55d5-bf70-5a63223f2854 with identifier: LR95574 to the API
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:48:57Z',
 'fuel_type': 'petrol',
 'id': '1f9888e9-5198-55d5-bf70-5a63223f2854',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR95574',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 172225,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-04',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR95574%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Saving data for LR95574: {'auction_closing_time': 1774885737.0, 'created_time': 1774551195.190847, 'last_price_update_time': 1774856615.571142}
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR95574') HTTP/1.1" 204 0
2026-03-30 07:43:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: SB60272
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: FG07323
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: RZ48384
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: GA42145
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: NZ25875
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ25875%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for NZ25875: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: XB39806
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB39806%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for XB39806: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: LG85121
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG85121%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for LG85121: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: YU93919
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU93919%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for YU93919: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: XY68410
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: YR11157
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR11157%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for YR11157: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: TN32015
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: TE25882
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE25882%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for TE25882: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: LR74805
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR74805%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for LR74805: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: DZ79939
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: DA23811
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: TD17986
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: DC30039
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC30039%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for DC30039: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: MX03618
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX03618%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for MX03618: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: RV99753
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: XS38036
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: AS21942
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: JS29851
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS29851%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for JS29851: 0
2026-03-30 07:43:35 [auto1.de] INFO: Found listing with ID: VM82441
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM82441%27 HTTP/1.1" 200 None
2026-03-30 07:43:35 [auto1.de] INFO: Scrape type for VM82441: 2
2026-03-30 07:43:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with identifier: VM82441
2026-03-30 07:43:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with scrape type 2
2026-03-30 07:43:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with scrape type 2
2026-03-30 07:43:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0bd1825-3bc3-5f42-b51b-e78dce8db0dd, identifier: VM82441
2026-03-30 07:43:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with identifier: VM82441
2026-03-30 07:43:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with identifier: VM82441
2026-03-30 07:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0bd1825-3bc3-5f42-b51b-e78dce8db0dd with identifier: VM82441 to the API
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:16:22Z',
 'fuel_type': 'petrol',
 'id': 'e0bd1825-3bc3-5f42-b51b-e78dce8db0dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM82441',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 37901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-26',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM82441%27 HTTP/1.1" 200 None
2026-03-30 07:43:36 [auto1.de] INFO: Saving data for VM82441: {'auction_closing_time': 1774883782.0, 'created_time': 1774552140.071294, 'last_price_update_time': 1774856616.192504}
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM82441') HTTP/1.1" 204 0
2026-03-30 07:43:36 [auto1.de] INFO: Found listing with ID: UK63954
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63954%27 HTTP/1.1" 200 None
2026-03-30 07:43:36 [auto1.de] INFO: Scrape type for UK63954: 0
2026-03-30 07:43:36 [auto1.de] INFO: Found listing with ID: MB94614
2026-03-30 07:43:36 [auto1.de] INFO: Found listing with ID: MP20467
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP20467%27 HTTP/1.1" 200 None
2026-03-30 07:43:36 [auto1.de] INFO: Scrape type for MP20467: 0
2026-03-30 07:43:36 [auto1.de] INFO: Found listing with ID: CF62011
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF62011%27 HTTP/1.1" 200 None
2026-03-30 07:43:36 [auto1.de] INFO: Scrape type for CF62011: 2
2026-03-30 07:43:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0605991-f0b8-542c-981b-c40ce1c6bd44 with identifier: CF62011
2026-03-30 07:43:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0605991-f0b8-542c-981b-c40ce1c6bd44 with scrape type 2
2026-03-30 07:43:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0605991-f0b8-542c-981b-c40ce1c6bd44 with scrape type 2
2026-03-30 07:43:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0605991-f0b8-542c-981b-c40ce1c6bd44, identifier: CF62011
2026-03-30 07:43:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0605991-f0b8-542c-981b-c40ce1c6bd44 with identifier: CF62011
2026-03-30 07:43:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0605991-f0b8-542c-981b-c40ce1c6bd44 with identifier: CF62011
2026-03-30 07:43:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0605991-f0b8-542c-981b-c40ce1c6bd44 with identifier: CF62011 to the API
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:38:51Z',
 'fuel_type': 'petrol',
 'id': 'e0605991-f0b8-542c-981b-c40ce1c6bd44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF62011',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Altea',
 'odometer': 156329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-01',
 'seller_name': None,
 'title': 'Seat Altea 1.4 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2010}
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF62011%27 HTTP/1.1" 200 None
2026-03-30 07:43:36 [auto1.de] INFO: Saving data for CF62011: {'auction_closing_time': 1774885131.0, 'created_time': 1774552692.850183, 'last_price_update_time': 1774856616.719806}
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF62011') HTTP/1.1" 204 0
2026-03-30 07:43:36 [auto1.de] INFO: Found listing with ID: DT00101
2026-03-30 07:43:36 [auto1.de] INFO: Found listing with ID: KC92334
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC92334%27 HTTP/1.1" 200 None
2026-03-30 07:43:36 [auto1.de] INFO: Scrape type for KC92334: 0
2026-03-30 07:43:36 [auto1.de] INFO: Found listing with ID: HS55483
2026-03-30 07:43:36 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07510%27 HTTP/1.1" 200 None
2026-03-30 07:43:36 [auto1.de] INFO: Scrape type for FK07510: 0
2026-03-30 07:43:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:37 [auto1.de] INFO: Channel: 24h | Page: 84 | totalHits: 8224 | hits on page: 40
2026-03-30 07:43:37 [auto1.de] INFO: Found listing with ID: FK07510
2026-03-30 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK07510%27 HTTP/1.1" 200 None
2026-03-30 07:43:37 [auto1.de] INFO: Scrape type for FK07510: 0
2026-03-30 07:43:37 [auto1.de] INFO: Found listing with ID: WF80406
2026-03-30 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF80406%27 HTTP/1.1" 200 None
2026-03-30 07:43:37 [auto1.de] INFO: Scrape type for WF80406: 0
2026-03-30 07:43:37 [auto1.de] INFO: Found listing with ID: CR26855
2026-03-30 07:43:37 [auto1.de] INFO: Found listing with ID: BR02307
2026-03-30 07:43:37 [auto1.de] INFO: Found listing with ID: VP02166
2026-03-30 07:43:37 [auto1.de] INFO: Found listing with ID: DF30572
2026-03-30 07:43:37 [auto1.de] INFO: Found listing with ID: SV15826
2026-03-30 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV15826%27 HTTP/1.1" 200 None
2026-03-30 07:43:37 [auto1.de] INFO: Scrape type for SV15826: 0
2026-03-30 07:43:37 [auto1.de] INFO: Found listing with ID: RS09713
2026-03-30 07:43:37 [auto1.de] INFO: Found listing with ID: PJ17742
2026-03-30 07:43:37 [auto1.de] INFO: Found listing with ID: FK97856
2026-03-30 07:43:37 [auto1.de] INFO: Found listing with ID: ST87748
2026-03-30 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST87748%27 HTTP/1.1" 200 None
2026-03-30 07:43:37 [auto1.de] INFO: Scrape type for ST87748: 2
2026-03-30 07:43:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with identifier: ST87748
2026-03-30 07:43:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with scrape type 2
2026-03-30 07:43:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with scrape type 2
2026-03-30 07:43:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a, identifier: ST87748
2026-03-30 07:43:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with identifier: ST87748
2026-03-30 07:43:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with identifier: ST87748
2026-03-30 07:43:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a with identifier: ST87748 to the API
2026-03-30 07:43:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:22Z',
 'fuel_type': 'diesel',
 'id': '6fc972fa-7fa7-5bef-b0a5-f45fc2eb198a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST87748',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 96570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-08',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten EcoProfi',
 'transmission': 'automatic',
 'trim': 'Kasten EcoProfi',
 'year': 2019}
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST87748%27 HTTP/1.1" 200 None
2026-03-30 07:43:38 [auto1.de] INFO: Saving data for ST87748: {'auction_closing_time': 1774885402.0, 'created_time': 1774552741.369987, 'last_price_update_time': 1774856618.171924}
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST87748') HTTP/1.1" 204 0
2026-03-30 07:43:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:38 [auto1.de] INFO: Found listing with ID: RB89503
2026-03-30 07:43:38 [auto1.de] INFO: Found listing with ID: EY26571
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY26571%27 HTTP/1.1" 200 None
2026-03-30 07:43:38 [auto1.de] INFO: Scrape type for EY26571: 2
2026-03-30 07:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b03218-6889-5977-8daf-14e0ba27b920 with identifier: EY26571
2026-03-30 07:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b03218-6889-5977-8daf-14e0ba27b920 with scrape type 2
2026-03-30 07:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71b03218-6889-5977-8daf-14e0ba27b920 with scrape type 2
2026-03-30 07:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71b03218-6889-5977-8daf-14e0ba27b920, identifier: EY26571
2026-03-30 07:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71b03218-6889-5977-8daf-14e0ba27b920 with identifier: EY26571
2026-03-30 07:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71b03218-6889-5977-8daf-14e0ba27b920 with identifier: EY26571
2026-03-30 07:43:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71b03218-6889-5977-8daf-14e0ba27b920 with identifier: EY26571 to the API
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:06:52Z',
 'fuel_type': 'petrol',
 'id': '71b03218-6889-5977-8daf-14e0ba27b920',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY26571',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 41382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI R 4Motion',
 'transmission': 'automatic',
 'trim': 'R 4Motion',
 'year': 2023}
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY26571%27 HTTP/1.1" 200 None
2026-03-30 07:43:38 [auto1.de] INFO: Saving data for EY26571: {'auction_closing_time': 1774883212.0, 'created_time': 1774553179.990372, 'last_price_update_time': 1774856618.753324}
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY26571') HTTP/1.1" 204 0
2026-03-30 07:43:38 [auto1.de] INFO: Found listing with ID: HE35464
2026-03-30 07:43:38 [auto1.de] INFO: Found listing with ID: JN99222
2026-03-30 07:43:38 [auto1.de] INFO: Found listing with ID: WP86079
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP86079%27 HTTP/1.1" 200 None
2026-03-30 07:43:38 [auto1.de] INFO: Scrape type for WP86079: 2
2026-03-30 07:43:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with identifier: WP86079
2026-03-30 07:43:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with scrape type 2
2026-03-30 07:43:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with scrape type 2
2026-03-30 07:43:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6a9ca4f-4a4b-5547-beb1-e61a0974eedb, identifier: WP86079
2026-03-30 07:43:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with identifier: WP86079
2026-03-30 07:43:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with identifier: WP86079
2026-03-30 07:43:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6a9ca4f-4a4b-5547-beb1-e61a0974eedb with identifier: WP86079 to the API
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:21:41Z',
 'fuel_type': 'petrol',
 'id': 'a6a9ca4f-4a4b-5547-beb1-e61a0974eedb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP86079',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 147390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP86079%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Saving data for WP86079: {'auction_closing_time': 1774884101.0, 'created_time': 1774550732.379042, 'last_price_update_time': 1774856619.636776}
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP86079') HTTP/1.1" 204 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: DF02739
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: LN30435
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN30435%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for LN30435: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: DL97595
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL97595%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for DL97595: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: VE57105
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE57105%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for VE57105: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: CL06528
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: GH93549
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: UB25361
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB25361%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for UB25361: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: VK94352
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: CC99000
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC99000%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for CC99000: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: YS81277
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: TN63570
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63570%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for TN63570: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: CB12842
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB12842%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for CB12842: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: UC38867
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: HH61225
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: FH53485
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH53485%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for FH53485: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: VF83806
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: UG93766
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG93766%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for UG93766: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: JB33429
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB33429%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for JB33429: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: DL95499
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL95499%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for DL95499: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for PX08843: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for AL34551: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-30 07:43:39 [auto1.de] INFO: Scrape type for CK59033: 0
2026-03-30 07:43:39 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-30 07:43:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:41 [auto1.de] INFO: Channel: 24h | Page: 85 | totalHits: 8229 | hits on page: 40
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: PX08843
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX08843%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for PX08843: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: AL34551
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL34551%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for AL34551: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: TG33672
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: CK59033
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK59033%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for CK59033: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: NR64586
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: DT42363
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT42363%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for DT42363: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: GC11605
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: GE96921
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96921%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for GE96921: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: FW30112
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: JW75116
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW75116%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for JW75116: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: FM53272
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: UN96808
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN96808%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for UN96808: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: DW78199
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW78199%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for DW78199: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: DM95893
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM95893%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for DM95893: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: HB72145
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: UL70410
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: JS73501
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS73501%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for JS73501: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: DE41778
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE41778%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for DE41778: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: GE16553
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE16553%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for GE16553: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: RL23601
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: UL41666
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: GB33155
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB33155%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for GB33155: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: EB33579
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: AZ05535
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: UZ81937
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: DW36097
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: SP97012
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP97012%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for SP97012: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: MA42451
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA42451%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for MA42451: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: MC22222
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: AU85949
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU85949%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for AU85949: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: UB34830
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: EL90308
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL90308%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for EL90308: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: YF48046
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: FH94786
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: DH13363
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: CH56246
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH56246%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for CH56246: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: KV57112
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV57112%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for KV57112: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: VK31305
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK31305%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for VK31305: 0
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: KX26949
2026-03-30 07:43:41 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-30 07:43:41 [auto1.de] INFO: Scrape type for ZR08367: 0
2026-03-30 07:43:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:42 [auto1.de] INFO: Channel: 24h | Page: 86 | totalHits: 8230 | hits on page: 40
2026-03-30 07:43:42 [auto1.de] INFO: Found listing with ID: ZR08367
2026-03-30 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR08367%27 HTTP/1.1" 200 None
2026-03-30 07:43:42 [auto1.de] INFO: Scrape type for ZR08367: 0
2026-03-30 07:43:42 [auto1.de] INFO: Found listing with ID: GC04938
2026-03-30 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC04938%27 HTTP/1.1" 200 None
2026-03-30 07:43:42 [auto1.de] INFO: Scrape type for GC04938: 0
2026-03-30 07:43:42 [auto1.de] INFO: Found listing with ID: RN18911
2026-03-30 07:43:42 [auto1.de] INFO: Found listing with ID: MR96643
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR96643%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for MR96643: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: WJ71458
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ71458%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for WJ71458: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: VW82123
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: JJ95706
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: SX77194
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX77194%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for SX77194: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: DD89889
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: XZ35475
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ35475%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for XZ35475: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: CS76015
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS76015%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for CS76015: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: UH40808
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH40808%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for UH40808: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: XU52502
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU52502%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for XU52502: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: AX51342
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: UA36533
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: CT74985
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: YJ51408
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ51408%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for YJ51408: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: SG56142
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: XN70423
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: TB82704
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: YJ71992
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: VG55778
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: EX27277
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX27277%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for EX27277: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: MZ60723
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ60723%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for MZ60723: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: VX50427
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX50427%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for VX50427: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: AD73380
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: UA25868
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25868%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for UA25868: 2
2026-03-30 07:43:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be6654d5-1e7c-55da-9895-1e45d0796f4a with identifier: UA25868
2026-03-30 07:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item be6654d5-1e7c-55da-9895-1e45d0796f4a with scrape type 2
2026-03-30 07:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item be6654d5-1e7c-55da-9895-1e45d0796f4a with scrape type 2
2026-03-30 07:43:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: be6654d5-1e7c-55da-9895-1e45d0796f4a, identifier: UA25868
2026-03-30 07:43:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: be6654d5-1e7c-55da-9895-1e45d0796f4a with identifier: UA25868
2026-03-30 07:43:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: be6654d5-1e7c-55da-9895-1e45d0796f4a with identifier: UA25868
2026-03-30 07:43:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: be6654d5-1e7c-55da-9895-1e45d0796f4a with identifier: UA25868 to the API
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:00:29Z',
 'fuel_type': 'petrol',
 'id': 'be6654d5-1e7c-55da-9895-1e45d0796f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA25868',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 145055,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-29',
 'seller_name': None,
 'title': 'Honda Jazz 1.4 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2013}
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25868%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Saving data for UA25868: {'auction_closing_time': 1774882829.0, 'created_time': 1774553082.473147, 'last_price_update_time': 1774856623.711349}
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA25868') HTTP/1.1" 204 0
2026-03-30 07:43:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: LD21016
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: JC56914
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: PA09921
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: GB19657
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB19657%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for GB19657: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: EJ57142
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: JJ39643
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ39643%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for JJ39643: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: ZC19539
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: FG50189
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: WB12349
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB12349%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for WB12349: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: KL38868
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL38868%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for KL38868: 0
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: ZA19141
2026-03-30 07:43:43 [auto1.de] INFO: Found listing with ID: BJ31953
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ31953%27 HTTP/1.1" 200 None
2026-03-30 07:43:43 [auto1.de] INFO: Scrape type for BJ31953: 2
2026-03-30 07:43:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94bdcb7e-33e1-5949-b51c-976356011629 with identifier: BJ31953
2026-03-30 07:43:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94bdcb7e-33e1-5949-b51c-976356011629 with scrape type 2
2026-03-30 07:43:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94bdcb7e-33e1-5949-b51c-976356011629 with scrape type 2
2026-03-30 07:43:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94bdcb7e-33e1-5949-b51c-976356011629, identifier: BJ31953
2026-03-30 07:43:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94bdcb7e-33e1-5949-b51c-976356011629 with identifier: BJ31953
2026-03-30 07:43:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94bdcb7e-33e1-5949-b51c-976356011629 with identifier: BJ31953
2026-03-30 07:43:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94bdcb7e-33e1-5949-b51c-976356011629 with identifier: BJ31953 to the API
2026-03-30 07:43:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:40:33Z',
 'fuel_type': 'diesel',
 'id': '94bdcb7e-33e1-5949-b51c-976356011629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ31953',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 79378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-13',
 'seller_name': None,
 'title': 'Opel Combo 1.5 CDTI Edition XL erhöhte Nutzlast',
 'transmission': 'manual',
 'trim': 'Edition XL erhöhte Nutzlast',
 'year': 2019}
2026-03-30 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ31953%27 HTTP/1.1" 200 None
2026-03-30 07:43:44 [auto1.de] INFO: Saving data for BJ31953: {'auction_closing_time': 1774885233.0, 'created_time': 1774552495.707403, 'last_price_update_time': 1774856624.334955}
2026-03-30 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ31953') HTTP/1.1" 204 0
2026-03-30 07:43:44 [auto1.de] INFO: Found listing with ID: BU60385
2026-03-30 07:43:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:45 [auto1.de] INFO: Channel: 24h | Page: 87 | totalHits: 8230 | hits on page: 40
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: DB09023
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09023%27 HTTP/1.1" 200 None
2026-03-30 07:43:45 [auto1.de] INFO: Scrape type for DB09023: 0
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: MK35059
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: DF93652
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF93652%27 HTTP/1.1" 200 None
2026-03-30 07:43:45 [auto1.de] INFO: Scrape type for DF93652: 0
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: VM51620
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: PY88606
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: MA41049
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: WJ04835
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: TX40951
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: BU16541
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: EA67695
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: GP15297
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: AV25336
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: BG86685
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: ER78775
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: TL76772
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL76772%27 HTTP/1.1" 200 None
2026-03-30 07:43:45 [auto1.de] INFO: Scrape type for TL76772: 0
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: ZN73895
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN73895%27 HTTP/1.1" 200 None
2026-03-30 07:43:45 [auto1.de] INFO: Scrape type for ZN73895: 2
2026-03-30 07:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895
2026-03-30 07:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdf748ad-260c-52e1-afb0-701034a3a560 with scrape type 2
2026-03-30 07:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdf748ad-260c-52e1-afb0-701034a3a560 with scrape type 2
2026-03-30 07:43:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdf748ad-260c-52e1-afb0-701034a3a560, identifier: ZN73895
2026-03-30 07:43:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895
2026-03-30 07:43:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895
2026-03-30 07:43:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdf748ad-260c-52e1-afb0-701034a3a560 with identifier: ZN73895 to the API
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:46:36Z',
 'fuel_type': 'diesel',
 'id': 'bdf748ad-260c-52e1-afb0-701034a3a560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN73895',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 78681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-14',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN73895%27 HTTP/1.1" 200 None
2026-03-30 07:43:45 [auto1.de] INFO: Saving data for ZN73895: {'auction_closing_time': 1774885596.0, 'created_time': 1774550699.262073, 'last_price_update_time': 1774856625.808025}
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN73895') HTTP/1.1" 204 0
2026-03-30 07:43:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: LA66980
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: LT09542
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: TM25044
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: EC81606
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC81606%27 HTTP/1.1" 200 None
2026-03-30 07:43:45 [auto1.de] INFO: Scrape type for EC81606: 0
2026-03-30 07:43:45 [auto1.de] INFO: Found listing with ID: WA89012
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA89012%27 HTTP/1.1" 200 None
2026-03-30 07:43:45 [auto1.de] INFO: Scrape type for WA89012: 2
2026-03-30 07:43:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8164d876-1647-548b-a032-1ae40db9998c with identifier: WA89012
2026-03-30 07:43:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8164d876-1647-548b-a032-1ae40db9998c with scrape type 2
2026-03-30 07:43:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8164d876-1647-548b-a032-1ae40db9998c with scrape type 2
2026-03-30 07:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8164d876-1647-548b-a032-1ae40db9998c, identifier: WA89012
2026-03-30 07:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8164d876-1647-548b-a032-1ae40db9998c with identifier: WA89012
2026-03-30 07:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8164d876-1647-548b-a032-1ae40db9998c with identifier: WA89012
2026-03-30 07:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8164d876-1647-548b-a032-1ae40db9998c with identifier: WA89012 to the API
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 600,
 'expiration_date': '2026-03-30T15:56:03Z',
 'fuel_type': 'petrol',
 'id': '8164d876-1647-548b-a032-1ae40db9998c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA89012',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 118024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-11',
 'seller_name': None,
 'title': 'BMW 5er M5',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA89012%27 HTTP/1.1" 200 None
2026-03-30 07:43:46 [auto1.de] INFO: Saving data for WA89012: {'auction_closing_time': 1774886163.0, 'created_time': 1774550584.448565, 'last_price_update_time': 1774856626.366792}
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA89012') HTTP/1.1" 204 0
2026-03-30 07:43:46 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91844%27 HTTP/1.1" 200 None
2026-03-30 07:43:46 [auto1.de] INFO: Scrape type for MW91844: 0
2026-03-30 07:43:46 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-30 07:43:46 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX63179%27 HTTP/1.1" 200 None
2026-03-30 07:43:46 [auto1.de] INFO: Scrape type for XX63179: 0
2026-03-30 07:43:46 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-30 07:43:46 [auto1.de] INFO: Scrape type for HY47852: 0
2026-03-30 07:43:46 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA54301%27 HTTP/1.1" 200 None
2026-03-30 07:43:46 [auto1.de] INFO: Scrape type for VA54301: 0
2026-03-30 07:43:46 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-30 07:43:46 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-30 07:43:46 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09271%27 HTTP/1.1" 200 None
2026-03-30 07:43:46 [auto1.de] INFO: Scrape type for SM09271: 2
2026-03-30 07:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94b905d5-ed14-5215-8815-392c2acd6abf with identifier: SM09271
2026-03-30 07:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94b905d5-ed14-5215-8815-392c2acd6abf with scrape type 2
2026-03-30 07:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94b905d5-ed14-5215-8815-392c2acd6abf with scrape type 2
2026-03-30 07:43:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94b905d5-ed14-5215-8815-392c2acd6abf, identifier: SM09271
2026-03-30 07:43:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94b905d5-ed14-5215-8815-392c2acd6abf with identifier: SM09271
2026-03-30 07:43:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94b905d5-ed14-5215-8815-392c2acd6abf with identifier: SM09271
2026-03-30 07:43:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94b905d5-ed14-5215-8815-392c2acd6abf with identifier: SM09271 to the API
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:23:03Z',
 'fuel_type': 'petrol',
 'id': '94b905d5-ed14-5215-8815-392c2acd6abf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM09271',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 77068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-11-03',
 'seller_name': None,
 'title': 'BMW 3er 316ti',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09271%27 HTTP/1.1" 200 None
2026-03-30 07:43:46 [auto1.de] INFO: Saving data for SM09271: {'auction_closing_time': 1774884183.0, 'created_time': 1774552915.551267, 'last_price_update_time': 1774856626.840502}
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM09271') HTTP/1.1" 204 0
2026-03-30 07:43:46 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX42832%27 HTTP/1.1" 200 None
2026-03-30 07:43:46 [auto1.de] INFO: Scrape type for DX42832: 2
2026-03-30 07:43:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 962deb33-63f3-52ac-95aa-20ddc07a4d98 with identifier: DX42832
2026-03-30 07:43:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 962deb33-63f3-52ac-95aa-20ddc07a4d98 with scrape type 2
2026-03-30 07:43:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 962deb33-63f3-52ac-95aa-20ddc07a4d98 with scrape type 2
2026-03-30 07:43:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 962deb33-63f3-52ac-95aa-20ddc07a4d98, identifier: DX42832
2026-03-30 07:43:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 962deb33-63f3-52ac-95aa-20ddc07a4d98 with identifier: DX42832
2026-03-30 07:43:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 962deb33-63f3-52ac-95aa-20ddc07a4d98 with identifier: DX42832
2026-03-30 07:43:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 962deb33-63f3-52ac-95aa-20ddc07a4d98 with identifier: DX42832 to the API
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:09:12Z',
 'fuel_type': 'diesel',
 'id': '962deb33-63f3-52ac-95aa-20ddc07a4d98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX42832',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 209732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 220 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX42832%27 HTTP/1.1" 200 None
2026-03-30 07:43:47 [auto1.de] INFO: Saving data for DX42832: {'auction_closing_time': 1774883352.0, 'created_time': 1774552923.957043, 'last_price_update_time': 1774856627.371515}
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX42832') HTTP/1.1" 204 0
2026-03-30 07:43:47 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-30 07:43:47 [auto1.de] INFO: Scrape type for SY34106: 0
2026-03-30 07:43:47 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-30 07:43:47 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND90067%27 HTTP/1.1" 200 None
2026-03-30 07:43:47 [auto1.de] INFO: Scrape type for ND90067: 0
2026-03-30 07:43:47 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-30 07:43:47 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-30 07:43:47 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-30 07:43:47 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-30 07:43:47 [auto1.de] INFO: Scrape type for MF56816: 0
2026-03-30 07:43:47 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-30 07:43:47 [auto1.de] INFO: Scrape type for CK72953: 0
2026-03-30 07:43:47 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-30 07:43:47 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-30 07:43:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:43:58 [auto1.de] INFO: Channel: 24h | Page: 88 | totalHits: 8249 | hits on page: 40
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: MW91844
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91844%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for MW91844: 0
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: ZW55395
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: XX63179
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX63179%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for XX63179: 0
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: HY47852
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY47852%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for HY47852: 0
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: VA54301
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA54301%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for VA54301: 0
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: VY61993
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: MU33695
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: SM09271
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09271%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for SM09271: 0
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: DX42832
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX42832%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for DX42832: 0
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: SY34106
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY34106%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for SY34106: 0
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: LV04533
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: ND90067
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND90067%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for ND90067: 0
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: HJ54097
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: HA10430
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: RY91957
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: MF56816
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF56816%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for MF56816: 0
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: CK72953
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK72953%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for CK72953: 0
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: DX24804
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: KG08192
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: YM55237
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM55237%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for YM55237: 0
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: GL07101
2026-03-30 07:43:58 [auto1.de] INFO: Found listing with ID: PY46067
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY46067%27 HTTP/1.1" 200 None
2026-03-30 07:43:58 [auto1.de] INFO: Scrape type for PY46067: 2
2026-03-30 07:43:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb06dd25-b60f-520c-871a-a275b2853488 with identifier: PY46067
2026-03-30 07:43:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb06dd25-b60f-520c-871a-a275b2853488 with scrape type 2
2026-03-30 07:43:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb06dd25-b60f-520c-871a-a275b2853488 with scrape type 2
2026-03-30 07:43:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb06dd25-b60f-520c-871a-a275b2853488, identifier: PY46067
2026-03-30 07:43:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb06dd25-b60f-520c-871a-a275b2853488 with identifier: PY46067
2026-03-30 07:43:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb06dd25-b60f-520c-871a-a275b2853488 with identifier: PY46067
2026-03-30 07:43:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb06dd25-b60f-520c-871a-a275b2853488 with identifier: PY46067 to the API
2026-03-30 07:43:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:43:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:40:07Z',
 'fuel_type': 'diesel',
 'id': 'bb06dd25-b60f-520c-871a-a275b2853488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY46067',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 142725,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-12',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Business',
 'transmission': 'automatic',
 'trim': 'Business',
 'year': 2019}
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY46067%27 HTTP/1.1" 200 None
2026-03-30 07:43:59 [auto1.de] INFO: Saving data for PY46067: {'auction_closing_time': 1774885207.0, 'created_time': 1774552710.696205, 'last_price_update_time': 1774856639.639127}
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY46067') HTTP/1.1" 204 0
2026-03-30 07:43:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: GY23917
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY23917%27 HTTP/1.1" 200 None
2026-03-30 07:43:59 [auto1.de] INFO: Scrape type for GY23917: 0
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-30 07:43:59 [auto1.de] INFO: Scrape type for WB03477: 0
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC43616%27 HTTP/1.1" 200 None
2026-03-30 07:43:59 [auto1.de] INFO: Scrape type for NC43616: 0
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58590%27 HTTP/1.1" 200 None
2026-03-30 07:43:59 [auto1.de] INFO: Scrape type for SG58590: 0
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-30 07:43:59 [auto1.de] INFO: Scrape type for NL36228: 0
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-30 07:43:59 [auto1.de] INFO: Scrape type for SM09769: 0
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-30 07:43:59 [auto1.de] INFO: Scrape type for SA11985: 0
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA44966%27 HTTP/1.1" 200 None
2026-03-30 07:43:59 [auto1.de] INFO: Scrape type for RA44966: 0
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-30 07:43:59 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:43:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML64265%27 HTTP/1.1" 200 None
2026-03-30 07:43:59 [auto1.de] INFO: Scrape type for ML64265: 2
2026-03-30 07:43:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with identifier: ML64265
2026-03-30 07:43:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with scrape type 2
2026-03-30 07:43:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with scrape type 2
2026-03-30 07:43:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0b6f6c0-4157-54f8-a52c-e2f6e01484b9, identifier: ML64265
2026-03-30 07:43:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with identifier: ML64265
2026-03-30 07:43:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with identifier: ML64265
2026-03-30 07:44:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0b6f6c0-4157-54f8-a52c-e2f6e01484b9 with identifier: ML64265 to the API
2026-03-30 07:44:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:21Z',
 'fuel_type': 'petrol',
 'id': 'b0b6f6c0-4157-54f8-a52c-e2f6e01484b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML64265',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 119982,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-25',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-30 07:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML64265%27 HTTP/1.1" 200 None
2026-03-30 07:44:00 [auto1.de] INFO: Saving data for ML64265: {'auction_closing_time': 1774883181.0, 'created_time': 1774552709.145644, 'last_price_update_time': 1774856640.761197}
2026-03-30 07:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML64265') HTTP/1.1" 204 0
2026-03-30 07:44:00 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-30 07:44:00 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-30 07:44:00 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-30 07:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-30 07:44:00 [auto1.de] INFO: Scrape type for NU23717: 0
2026-03-30 07:44:00 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-30 07:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-30 07:44:00 [auto1.de] INFO: Scrape type for HB95489: 0
2026-03-30 07:44:06 [scrapy.extensions.logstats] INFO: Crawled 284 pages (at 15 pages/min), scraped 660 items (at 31 items/min)
2026-03-30 07:44:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:44:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:17 [auto1.de] INFO: Channel: 24h | Page: 89 | totalHits: 8266 | hits on page: 40
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: WB03477
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB03477%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for WB03477: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: NC43616
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC43616%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for NC43616: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: SG58590
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58590%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for SG58590: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: TE32041
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: YG72803
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: NL36228
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL36228%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for NL36228: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: HX34455
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: HX00306
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: SM09769
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM09769%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for SM09769: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: SA11985
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA11985%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for SA11985: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: RA44966
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA44966%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for RA44966: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: AR62221
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: ML64265
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML64265%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for ML64265: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: CY90259
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: BY14877
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: NU23717
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU23717%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for NU23717: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: HB95489
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB95489%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for HB95489: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: AV93240
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: RT79554
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT79554%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for RT79554: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: BZ09697
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: ZU18943
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU18943%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for ZU18943: 0
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: GC82813
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: PL23541
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: AB26225
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: ND33880
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: GE28071
2026-03-30 07:44:17 [auto1.de] INFO: Found listing with ID: CR61198
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR61198%27 HTTP/1.1" 200 None
2026-03-30 07:44:17 [auto1.de] INFO: Scrape type for CR61198: 2
2026-03-30 07:44:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with identifier: CR61198
2026-03-30 07:44:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with scrape type 2
2026-03-30 07:44:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with scrape type 2
2026-03-30 07:44:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2ac005df-39ad-5cf6-86e6-deda5dbf0f38, identifier: CR61198
2026-03-30 07:44:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with identifier: CR61198
2026-03-30 07:44:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with identifier: CR61198
2026-03-30 07:44:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2ac005df-39ad-5cf6-86e6-deda5dbf0f38 with identifier: CR61198 to the API
2026-03-30 07:44:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:55:11Z',
 'fuel_type': 'diesel',
 'id': '2ac005df-39ad-5cf6-86e6-deda5dbf0f38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR61198',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 151539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-02',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2018}
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR61198%27 HTTP/1.1" 200 None
2026-03-30 07:44:18 [auto1.de] INFO: Saving data for CR61198: {'auction_closing_time': 1774886111.0, 'created_time': 1774552740.41681, 'last_price_update_time': 1774856658.199992}
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR61198') HTTP/1.1" 204 0
2026-03-30 07:44:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: SC70285
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: FX62858
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: JJ68009
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ68009%27 HTTP/1.1" 200 None
2026-03-30 07:44:18 [auto1.de] INFO: Scrape type for JJ68009: 0
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: CF74386
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: ZP61360
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP61360%27 HTTP/1.1" 200 None
2026-03-30 07:44:18 [auto1.de] INFO: Scrape type for ZP61360: 0
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: XB46016
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: BX34768
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: UZ04747
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ04747%27 HTTP/1.1" 200 None
2026-03-30 07:44:18 [auto1.de] INFO: Scrape type for UZ04747: 2
2026-03-30 07:44:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with identifier: UZ04747
2026-03-30 07:44:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with scrape type 2
2026-03-30 07:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with scrape type 2
2026-03-30 07:44:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70, identifier: UZ04747
2026-03-30 07:44:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with identifier: UZ04747
2026-03-30 07:44:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with identifier: UZ04747
2026-03-30 07:44:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33c8ac28-1323-5291-a5e4-a3bc2d9a2e70 with identifier: UZ04747 to the API
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:20:35Z',
 'fuel_type': 'diesel',
 'id': '33c8ac28-1323-5291-a5e4-a3bc2d9a2e70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UZ04747',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 182584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-26',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Design Edition',
 'transmission': 'automatic',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ04747%27 HTTP/1.1" 200 None
2026-03-30 07:44:18 [auto1.de] INFO: Saving data for UZ04747: {'auction_closing_time': 1774884035.0, 'created_time': 1774552708.350387, 'last_price_update_time': 1774856658.77338}
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UZ04747') HTTP/1.1" 204 0
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB41592%27 HTTP/1.1" 200 None
2026-03-30 07:44:18 [auto1.de] INFO: Scrape type for PB41592: 0
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-30 07:44:18 [auto1.de] INFO: Scrape type for TV47355: 0
2026-03-30 07:44:18 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH96711%27 HTTP/1.1" 200 None
2026-03-30 07:44:18 [auto1.de] INFO: Scrape type for EH96711: 2
2026-03-30 07:44:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with identifier: EH96711
2026-03-30 07:44:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with scrape type 2
2026-03-30 07:44:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with scrape type 2
2026-03-30 07:44:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6e6930a-f47a-5c27-a0ac-e8a3602a3f82, identifier: EH96711
2026-03-30 07:44:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with identifier: EH96711
2026-03-30 07:44:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with identifier: EH96711
2026-03-30 07:44:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6e6930a-f47a-5c27-a0ac-e8a3602a3f82 with identifier: EH96711 to the API
2026-03-30 07:44:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:32:10Z',
 'fuel_type': 'diesel',
 'id': 'c6e6930a-f47a-5c27-a0ac-e8a3602a3f82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH96711',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 281510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-20',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH96711%27 HTTP/1.1" 200 None
2026-03-30 07:44:19 [auto1.de] INFO: Saving data for EH96711: {'auction_closing_time': 1774884730.0, 'created_time': 1773946608.675762, 'last_price_update_time': 1774856659.217493}
2026-03-30 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH96711') HTTP/1.1" 204 0
2026-03-30 07:44:19 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-30 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL56937%27 HTTP/1.1" 200 None
2026-03-30 07:44:19 [auto1.de] INFO: Scrape type for XL56937: 0
2026-03-30 07:44:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:20 [auto1.de] INFO: Channel: 24h | Page: 90 | totalHits: 8271 | hits on page: 40
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: CG17958
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: PB41592
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB41592%27 HTTP/1.1" 200 None
2026-03-30 07:44:20 [auto1.de] INFO: Scrape type for PB41592: 0
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: TV47355
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV47355%27 HTTP/1.1" 200 None
2026-03-30 07:44:20 [auto1.de] INFO: Scrape type for TV47355: 0
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: EH96711
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH96711%27 HTTP/1.1" 200 None
2026-03-30 07:44:20 [auto1.de] INFO: Scrape type for EH96711: 0
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: XL56937
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL56937%27 HTTP/1.1" 200 None
2026-03-30 07:44:20 [auto1.de] INFO: Scrape type for XL56937: 0
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: BN55276
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN55276%27 HTTP/1.1" 200 None
2026-03-30 07:44:20 [auto1.de] INFO: Scrape type for BN55276: 0
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: YF25460
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: FG09102
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: DE62797
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE62797%27 HTTP/1.1" 200 None
2026-03-30 07:44:20 [auto1.de] INFO: Scrape type for DE62797: 0
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: GJ72052
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: KJ55573
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: UT25770
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: XK87583
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: KE90255
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: YD46257
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: RP89370
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: TA14554
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: JT51313
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JT51313%27 HTTP/1.1" 200 None
2026-03-30 07:44:20 [auto1.de] INFO: Scrape type for JT51313: 0
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: PG30420
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: FX76120
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: DB28845
2026-03-30 07:44:20 [auto1.de] INFO: Found listing with ID: NF88064
2026-03-30 07:44:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF88064%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for NF88064: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: DG61616
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG61616%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for DG61616: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: AN15165
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN15165%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for AN15165: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: MH20468
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH20468%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for MH20468: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: VA07254
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: VW15579
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW15579%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for VW15579: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: VE65204
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE65204%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for VE65204: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: PV33295
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV33295%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for PV33295: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: UF84610
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: JV66840
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV66840%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for JV66840: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: DZ63876
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ63876%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for DZ63876: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: NW39371
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: JN58244
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN58244%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for JN58244: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: BP69075
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69075%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for BP69075: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: BH45132
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45132%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for BH45132: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: ZE28536
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE28536%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for ZE28536: 2
2026-03-30 07:44:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e743ccce-91d0-5b52-843a-b9f15e136d17 with identifier: ZE28536
2026-03-30 07:44:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e743ccce-91d0-5b52-843a-b9f15e136d17 with scrape type 2
2026-03-30 07:44:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e743ccce-91d0-5b52-843a-b9f15e136d17 with scrape type 2
2026-03-30 07:44:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e743ccce-91d0-5b52-843a-b9f15e136d17, identifier: ZE28536
2026-03-30 07:44:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e743ccce-91d0-5b52-843a-b9f15e136d17 with identifier: ZE28536
2026-03-30 07:44:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e743ccce-91d0-5b52-843a-b9f15e136d17 with identifier: ZE28536
2026-03-30 07:44:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e743ccce-91d0-5b52-843a-b9f15e136d17 with identifier: ZE28536 to the API
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:42:47Z',
 'fuel_type': 'diesel',
 'id': 'e743ccce-91d0-5b52-843a-b9f15e136d17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE28536',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 159429,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-07',
 'seller_name': None,
 'title': 'BMW 1er 116d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2016}
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE28536%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Saving data for ZE28536: {'auction_closing_time': 1774885367.0, 'created_time': 1774552680.501876, 'last_price_update_time': 1774856661.606359}
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE28536') HTTP/1.1" 204 0
2026-03-30 07:44:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: CY45921
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY45921%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for CY45921: 0
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-30 07:44:21 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX04518%27 HTTP/1.1" 200 None
2026-03-30 07:44:21 [auto1.de] INFO: Scrape type for XX04518: 0
2026-03-30 07:44:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:22 [auto1.de] INFO: Channel: 24h | Page: 91 | totalHits: 8273 | hits on page: 40
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: BY42207
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: XX04518
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX04518%27 HTTP/1.1" 200 None
2026-03-30 07:44:22 [auto1.de] INFO: Scrape type for XX04518: 0
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: BR95231
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: GM93561
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM93561%27 HTTP/1.1" 200 None
2026-03-30 07:44:22 [auto1.de] INFO: Scrape type for GM93561: 0
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: SJ09412
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ09412%27 HTTP/1.1" 200 None
2026-03-30 07:44:22 [auto1.de] INFO: Scrape type for SJ09412: 0
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: WT60095
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: NC65519
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: ZT20326
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: SV25975
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV25975%27 HTTP/1.1" 200 None
2026-03-30 07:44:22 [auto1.de] INFO: Scrape type for SV25975: 0
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: RW32541
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW32541%27 HTTP/1.1" 200 None
2026-03-30 07:44:22 [auto1.de] INFO: Scrape type for RW32541: 0
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: MD11027
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: SJ84971
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ84971%27 HTTP/1.1" 200 None
2026-03-30 07:44:22 [auto1.de] INFO: Scrape type for SJ84971: 0
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: AR39544
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR39544%27 HTTP/1.1" 200 None
2026-03-30 07:44:22 [auto1.de] INFO: Scrape type for AR39544: 0
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: HZ20287
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: VL31529
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL31529%27 HTTP/1.1" 200 None
2026-03-30 07:44:22 [auto1.de] INFO: Scrape type for VL31529: 0
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: FU20206
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: VE80218
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: LT47109
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: BN62296
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN62296%27 HTTP/1.1" 200 None
2026-03-30 07:44:22 [auto1.de] INFO: Scrape type for BN62296: 0
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: RH04581
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: VV47802
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV47802%27 HTTP/1.1" 200 None
2026-03-30 07:44:22 [auto1.de] INFO: Scrape type for VV47802: 0
2026-03-30 07:44:22 [auto1.de] INFO: Found listing with ID: LT13241
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT13241%27 HTTP/1.1" 200 None
2026-03-30 07:44:22 [auto1.de] INFO: Scrape type for LT13241: 2
2026-03-30 07:44:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e88029d-27a2-558e-b720-a7660872eaa9 with identifier: LT13241
2026-03-30 07:44:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e88029d-27a2-558e-b720-a7660872eaa9 with scrape type 2
2026-03-30 07:44:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e88029d-27a2-558e-b720-a7660872eaa9 with scrape type 2
2026-03-30 07:44:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e88029d-27a2-558e-b720-a7660872eaa9, identifier: LT13241
2026-03-30 07:44:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e88029d-27a2-558e-b720-a7660872eaa9 with identifier: LT13241
2026-03-30 07:44:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e88029d-27a2-558e-b720-a7660872eaa9 with identifier: LT13241
2026-03-30 07:44:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e88029d-27a2-558e-b720-a7660872eaa9 with identifier: LT13241 to the API
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-30T15:38:30Z',
 'fuel_type': 'diesel',
 'id': '0e88029d-27a2-558e-b720-a7660872eaa9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT13241',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 62149,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-18',
 'seller_name': None,
 'title': 'Renault Koleos 2.0 BLUE dCi Initiale Paris 4x4',
 'transmission': 'automatic',
 'trim': 'Initiale Paris 4x4',
 'year': 2022}
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT13241%27 HTTP/1.1" 200 None
2026-03-30 07:44:23 [auto1.de] INFO: Saving data for LT13241: {'auction_closing_time': 1774885110.0, 'created_time': 1774553232.722356, 'last_price_update_time': 1774856663.305719}
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT13241') HTTP/1.1" 204 0
2026-03-30 07:44:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: RK32817
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK32817%27 HTTP/1.1" 200 None
2026-03-30 07:44:23 [auto1.de] INFO: Scrape type for RK32817: 0
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: HR62368
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: YH04834
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH04834%27 HTTP/1.1" 200 None
2026-03-30 07:44:23 [auto1.de] INFO: Scrape type for YH04834: 0
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: XD11713
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: UH90150
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH90150%27 HTTP/1.1" 200 None
2026-03-30 07:44:23 [auto1.de] INFO: Scrape type for UH90150: 0
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: RT27360
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: NW35011
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: YH72749
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH72749%27 HTTP/1.1" 200 None
2026-03-30 07:44:23 [auto1.de] INFO: Scrape type for YH72749: 0
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: UD88757
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD88757%27 HTTP/1.1" 200 None
2026-03-30 07:44:23 [auto1.de] INFO: Scrape type for UD88757: 0
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: RP50374
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: GF78107
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: JP43917
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP43917%27 HTTP/1.1" 200 None
2026-03-30 07:44:23 [auto1.de] INFO: Scrape type for JP43917: 0
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: CA34642
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: JW84966
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: KE92828
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE92828%27 HTTP/1.1" 200 None
2026-03-30 07:44:23 [auto1.de] INFO: Scrape type for KE92828: 0
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: SM47095
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-30 07:44:23 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-30 07:44:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:24 [auto1.de] INFO: Channel: 24h | Page: 92 | totalHits: 8275 | hits on page: 40
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: SD86365
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: CG74532
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: SZ48596
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: RG31591
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: ST98775
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST98775%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for ST98775: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: AS96658
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS96658%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for AS96658: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: AD81240
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD81240%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for AD81240: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: YE46941
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: WM09546
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: MJ25721
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ25721%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for MJ25721: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: BR11811
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: KT65416
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT65416%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for KT65416: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: WG41390
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: DS71504
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: GJ62462
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: JY05464
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY05464%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for JY05464: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: FY64526
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: SC00063
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: DF96715
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF96715%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for DF96715: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: MT28952
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: WE79254
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: KX24751
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX24751%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for KX24751: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: XC67226
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC67226%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for XC67226: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: YT05119
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT05119%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for YT05119: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE68185%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for AE68185: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for CZ09118: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for WD16900: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for SX85367: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD99191%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for BD99191: 0
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-30 07:44:24 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-30 07:44:24 [auto1.de] INFO: Scrape type for SL28048: 0
2026-03-30 07:44:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:36 [auto1.de] INFO: Channel: 24h | Page: 93 | totalHits: 8291 | hits on page: 40
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: NK84600
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: AE68185
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE68185%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for AE68185: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: CZ09118
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ09118%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for CZ09118: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: AW88722
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: YT16808
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: TY75534
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: WD16900
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD16900%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for WD16900: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: CD75324
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: SX85367
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX85367%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for SX85367: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: AP34925
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: ZJ19484
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: BD99191
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD99191%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for BD99191: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: JB95370
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: ZY62714
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: HP95404
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: SL28048
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL28048%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for SL28048: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: CN87800
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: GN68043
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: MA61541
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA61541%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for MA61541: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: CR83846
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: FU85370
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU85370%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for FU85370: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: HC91159
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC91159%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for HC91159: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: EW37787
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW37787%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for EW37787: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: ZU48886
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU48886%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for ZU48886: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: DZ26190
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ26190%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for DZ26190: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: RM51665
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM51665%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for RM51665: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: PP42616
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP42616%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for PP42616: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: XU38066
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU38066%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for XU38066: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: HG64056
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: LL15014
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL15014%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for LL15014: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: UH99848
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: NP05566
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: WW82569
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW82569%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for WW82569: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: RL83292
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: WZ32773
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ32773%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for WZ32773: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: MP93113
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: BN83173
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BN83173%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for BN83173: 0
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: VX99653
2026-03-30 07:44:36 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR33012%27 HTTP/1.1" 200 None
2026-03-30 07:44:36 [auto1.de] INFO: Scrape type for GR33012: 2
2026-03-30 07:44:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41d735fb-5107-5167-af9f-0874cff56b62 with identifier: GR33012
2026-03-30 07:44:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41d735fb-5107-5167-af9f-0874cff56b62 with scrape type 2
2026-03-30 07:44:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41d735fb-5107-5167-af9f-0874cff56b62 with scrape type 2
2026-03-30 07:44:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41d735fb-5107-5167-af9f-0874cff56b62, identifier: GR33012
2026-03-30 07:44:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41d735fb-5107-5167-af9f-0874cff56b62 with identifier: GR33012
2026-03-30 07:44:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41d735fb-5107-5167-af9f-0874cff56b62 with identifier: GR33012
2026-03-30 07:44:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41d735fb-5107-5167-af9f-0874cff56b62 with identifier: GR33012 to the API
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:07:01Z',
 'fuel_type': 'diesel',
 'id': '41d735fb-5107-5167-af9f-0874cff56b62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR33012',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 301933,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-16',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI Comfortline 4Motion',
 'transmission': 'manual',
 'trim': 'Comfortline 4Motion',
 'year': 2008}
2026-03-30 07:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR33012%27 HTTP/1.1" 200 None
2026-03-30 07:44:37 [auto1.de] INFO: Saving data for GR33012: {'auction_closing_time': 1774883221.0, 'created_time': 1774551878.415461, 'last_price_update_time': 1774856677.076773}
2026-03-30 07:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR33012') HTTP/1.1" 204 0
2026-03-30 07:44:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:37 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-30 07:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-30 07:44:37 [auto1.de] INFO: Scrape type for MH03365: 0
2026-03-30 07:44:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:38 [auto1.de] INFO: Channel: 24h | Page: 94 | totalHits: 8293 | hits on page: 40
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: GR33012
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR33012%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for GR33012: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: MH03365
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH03365%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for MH03365: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: SR08314
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: AM60777
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM60777%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for AM60777: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: GP99988
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP99988%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for GP99988: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: ZR44160
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR44160%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for ZR44160: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: PY88123
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: UK52286
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK52286%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for UK52286: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: ZV84359
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: BB98458
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: ZR92554
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR92554%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for ZR92554: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: XD42848
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD42848%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for XD42848: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: MZ39955
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ39955%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for MZ39955: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: FA96638
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FA96638%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for FA96638: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: XR52886
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR52886%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for XR52886: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: DF95353
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: TE07006
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE07006%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for TE07006: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: AB88110
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: FE62159
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE62159%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for FE62159: 2
2026-03-30 07:44:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83495658-c211-5d79-9905-2878eb47eacc with identifier: FE62159
2026-03-30 07:44:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83495658-c211-5d79-9905-2878eb47eacc with scrape type 2
2026-03-30 07:44:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83495658-c211-5d79-9905-2878eb47eacc with scrape type 2
2026-03-30 07:44:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83495658-c211-5d79-9905-2878eb47eacc, identifier: FE62159
2026-03-30 07:44:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83495658-c211-5d79-9905-2878eb47eacc with identifier: FE62159
2026-03-30 07:44:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83495658-c211-5d79-9905-2878eb47eacc with identifier: FE62159
2026-03-30 07:44:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83495658-c211-5d79-9905-2878eb47eacc with identifier: FE62159 to the API
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:56:45Z',
 'fuel_type': 'petrol',
 'id': '83495658-c211-5d79-9905-2878eb47eacc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE62159',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 36662,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-27',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2011}
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE62159%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Saving data for FE62159: {'auction_closing_time': 1774886205.0, 'created_time': 1774553149.868523, 'last_price_update_time': 1774856678.811314}
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE62159') HTTP/1.1" 204 0
2026-03-30 07:44:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: GM35887
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: TB37654
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB37654%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for TB37654: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: MC12469
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC12469%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for MC12469: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: KC26030
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: ZK01329
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK01329%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for ZK01329: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: HR10791
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: RH02243
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH02243%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for RH02243: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: BB15265
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB15265%27 HTTP/1.1" 200 None
2026-03-30 07:44:38 [auto1.de] INFO: Scrape type for BB15265: 0
2026-03-30 07:44:38 [auto1.de] INFO: Found listing with ID: SS30943
2026-03-30 07:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS30943%27 HTTP/1.1" 200 None
2026-03-30 07:44:39 [auto1.de] INFO: Scrape type for SS30943: 2
2026-03-30 07:44:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with identifier: SS30943
2026-03-30 07:44:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with scrape type 2
2026-03-30 07:44:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with scrape type 2
2026-03-30 07:44:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d, identifier: SS30943
2026-03-30 07:44:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with identifier: SS30943
2026-03-30 07:44:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with identifier: SS30943
2026-03-30 07:44:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d with identifier: SS30943 to the API
2026-03-30 07:44:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:13:05Z',
 'fuel_type': 'diesel',
 'id': 'd5b7f1bf-d8d0-500b-9c13-eb4f1b1af02d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS30943',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 311802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-18',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2010}
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS30943%27 HTTP/1.1" 200 None
2026-03-30 07:44:40 [auto1.de] INFO: Saving data for SS30943: {'auction_closing_time': 1774883585.0, 'created_time': 1774553116.658246, 'last_price_update_time': 1774856680.343694}
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS30943') HTTP/1.1" 204 0
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: PM23375
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: BW77657
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: DY95504
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY95504%27 HTTP/1.1" 200 None
2026-03-30 07:44:40 [auto1.de] INFO: Scrape type for DY95504: 0
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: PH96915
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH96915%27 HTTP/1.1" 200 None
2026-03-30 07:44:40 [auto1.de] INFO: Scrape type for PH96915: 0
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: EM07898
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM07898%27 HTTP/1.1" 200 None
2026-03-30 07:44:40 [auto1.de] INFO: Scrape type for EM07898: 0
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: NK83819
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-30 07:44:40 [auto1.de] INFO: Scrape type for EP05122: 0
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT52370%27 HTTP/1.1" 200 None
2026-03-30 07:44:40 [auto1.de] INFO: Scrape type for YT52370: 0
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-30 07:44:40 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-30 07:44:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:41 [auto1.de] INFO: Channel: 24h | Page: 95 | totalHits: 8299 | hits on page: 40
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: EP05122
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP05122%27 HTTP/1.1" 200 None
2026-03-30 07:44:41 [auto1.de] INFO: Scrape type for EP05122: 0
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: ZE29906
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: ZZ59930
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: YT52370
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT52370%27 HTTP/1.1" 200 None
2026-03-30 07:44:41 [auto1.de] INFO: Scrape type for YT52370: 0
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: LL09458
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: AU82814
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: KR50591
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR50591%27 HTTP/1.1" 200 None
2026-03-30 07:44:41 [auto1.de] INFO: Scrape type for KR50591: 0
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: HH56316
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: XY67519
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: CD13721
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD13721%27 HTTP/1.1" 200 None
2026-03-30 07:44:41 [auto1.de] INFO: Scrape type for CD13721: 0
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: LX86336
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: VT42792
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: WF02810
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF02810%27 HTTP/1.1" 200 None
2026-03-30 07:44:41 [auto1.de] INFO: Scrape type for WF02810: 0
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: FX25662
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: TL84937
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL84937%27 HTTP/1.1" 200 None
2026-03-30 07:44:41 [auto1.de] INFO: Scrape type for TL84937: 0
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: RX80548
2026-03-30 07:44:41 [auto1.de] INFO: Found listing with ID: PG24274
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24274%27 HTTP/1.1" 200 None
2026-03-30 07:44:41 [auto1.de] INFO: Scrape type for PG24274: 2
2026-03-30 07:44:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274
2026-03-30 07:44:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3a45927-1997-5e4c-af77-e3843bf636a7 with scrape type 2
2026-03-30 07:44:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3a45927-1997-5e4c-af77-e3843bf636a7 with scrape type 2
2026-03-30 07:44:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c3a45927-1997-5e4c-af77-e3843bf636a7, identifier: PG24274
2026-03-30 07:44:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274
2026-03-30 07:44:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274
2026-03-30 07:44:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c3a45927-1997-5e4c-af77-e3843bf636a7 with identifier: PG24274 to the API
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:55:25Z',
 'fuel_type': 'petrol',
 'id': 'c3a45927-1997-5e4c-af77-e3843bf636a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG24274',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 98026,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-21',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TSI ACT BlueGT',
 'transmission': 'manual',
 'trim': 'BlueGT',
 'year': 2015}
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG24274%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Saving data for PG24274: {'auction_closing_time': 1774886125.0, 'created_time': 1773947037.30325, 'last_price_update_time': 1774856682.008931}
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG24274') HTTP/1.1" 204 0
2026-03-30 07:44:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: XF83287
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: HJ88633
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ88633%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Scrape type for HJ88633: 0
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: NY75597
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY75597%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Scrape type for NY75597: 0
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: WX91762
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: YT57989
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: JS13151
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: PP10507
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP10507%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Scrape type for PP10507: 0
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: GU59921
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU59921%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Scrape type for GU59921: 0
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: NF38330
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: WN67073
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: SD15904
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD15904%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Scrape type for SD15904: 0
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: BN76417
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: ZS47676
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: CM15300
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: EC93517
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: AW08292
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: BG81908
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG81908%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Scrape type for BG81908: 0
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: ND34621
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: GJ75374
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ75374%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Scrape type for GJ75374: 2
2026-03-30 07:44:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with identifier: GJ75374
2026-03-30 07:44:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with scrape type 2
2026-03-30 07:44:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with scrape type 2
2026-03-30 07:44:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8, identifier: GJ75374
2026-03-30 07:44:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with identifier: GJ75374
2026-03-30 07:44:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with identifier: GJ75374
2026-03-30 07:44:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50c42aa6-351b-53a2-b1c4-a3c21a61bdd8 with identifier: GJ75374 to the API
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:52:22Z',
 'fuel_type': 'petrol',
 'id': '50c42aa6-351b-53a2-b1c4-a3c21a61bdd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ75374',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 93868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-03',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2016}
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ75374%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Saving data for GJ75374: {'auction_closing_time': 1774885942.0, 'created_time': 1774553021.008624, 'last_price_update_time': 1774856682.777567}
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ75374') HTTP/1.1" 204 0
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: YN35790
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: ME06173
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME06173%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Scrape type for ME06173: 0
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV97888%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Scrape type for EV97888: 0
2026-03-30 07:44:42 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-30 07:44:42 [auto1.de] INFO: Scrape type for HH04622: 0
2026-03-30 07:44:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:43 [auto1.de] INFO: Channel: 24h | Page: 96 | totalHits: 8301 | hits on page: 40
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: EV97888
2026-03-30 07:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV97888%27 HTTP/1.1" 200 None
2026-03-30 07:44:43 [auto1.de] INFO: Scrape type for EV97888: 0
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: HH04622
2026-03-30 07:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH04622%27 HTTP/1.1" 200 None
2026-03-30 07:44:43 [auto1.de] INFO: Scrape type for HH04622: 0
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: LT29180
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: EY95124
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: BG10671
2026-03-30 07:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG10671%27 HTTP/1.1" 200 None
2026-03-30 07:44:43 [auto1.de] INFO: Scrape type for BG10671: 0
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: BT97147
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: VC63070
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: JF36424
2026-03-30 07:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF36424%27 HTTP/1.1" 200 None
2026-03-30 07:44:43 [auto1.de] INFO: Scrape type for JF36424: 0
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: TF71705
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: PL64975
2026-03-30 07:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL64975%27 HTTP/1.1" 200 None
2026-03-30 07:44:43 [auto1.de] INFO: Scrape type for PL64975: 0
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: WT86563
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: PS47170
2026-03-30 07:44:43 [auto1.de] INFO: Found listing with ID: AN46464
2026-03-30 07:44:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN46464%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for AN46464: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: ZY58366
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY58366%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for ZY58366: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: AN41414
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN41414%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for AN41414: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: YR25980
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR25980%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for YR25980: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: HP37567
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP37567%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for HP37567: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: UT75774
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT75774%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for UT75774: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: DP30062
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: RM03411
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: LT34656
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT34656%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for LT34656: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: CD69180
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD69180%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for CD69180: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: YJ47814
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: MM42204
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM42204%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for MM42204: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: AG08443
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: VX90434
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX90434%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for VX90434: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: XZ76786
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: TD56842
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: AJ16531
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: LL25204
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL25204%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for LL25204: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: KX12116
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: KR99013
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: AE08080
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE08080%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for AE08080: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: YT23493
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT23493%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for YT23493: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: UB50562
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB50562%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for UB50562: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: WW12135
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW12135%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for WW12135: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: VB93359
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: RK12906
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: HD30169
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD30169%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for HD30169: 0
2026-03-30 07:44:44 [auto1.de] INFO: Found listing with ID: MD55722
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD55722%27 HTTP/1.1" 200 None
2026-03-30 07:44:44 [auto1.de] INFO: Scrape type for MD55722: 0
2026-03-30 07:44:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:45 [auto1.de] INFO: Channel: 24h | Page: 97 | totalHits: 8301 | hits on page: 40
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: DE84104
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE84104%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for DE84104: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: BR24647
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR24647%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for BR24647: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: WZ86962
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ86962%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for WZ86962: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: GJ61824
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: EF47074
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF47074%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for EF47074: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: XG02124
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: DC90555
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: AL45510
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: AK65785
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: FF73158
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF73158%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for FF73158: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: ZZ79893
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: AW17852
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: AV13612
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV13612%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for AV13612: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: AY57435
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: EG34201
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: ZD30774
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD30774%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for ZD30774: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: NJ66077
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NJ66077%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for NJ66077: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: UK09737
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK09737%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for UK09737: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: DY67323
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY67323%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for DY67323: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: YH76604
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: MT21792
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT21792%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for MT21792: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: BD44201
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: VX98591
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: FY04572
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY04572%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for FY04572: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: NG07529
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: JY21775
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY21775%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for JY21775: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: NG90770
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG90770%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for NG90770: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: DL69348
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL69348%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for DL69348: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: RK40199
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK40199%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for RK40199: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: YY97857
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: LR76257
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: DS47068
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: NX23620
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX23620%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for NX23620: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: DC50657
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: BC73225
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC73225%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for BC73225: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: BT35414
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT35414%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for BT35414: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: XU56450
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU56450%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for XU56450: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: HL62100
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL62100%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for HL62100: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77480%27 HTTP/1.1" 200 None
2026-03-30 07:44:45 [auto1.de] INFO: Scrape type for YA77480: 0
2026-03-30 07:44:45 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-30 07:44:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:47 [auto1.de] INFO: Channel: 24h | Page: 98 | totalHits: 8303 | hits on page: 40
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: YA77480
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA77480%27 HTTP/1.1" 200 None
2026-03-30 07:44:47 [auto1.de] INFO: Scrape type for YA77480: 0
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: LC77842
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: UX10113
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: YF78558
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: BJ94385
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ94385%27 HTTP/1.1" 200 None
2026-03-30 07:44:47 [auto1.de] INFO: Scrape type for BJ94385: 0
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: DP87789
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP87789%27 HTTP/1.1" 200 None
2026-03-30 07:44:47 [auto1.de] INFO: Scrape type for DP87789: 0
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: TE35535
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: EN83370
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN83370%27 HTTP/1.1" 200 None
2026-03-30 07:44:47 [auto1.de] INFO: Scrape type for EN83370: 0
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: SA59196
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA59196%27 HTTP/1.1" 200 None
2026-03-30 07:44:47 [auto1.de] INFO: Scrape type for SA59196: 0
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: AH38821
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH38821%27 HTTP/1.1" 200 None
2026-03-30 07:44:47 [auto1.de] INFO: Scrape type for AH38821: 0
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: MS73974
2026-03-30 07:44:47 [auto1.de] INFO: Found listing with ID: WZ27429
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27429%27 HTTP/1.1" 200 None
2026-03-30 07:44:47 [auto1.de] INFO: Scrape type for WZ27429: 2
2026-03-30 07:44:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5384a260-bcf8-5df6-9398-5dc2351ac375 with identifier: WZ27429
2026-03-30 07:44:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5384a260-bcf8-5df6-9398-5dc2351ac375 with scrape type 2
2026-03-30 07:44:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5384a260-bcf8-5df6-9398-5dc2351ac375 with scrape type 2
2026-03-30 07:44:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5384a260-bcf8-5df6-9398-5dc2351ac375, identifier: WZ27429
2026-03-30 07:44:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5384a260-bcf8-5df6-9398-5dc2351ac375 with identifier: WZ27429
2026-03-30 07:44:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5384a260-bcf8-5df6-9398-5dc2351ac375 with identifier: WZ27429
2026-03-30 07:44:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5384a260-bcf8-5df6-9398-5dc2351ac375 with identifier: WZ27429 to the API
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:39:07Z',
 'fuel_type': 'hybrid',
 'id': '5384a260-bcf8-5df6-9398-5dc2351ac375',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ27429',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Optima',
 'odometer': 97959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Kia Optima 2.0 Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2015}
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ27429%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Saving data for WZ27429: {'auction_closing_time': 1774885147.0, 'created_time': 1774552961.259229, 'last_price_update_time': 1774856688.210057}
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ27429') HTTP/1.1" 204 0
2026-03-30 07:44:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: XE26333
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: RK13717
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: NX68666
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: EL91395
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: MC36419
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC36419%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Scrape type for MC36419: 0
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: YF83541
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF83541%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Scrape type for YF83541: 0
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: EB01944
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: KN65444
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: EA13854
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA13854%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Scrape type for EA13854: 0
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: BK25487
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK25487%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Scrape type for BK25487: 0
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: SX08499
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: TU73668
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: TR96368
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: KM66171
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: PT08625
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: NJ99986
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: HM95018
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: JR56038
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: MH67551
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH67551%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Scrape type for MH67551: 0
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: KF98082
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF98082%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Scrape type for KF98082: 0
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: SA94096
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA94096%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Scrape type for SA94096: 0
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: ZR39643
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: BK49064
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK49064%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Scrape type for BK49064: 0
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: PJ34004
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: HA65377
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA65377%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Scrape type for HA65377: 0
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: AR72060
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR72060%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Scrape type for AR72060: 0
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: HE33973
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE33973%27 HTTP/1.1" 200 None
2026-03-30 07:44:48 [auto1.de] INFO: Scrape type for HE33973: 0
2026-03-30 07:44:48 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-30 07:44:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:49 [auto1.de] INFO: Channel: 24h | Page: 99 | totalHits: 8304 | hits on page: 40
2026-03-30 07:44:49 [auto1.de] INFO: Found listing with ID: JL65692
2026-03-30 07:44:49 [auto1.de] INFO: Found listing with ID: MX37752
2026-03-30 07:44:49 [auto1.de] INFO: Found listing with ID: BG36952
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36952%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for BG36952: 2
2026-03-30 07:44:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a82bd6a9-b789-5542-98e2-34c1f89070b2 with identifier: BG36952
2026-03-30 07:44:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a82bd6a9-b789-5542-98e2-34c1f89070b2 with scrape type 2
2026-03-30 07:44:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a82bd6a9-b789-5542-98e2-34c1f89070b2 with scrape type 2
2026-03-30 07:44:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a82bd6a9-b789-5542-98e2-34c1f89070b2, identifier: BG36952
2026-03-30 07:44:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a82bd6a9-b789-5542-98e2-34c1f89070b2 with identifier: BG36952
2026-03-30 07:44:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a82bd6a9-b789-5542-98e2-34c1f89070b2 with identifier: BG36952
2026-03-30 07:44:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a82bd6a9-b789-5542-98e2-34c1f89070b2 with identifier: BG36952 to the API
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 128,
 'expiration_date': '2026-03-30T15:29:44Z',
 'fuel_type': 'diesel',
 'id': 'a82bd6a9-b789-5542-98e2-34c1f89070b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG36952',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 175392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-10',
 'seller_name': None,
 'title': 'Citroen Jumpy 2.0 HDi L2 Multispace Tendance',
 'transmission': 'manual',
 'trim': 'L2 Multispace Tendance',
 'year': 2014}
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG36952%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Saving data for BG36952: {'auction_closing_time': 1774884584.0, 'created_time': 1774552343.264413, 'last_price_update_time': 1774856690.586908}
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG36952') HTTP/1.1" 204 0
2026-03-30 07:44:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: WK78247
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK78247%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for WK78247: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: XR06088
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR06088%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for XR06088: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: NB80689
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB80689%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for NB80689: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: RY74387
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RY74387%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for RY74387: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: LK79875
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: AG47249
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: LU05399
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05399%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for LU05399: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: CG37659
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG37659%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for CG37659: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: LK34875
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: DB46013
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: ZM12960
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM12960%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for ZM12960: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: NH13691
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH13691%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for NH13691: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: EY55649
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: MG81975
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG81975%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for MG81975: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: XB43693
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: HU88385
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU88385%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for HU88385: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: ER51376
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: HS53864
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: BV10728
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV10728%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for BV10728: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: EU79634
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: XW28946
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: HX49915
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX49915%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for HX49915: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: RR35143
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: KJ96980
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: SK20956
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: DM70837
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70837%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for DM70837: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: SA39123
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: KE50897
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE50897%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for KE50897: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: GE03555
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: AB40080
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: LM98964
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: AM64478
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM64478%27 HTTP/1.1" 200 None
2026-03-30 07:44:50 [auto1.de] INFO: Scrape type for AM64478: 0
2026-03-30 07:44:50 [auto1.de] INFO: Found listing with ID: BL07705
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BL07705%27 HTTP/1.1" 200 None
2026-03-30 07:44:51 [auto1.de] INFO: Scrape type for BL07705: 0
2026-03-30 07:44:51 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-30 07:44:51 [auto1.de] INFO: Scrape type for TX92660: 0
2026-03-30 07:44:51 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-30 07:44:51 [auto1.de] INFO: Scrape type for RP72323: 0
2026-03-30 07:44:51 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF85526%27 HTTP/1.1" 200 None
2026-03-30 07:44:51 [auto1.de] INFO: Scrape type for CF85526: 0
2026-03-30 07:44:51 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-30 07:44:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:51 [auto1.de] INFO: Channel: 24h | Page: 100 | totalHits: 8308 | hits on page: 40
2026-03-30 07:44:51 [auto1.de] INFO: Found listing with ID: TX92660
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92660%27 HTTP/1.1" 200 None
2026-03-30 07:44:51 [auto1.de] INFO: Scrape type for TX92660: 0
2026-03-30 07:44:51 [auto1.de] INFO: Found listing with ID: RP72323
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP72323%27 HTTP/1.1" 200 None
2026-03-30 07:44:51 [auto1.de] INFO: Scrape type for RP72323: 0
2026-03-30 07:44:51 [auto1.de] INFO: Found listing with ID: CF85526
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF85526%27 HTTP/1.1" 200 None
2026-03-30 07:44:51 [auto1.de] INFO: Scrape type for CF85526: 0
2026-03-30 07:44:51 [auto1.de] INFO: Found listing with ID: PY37454
2026-03-30 07:44:51 [auto1.de] INFO: Found listing with ID: BJ98180
2026-03-30 07:44:51 [auto1.de] INFO: Found listing with ID: YJ19270
2026-03-30 07:44:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ19270%27 HTTP/1.1" 200 None
2026-03-30 07:44:52 [auto1.de] INFO: Scrape type for YJ19270: 0
2026-03-30 07:44:52 [auto1.de] INFO: Found listing with ID: GX91022
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX91022%27 HTTP/1.1" 200 None
2026-03-30 07:44:52 [auto1.de] INFO: Scrape type for GX91022: 2
2026-03-30 07:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with identifier: GX91022
2026-03-30 07:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with scrape type 2
2026-03-30 07:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with scrape type 2
2026-03-30 07:44:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1, identifier: GX91022
2026-03-30 07:44:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with identifier: GX91022
2026-03-30 07:44:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with identifier: GX91022
2026-03-30 07:44:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1 with identifier: GX91022 to the API
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:52Z',
 'fuel_type': 'petrol',
 'id': '4ce7b1c3-1778-5839-8c56-c59a2ed9f3b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX91022',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 31647,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-22',
 'seller_name': None,
 'title': 'Ford C-Max 1.5 EcoBoost Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2015}
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX91022%27 HTTP/1.1" 200 None
2026-03-30 07:44:52 [auto1.de] INFO: Saving data for GX91022: {'auction_closing_time': 1774883272.0, 'created_time': 1774118698.283587, 'last_price_update_time': 1774856692.432045}
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX91022') HTTP/1.1" 204 0
2026-03-30 07:44:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:52 [auto1.de] INFO: Found listing with ID: PN22226
2026-03-30 07:44:52 [auto1.de] INFO: Found listing with ID: RZ53370
2026-03-30 07:44:52 [auto1.de] INFO: Found listing with ID: YL76472
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL76472%27 HTTP/1.1" 200 None
2026-03-30 07:44:52 [auto1.de] INFO: Scrape type for YL76472: 2
2026-03-30 07:44:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with identifier: YL76472
2026-03-30 07:44:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with scrape type 2
2026-03-30 07:44:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with scrape type 2
2026-03-30 07:44:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27, identifier: YL76472
2026-03-30 07:44:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with identifier: YL76472
2026-03-30 07:44:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with identifier: YL76472
2026-03-30 07:44:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27 with identifier: YL76472 to the API
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:57:13Z',
 'fuel_type': 'petrol',
 'id': '592dc0ae-634b-5ce5-ad8e-bb5a46ecbb27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL76472',
 'listing': 'auction',
 'make': 'Cadillac',
 'model': 'BLS',
 'odometer': 195179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-24',
 'seller_name': None,
 'title': 'Cadillac BLS 2.0 Turbo Elegance Wagon',
 'transmission': 'manual',
 'trim': 'Elegance Wagon',
 'year': 2009}
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL76472%27 HTTP/1.1" 200 None
2026-03-30 07:44:52 [auto1.de] INFO: Saving data for YL76472: {'auction_closing_time': 1774886233.0, 'created_time': 1773916799.252689, 'last_price_update_time': 1774856692.96617}
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL76472') HTTP/1.1" 204 0
2026-03-30 07:44:52 [auto1.de] INFO: Found listing with ID: HG88982
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88982%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Scrape type for HG88982: 0
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: UA56207
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA56207%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Scrape type for UA56207: 0
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: YJ47160
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: KL79607
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL79607%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Scrape type for KL79607: 0
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: UG40068
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: MR73293
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: GU43225
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: DL54594
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL54594%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Scrape type for DL54594: 0
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: BW09320
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW09320%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Scrape type for BW09320: 2
2026-03-30 07:44:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189bd547-49cd-561c-9b74-0283d2016b89 with identifier: BW09320
2026-03-30 07:44:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189bd547-49cd-561c-9b74-0283d2016b89 with scrape type 2
2026-03-30 07:44:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 189bd547-49cd-561c-9b74-0283d2016b89 with scrape type 2
2026-03-30 07:44:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 189bd547-49cd-561c-9b74-0283d2016b89, identifier: BW09320
2026-03-30 07:44:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 189bd547-49cd-561c-9b74-0283d2016b89 with identifier: BW09320
2026-03-30 07:44:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 189bd547-49cd-561c-9b74-0283d2016b89 with identifier: BW09320
2026-03-30 07:44:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 189bd547-49cd-561c-9b74-0283d2016b89 with identifier: BW09320 to the API
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:52:32Z',
 'fuel_type': 'diesel',
 'id': '189bd547-49cd-561c-9b74-0283d2016b89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW09320',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 102077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2018}
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW09320%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Saving data for BW09320: {'auction_closing_time': 1774885952.0, 'created_time': 1774552769.777307, 'last_price_update_time': 1774856693.485832}
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW09320') HTTP/1.1" 204 0
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: VG26326
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: HB50510
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: TF26076
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: NR99017
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: JS31219
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: ED43113
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED43113%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Scrape type for ED43113: 0
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: WM19192
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: BC97155
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: EP13980
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP13980%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Scrape type for EP13980: 0
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: VG31593
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: WG78869
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: EE19276
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: VT68593
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: GP19513
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP19513%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Scrape type for GP19513: 0
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: UM92745
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: DE37083
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE37083%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Scrape type for DE37083: 0
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: YA08912
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: ZT19745
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: VB96558
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB96558%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Scrape type for VB96558: 0
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: JF43262
2026-03-30 07:44:53 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW98982%27 HTTP/1.1" 200 None
2026-03-30 07:44:53 [auto1.de] INFO: Scrape type for UW98982: 0
2026-03-30 07:44:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:54 [auto1.de] INFO: Channel: 24h | Page: 101 | totalHits: 8309 | hits on page: 40
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: UW98982
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW98982%27 HTTP/1.1" 200 None
2026-03-30 07:44:54 [auto1.de] INFO: Scrape type for UW98982: 0
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: TL65156
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: KN67174
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: EX72807
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: DG34308
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34308%27 HTTP/1.1" 200 None
2026-03-30 07:44:54 [auto1.de] INFO: Scrape type for DG34308: 0
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: SM13407
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM13407%27 HTTP/1.1" 200 None
2026-03-30 07:44:54 [auto1.de] INFO: Scrape type for SM13407: 0
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: CK84470
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: KZ71348
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71348%27 HTTP/1.1" 200 None
2026-03-30 07:44:54 [auto1.de] INFO: Scrape type for KZ71348: 2
2026-03-30 07:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with identifier: KZ71348
2026-03-30 07:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with scrape type 2
2026-03-30 07:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with scrape type 2
2026-03-30 07:44:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da, identifier: KZ71348
2026-03-30 07:44:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with identifier: KZ71348
2026-03-30 07:44:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with identifier: KZ71348
2026-03-30 07:44:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da with identifier: KZ71348 to the API
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:59:00Z',
 'fuel_type': 'petrol',
 'id': 'a9edaef8-a8e5-5e0e-8cfe-a8c835efb2da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ71348',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 37912,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-03',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71348%27 HTTP/1.1" 200 None
2026-03-30 07:44:54 [auto1.de] INFO: Saving data for KZ71348: {'auction_closing_time': 1774886340.0, 'created_time': 1774552725.550776, 'last_price_update_time': 1774856694.767243}
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ71348') HTTP/1.1" 204 0
2026-03-30 07:44:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: NE62435
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: WP12836
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: GB59587
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: DE22331
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE22331%27 HTTP/1.1" 200 None
2026-03-30 07:44:54 [auto1.de] INFO: Scrape type for DE22331: 0
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: GP54397
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP54397%27 HTTP/1.1" 200 None
2026-03-30 07:44:54 [auto1.de] INFO: Scrape type for GP54397: 0
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: FM56481
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: UA60360
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: AH65179
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: JB50627
2026-03-30 07:44:54 [auto1.de] INFO: Found listing with ID: US78573
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US78573%27 HTTP/1.1" 200 None
2026-03-30 07:44:54 [auto1.de] INFO: Scrape type for US78573: 2
2026-03-30 07:44:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa959e98-3d5b-58be-9cc2-d89c53d12c3d with identifier: US78573
2026-03-30 07:44:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa959e98-3d5b-58be-9cc2-d89c53d12c3d with scrape type 2
2026-03-30 07:44:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa959e98-3d5b-58be-9cc2-d89c53d12c3d with scrape type 2
2026-03-30 07:44:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa959e98-3d5b-58be-9cc2-d89c53d12c3d, identifier: US78573
2026-03-30 07:44:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa959e98-3d5b-58be-9cc2-d89c53d12c3d with identifier: US78573
2026-03-30 07:44:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa959e98-3d5b-58be-9cc2-d89c53d12c3d with identifier: US78573
2026-03-30 07:44:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa959e98-3d5b-58be-9cc2-d89c53d12c3d with identifier: US78573 to the API
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:44:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:23:46Z',
 'fuel_type': 'petrol',
 'id': 'aa959e98-3d5b-58be-9cc2-d89c53d12c3d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US78573',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 185259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-21',
 'seller_name': None,
 'title': 'Opel Mokka 1.4 Turbo Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2014}
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US78573%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Saving data for US78573: {'auction_closing_time': 1774884226.0, 'created_time': 1774552337.181942, 'last_price_update_time': 1774856695.346933}
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US78573') HTTP/1.1" 204 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: XZ96543
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XZ96543%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Scrape type for XZ96543: 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: PW80627
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: TR13409
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13409%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Scrape type for TR13409: 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: NL93445
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93445%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Scrape type for NL93445: 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: ST57334
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: CA38480
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA38480%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Scrape type for CA38480: 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: HR10562
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: MD70157
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD70157%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Scrape type for MD70157: 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: SF39323
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: VK62428
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK62428%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Scrape type for VK62428: 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: ZS55646
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS55646%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Scrape type for ZS55646: 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: UT32036
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT32036%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Scrape type for UT32036: 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM14327%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Scrape type for XM14327: 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Scrape type for UF88550: 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-30 07:44:55 [auto1.de] INFO: Scrape type for KH20562: 0
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-30 07:44:55 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-30 07:44:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:44:59 [auto1.de] INFO: Channel: 24h | Page: 102 | totalHits: 8319 | hits on page: 40
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: UF29194
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: RN12872
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: NP24686
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: XM14327
2026-03-30 07:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM14327%27 HTTP/1.1" 200 None
2026-03-30 07:44:59 [auto1.de] INFO: Scrape type for XM14327: 0
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: UF88550
2026-03-30 07:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF88550%27 HTTP/1.1" 200 None
2026-03-30 07:44:59 [auto1.de] INFO: Scrape type for UF88550: 0
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: KH20562
2026-03-30 07:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH20562%27 HTTP/1.1" 200 None
2026-03-30 07:44:59 [auto1.de] INFO: Scrape type for KH20562: 0
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: NR67134
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: CD45301
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: WM90118
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: AA40394
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: WD77905
2026-03-30 07:44:59 [auto1.de] INFO: Found listing with ID: ND67175
2026-03-30 07:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:44:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND67175%27 HTTP/1.1" 200 None
2026-03-30 07:44:59 [auto1.de] INFO: Scrape type for ND67175: 2
2026-03-30 07:44:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6416f1e6-b60c-57c9-baca-781a0d296df5 with identifier: ND67175
2026-03-30 07:44:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6416f1e6-b60c-57c9-baca-781a0d296df5 with scrape type 2
2026-03-30 07:44:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6416f1e6-b60c-57c9-baca-781a0d296df5 with scrape type 2
2026-03-30 07:44:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6416f1e6-b60c-57c9-baca-781a0d296df5, identifier: ND67175
2026-03-30 07:44:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6416f1e6-b60c-57c9-baca-781a0d296df5 with identifier: ND67175
2026-03-30 07:44:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6416f1e6-b60c-57c9-baca-781a0d296df5 with identifier: ND67175
2026-03-30 07:44:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6416f1e6-b60c-57c9-baca-781a0d296df5 with identifier: ND67175 to the API
2026-03-30 07:44:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:44:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 232,
 'expiration_date': '2026-03-30T15:28:07Z',
 'fuel_type': 'diesel',
 'id': '6416f1e6-b60c-57c9-baca-781a0d296df5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND67175',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 213407,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-05',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND67175%27 HTTP/1.1" 200 None
2026-03-30 07:45:00 [auto1.de] INFO: Saving data for ND67175: {'auction_closing_time': 1774884487.0, 'created_time': 1774552742.068146, 'last_price_update_time': 1774856700.097149}
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND67175') HTTP/1.1" 204 0
2026-03-30 07:45:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:00 [auto1.de] INFO: Found listing with ID: JJ90967
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ90967%27 HTTP/1.1" 200 None
2026-03-30 07:45:00 [auto1.de] INFO: Scrape type for JJ90967: 0
2026-03-30 07:45:00 [auto1.de] INFO: Found listing with ID: XN62659
2026-03-30 07:45:00 [auto1.de] INFO: Found listing with ID: CK58457
2026-03-30 07:45:00 [auto1.de] INFO: Found listing with ID: AM35234
2026-03-30 07:45:00 [auto1.de] INFO: Found listing with ID: FG01299
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG01299%27 HTTP/1.1" 200 None
2026-03-30 07:45:00 [auto1.de] INFO: Scrape type for FG01299: 0
2026-03-30 07:45:00 [auto1.de] INFO: Found listing with ID: NY07773
2026-03-30 07:45:00 [auto1.de] INFO: Found listing with ID: FT64995
2026-03-30 07:45:00 [auto1.de] INFO: Found listing with ID: HW81308
2026-03-30 07:45:00 [auto1.de] INFO: Found listing with ID: XD50788
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD50788%27 HTTP/1.1" 200 None
2026-03-30 07:45:00 [auto1.de] INFO: Scrape type for XD50788: 2
2026-03-30 07:45:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee4a42b3-4b02-52fe-8493-c672054efd61 with identifier: XD50788
2026-03-30 07:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee4a42b3-4b02-52fe-8493-c672054efd61 with scrape type 2
2026-03-30 07:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee4a42b3-4b02-52fe-8493-c672054efd61 with scrape type 2
2026-03-30 07:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee4a42b3-4b02-52fe-8493-c672054efd61, identifier: XD50788
2026-03-30 07:45:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee4a42b3-4b02-52fe-8493-c672054efd61 with identifier: XD50788
2026-03-30 07:45:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee4a42b3-4b02-52fe-8493-c672054efd61 with identifier: XD50788
2026-03-30 07:45:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee4a42b3-4b02-52fe-8493-c672054efd61 with identifier: XD50788 to the API
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:36:11Z',
 'fuel_type': 'petrol',
 'id': 'ee4a42b3-4b02-52fe-8493-c672054efd61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD50788',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206+',
 'odometer': 164780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-30',
 'seller_name': None,
 'title': 'Peugeot 206+ 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD50788%27 HTTP/1.1" 200 None
2026-03-30 07:45:00 [auto1.de] INFO: Saving data for XD50788: {'auction_closing_time': 1774884971.0, 'created_time': 1774553185.823239, 'last_price_update_time': 1774856700.680217}
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD50788') HTTP/1.1" 204 0
2026-03-30 07:45:00 [auto1.de] INFO: Found listing with ID: WX30438
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30438%27 HTTP/1.1" 200 None
2026-03-30 07:45:00 [auto1.de] INFO: Scrape type for WX30438: 2
2026-03-30 07:45:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e79b38e0-290e-52a4-bbb1-8507bb9e3959 with identifier: WX30438
2026-03-30 07:45:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e79b38e0-290e-52a4-bbb1-8507bb9e3959 with scrape type 2
2026-03-30 07:45:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e79b38e0-290e-52a4-bbb1-8507bb9e3959 with scrape type 2
2026-03-30 07:45:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e79b38e0-290e-52a4-bbb1-8507bb9e3959, identifier: WX30438
2026-03-30 07:45:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e79b38e0-290e-52a4-bbb1-8507bb9e3959 with identifier: WX30438
2026-03-30 07:45:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e79b38e0-290e-52a4-bbb1-8507bb9e3959 with identifier: WX30438
2026-03-30 07:45:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e79b38e0-290e-52a4-bbb1-8507bb9e3959 with identifier: WX30438 to the API
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:05:15Z',
 'fuel_type': 'petrol',
 'id': 'e79b38e0-290e-52a4-bbb1-8507bb9e3959',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WX30438',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Crossland X',
 'odometer': 132987,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-29',
 'seller_name': None,
 'title': 'Opel Crossland X 1.2 Turbo Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2018}
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX30438%27 HTTP/1.1" 200 None
2026-03-30 07:45:01 [auto1.de] INFO: Saving data for WX30438: {'auction_closing_time': 1774883115.0, 'created_time': 1774552882.18503, 'last_price_update_time': 1774856701.145524}
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WX30438') HTTP/1.1" 204 0
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: TX03008
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: ED91782
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED91782%27 HTTP/1.1" 200 None
2026-03-30 07:45:01 [auto1.de] INFO: Scrape type for ED91782: 0
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: MC27977
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: RJ76690
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: FE71372
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE71372%27 HTTP/1.1" 200 None
2026-03-30 07:45:01 [auto1.de] INFO: Scrape type for FE71372: 0
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: AU22690
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: SS51493
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51493%27 HTTP/1.1" 200 None
2026-03-30 07:45:01 [auto1.de] INFO: Scrape type for SS51493: 0
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: DN57570
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: BK33721
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: CC81369
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: HJ55484
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: KU56526
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU56526%27 HTTP/1.1" 200 None
2026-03-30 07:45:01 [auto1.de] INFO: Scrape type for KU56526: 0
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: ZN05925
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN05925%27 HTTP/1.1" 200 None
2026-03-30 07:45:01 [auto1.de] INFO: Scrape type for ZN05925: 0
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD73510%27 HTTP/1.1" 200 None
2026-03-30 07:45:01 [auto1.de] INFO: Scrape type for WD73510: 0
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-30 07:45:01 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-30 07:45:01 [auto1.de] INFO: Scrape type for JJ29192: 0
2026-03-30 07:45:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:02 [auto1.de] INFO: Channel: 24h | Page: 103 | totalHits: 8324 | hits on page: 40
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: PD33755
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: WD73510
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD73510%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for WD73510: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: RP88862
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: ZT00838
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: JJ29192
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ29192%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for JJ29192: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: HJ04828
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ04828%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for HJ04828: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: PH25486
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH25486%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for PH25486: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: GC03067
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: WX13584
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX13584%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for WX13584: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: PB35846
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35846%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for PB35846: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: LW48006
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: HY60596
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY60596%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for HY60596: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: EY00431
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY00431%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for EY00431: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: UR03591
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: RZ14311
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ14311%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for RZ14311: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: YS55163
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS55163%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for YS55163: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: HE80125
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: MK68330
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK68330%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for MK68330: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: VL45063
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: DM70862
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM70862%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for DM70862: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: MU86214
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: BM76815
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM76815%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for BM76815: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: HB08106
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB08106%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for HB08106: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: FX88340
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: ZU40216
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU40216%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for ZU40216: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: JD23896
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD23896%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for JD23896: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: VE61397
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE61397%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for VE61397: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: GW97412
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW97412%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for GW97412: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: CA54240
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA54240%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for CA54240: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: SZ45065
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: DF33717
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: RJ96114
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: UV08426
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV08426%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for UV08426: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: PA19754
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: XR18256
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: ZU43350
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU43350%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for ZU43350: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS28030%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for SS28030: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN40502%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for ZN40502: 0
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-30 07:45:02 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU97666%27 HTTP/1.1" 200 None
2026-03-30 07:45:02 [auto1.de] INFO: Scrape type for VU97666: 0
2026-03-30 07:45:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:04 [auto1.de] INFO: Channel: 24h | Page: 104 | totalHits: 8328 | hits on page: 40
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: SS28030
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS28030%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for SS28030: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: ZN40502
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN40502%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for ZN40502: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: MP68485
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: VU97666
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU97666%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for VU97666: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: WV10952
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV10952%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for WV10952: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: RW04069
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW04069%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for RW04069: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: VD78060
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD78060%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for VD78060: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: SS51107
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS51107%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for SS51107: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: ZZ43768
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ43768%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for ZZ43768: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: CS04042
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS04042%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for CS04042: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: PE27590
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: YG21382
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG21382%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for YG21382: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: FH89031
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH89031%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for FH89031: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: AJ78717
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ78717%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for AJ78717: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: YU03537
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU03537%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for YU03537: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: BZ53185
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: ZK43120
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK43120%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for ZK43120: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: SC19815
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC19815%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for SC19815: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: KR34750
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: BF31444
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF31444%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for BF31444: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: LW69749
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW69749%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for LW69749: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: DJ77655
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ77655%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for DJ77655: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: DG35961
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG35961%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for DG35961: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: JE48122
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE48122%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for JE48122: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: EU51889
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU51889%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for EU51889: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: SD83034
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD83034%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for SD83034: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: WK90635
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: FC40686
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: US02373
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: EG76856
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG76856%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for EG76856: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: SY84491
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY84491%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for SY84491: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: DR94699
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR94699%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for DR94699: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: TP63692
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63692%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for TP63692: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: CT65842
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT65842%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for CT65842: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: ZW22458
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: XY67074
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: GH07682
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH07682%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for GH07682: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: DP85983
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: EK13927
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK13927%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for EK13927: 0
2026-03-30 07:45:04 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA01752%27 HTTP/1.1" 200 None
2026-03-30 07:45:04 [auto1.de] INFO: Scrape type for TA01752: 0
2026-03-30 07:45:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:05 [auto1.de] INFO: Channel: 24h | Page: 105 | totalHits: 8329 | hits on page: 40
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: TA01752
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA01752%27 HTTP/1.1" 200 None
2026-03-30 07:45:05 [auto1.de] INFO: Scrape type for TA01752: 0
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: XT00440
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: KA95549
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: WC28097
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC28097%27 HTTP/1.1" 200 None
2026-03-30 07:45:05 [auto1.de] INFO: Scrape type for WC28097: 0
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: WB32004
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB32004%27 HTTP/1.1" 200 None
2026-03-30 07:45:05 [auto1.de] INFO: Scrape type for WB32004: 0
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: DL51973
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: CG27437
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: CR38354
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR38354%27 HTTP/1.1" 200 None
2026-03-30 07:45:05 [auto1.de] INFO: Scrape type for CR38354: 0
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: FW13122
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: YY97428
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY97428%27 HTTP/1.1" 200 None
2026-03-30 07:45:05 [auto1.de] INFO: Scrape type for YY97428: 0
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: UE91712
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: SW23111
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: EM80186
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EM80186%27 HTTP/1.1" 200 None
2026-03-30 07:45:05 [auto1.de] INFO: Scrape type for EM80186: 0
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: BC27569
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: RM91715
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: VJ30367
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: HT11802
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT11802%27 HTTP/1.1" 200 None
2026-03-30 07:45:05 [auto1.de] INFO: Scrape type for HT11802: 0
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: DB09685
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB09685%27 HTTP/1.1" 200 None
2026-03-30 07:45:05 [auto1.de] INFO: Scrape type for DB09685: 0
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: JT94626
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: NE16717
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE16717%27 HTTP/1.1" 200 None
2026-03-30 07:45:05 [auto1.de] INFO: Scrape type for NE16717: 0
2026-03-30 07:45:05 [auto1.de] INFO: Found listing with ID: HX36326
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX36326%27 HTTP/1.1" 200 None
2026-03-30 07:45:05 [auto1.de] INFO: Scrape type for HX36326: 2
2026-03-30 07:45:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6806d95f-19f3-55b8-a38a-f5a407636989 with identifier: HX36326
2026-03-30 07:45:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6806d95f-19f3-55b8-a38a-f5a407636989 with scrape type 2
2026-03-30 07:45:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6806d95f-19f3-55b8-a38a-f5a407636989 with scrape type 2
2026-03-30 07:45:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6806d95f-19f3-55b8-a38a-f5a407636989, identifier: HX36326
2026-03-30 07:45:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6806d95f-19f3-55b8-a38a-f5a407636989 with identifier: HX36326
2026-03-30 07:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6806d95f-19f3-55b8-a38a-f5a407636989 with identifier: HX36326
2026-03-30 07:45:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6806d95f-19f3-55b8-a38a-f5a407636989 with identifier: HX36326 to the API
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 475,
 'expiration_date': '2026-03-30T15:32:17Z',
 'fuel_type': 'petrol',
 'id': '6806d95f-19f3-55b8-a38a-f5a407636989',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX36326',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 80990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-13',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 63 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2022}
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX36326%27 HTTP/1.1" 200 None
2026-03-30 07:45:06 [auto1.de] INFO: Saving data for HX36326: {'auction_closing_time': 1774884737.0, 'created_time': 1774553221.691818, 'last_price_update_time': 1774856706.514347}
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX36326') HTTP/1.1" 204 0
2026-03-30 07:45:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:06 [auto1.de] INFO: Found listing with ID: SY11611
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY11611%27 HTTP/1.1" 200 None
2026-03-30 07:45:06 [auto1.de] INFO: Scrape type for SY11611: 0
2026-03-30 07:45:06 [auto1.de] INFO: Found listing with ID: ZW76685
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW76685%27 HTTP/1.1" 200 None
2026-03-30 07:45:06 [auto1.de] INFO: Scrape type for ZW76685: 0
2026-03-30 07:45:06 [auto1.de] INFO: Found listing with ID: KS86006
2026-03-30 07:45:06 [auto1.de] INFO: Found listing with ID: ZT22955
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT22955%27 HTTP/1.1" 200 None
2026-03-30 07:45:06 [auto1.de] INFO: Scrape type for ZT22955: 0
2026-03-30 07:45:06 [auto1.de] INFO: Found listing with ID: UZ08427
2026-03-30 07:45:06 [auto1.de] INFO: Found listing with ID: ML35786
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML35786%27 HTTP/1.1" 200 None
2026-03-30 07:45:06 [auto1.de] INFO: Scrape type for ML35786: 0
2026-03-30 07:45:06 [auto1.de] INFO: Found listing with ID: MH82914
2026-03-30 07:45:06 [auto1.de] INFO: Found listing with ID: BC06699
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC06699%27 HTTP/1.1" 200 None
2026-03-30 07:45:06 [auto1.de] INFO: Scrape type for BC06699: 0
2026-03-30 07:45:06 [auto1.de] INFO: Found listing with ID: BX62437
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX62437%27 HTTP/1.1" 200 None
2026-03-30 07:45:06 [auto1.de] INFO: Scrape type for BX62437: 2
2026-03-30 07:45:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb52abd3-624d-5bcf-bc7a-96e781df2035 with identifier: BX62437
2026-03-30 07:45:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb52abd3-624d-5bcf-bc7a-96e781df2035 with scrape type 2
2026-03-30 07:45:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb52abd3-624d-5bcf-bc7a-96e781df2035 with scrape type 2
2026-03-30 07:45:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cb52abd3-624d-5bcf-bc7a-96e781df2035, identifier: BX62437
2026-03-30 07:45:06 [scrapy.extensions.logstats] INFO: Crawled 301 pages (at 17 pages/min), scraped 681 items (at 21 items/min)
2026-03-30 07:45:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:45:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cb52abd3-624d-5bcf-bc7a-96e781df2035 with identifier: BX62437
2026-03-30 07:45:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cb52abd3-624d-5bcf-bc7a-96e781df2035 with identifier: BX62437
2026-03-30 07:45:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cb52abd3-624d-5bcf-bc7a-96e781df2035 with identifier: BX62437 to the API
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:30Z',
 'fuel_type': 'diesel',
 'id': 'cb52abd3-624d-5bcf-bc7a-96e781df2035',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX62437',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '508',
 'odometer': 345146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'Peugeot 508 2.0 HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2012}
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX62437%27 HTTP/1.1" 200 None
2026-03-30 07:45:07 [auto1.de] INFO: Saving data for BX62437: {'auction_closing_time': 1774885890.0, 'created_time': 1774552727.954053, 'last_price_update_time': 1774856707.076179}
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX62437') HTTP/1.1" 204 0
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: BF60599
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: XX92411
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX92411%27 HTTP/1.1" 200 None
2026-03-30 07:45:07 [auto1.de] INFO: Scrape type for XX92411: 0
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: YG74367
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YG74367%27 HTTP/1.1" 200 None
2026-03-30 07:45:07 [auto1.de] INFO: Scrape type for YG74367: 0
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: TW39351
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW39351%27 HTTP/1.1" 200 None
2026-03-30 07:45:07 [auto1.de] INFO: Scrape type for TW39351: 0
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: YG83893
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: MY48051
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY48051%27 HTTP/1.1" 200 None
2026-03-30 07:45:07 [auto1.de] INFO: Scrape type for MY48051: 0
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: EA07160
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA07160%27 HTTP/1.1" 200 None
2026-03-30 07:45:07 [auto1.de] INFO: Scrape type for EA07160: 0
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: VN06555
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN06555%27 HTTP/1.1" 200 None
2026-03-30 07:45:07 [auto1.de] INFO: Scrape type for VN06555: 0
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: WJ12441
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: UC14298
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14298%27 HTTP/1.1" 200 None
2026-03-30 07:45:07 [auto1.de] INFO: Scrape type for UC14298: 0
2026-03-30 07:45:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:07 [auto1.de] INFO: Channel: 24h | Page: 106 | totalHits: 8329 | hits on page: 40
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: NS82829
2026-03-30 07:45:07 [auto1.de] INFO: Found listing with ID: FZ02201
2026-03-30 07:45:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ02201%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for FZ02201: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: FJ78048
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ78048%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for FJ78048: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: EN23227
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: DN49518
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: DJ76178
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ76178%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for DJ76178: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: NN41224
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN41224%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for NN41224: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: US46384
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: BZ42354
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ42354%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for BZ42354: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: PU11267
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU11267%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for PU11267: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: UA59883
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59883%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for UA59883: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: EL79145
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL79145%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for EL79145: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: JB03726
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB03726%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for JB03726: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: RA04600
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: XB85584
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: JG55591
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: BN16879
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: AM22108
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM22108%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for AM22108: 2
2026-03-30 07:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70b120a1-1224-5c23-8b72-67be568f1c46 with identifier: AM22108
2026-03-30 07:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70b120a1-1224-5c23-8b72-67be568f1c46 with scrape type 2
2026-03-30 07:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70b120a1-1224-5c23-8b72-67be568f1c46 with scrape type 2
2026-03-30 07:45:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70b120a1-1224-5c23-8b72-67be568f1c46, identifier: AM22108
2026-03-30 07:45:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70b120a1-1224-5c23-8b72-67be568f1c46 with identifier: AM22108
2026-03-30 07:45:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70b120a1-1224-5c23-8b72-67be568f1c46 with identifier: AM22108
2026-03-30 07:45:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70b120a1-1224-5c23-8b72-67be568f1c46 with identifier: AM22108 to the API
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:52:29Z',
 'fuel_type': 'petrol',
 'id': '70b120a1-1224-5c23-8b72-67be568f1c46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM22108',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 148191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM22108%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Saving data for AM22108: {'auction_closing_time': 1774885949.0, 'created_time': 1774552727.615727, 'last_price_update_time': 1774856708.564142}
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM22108') HTTP/1.1" 204 0
2026-03-30 07:45:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: FU95957
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU95957%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for FU95957: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: PJ55553
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: WR53064
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: YH66607
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: AG88480
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG88480%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for AG88480: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: AV40802
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV40802%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for AV40802: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: EU33293
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU33293%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for EU33293: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: DY72609
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY72609%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for DY72609: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: BD12559
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: MC56654
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: VU29174
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: SN95717
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: BB14997
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB14997%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for BB14997: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: DK43665
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: FF39586
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FF39586%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for FF39586: 0
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: CY56514
2026-03-30 07:45:08 [auto1.de] INFO: Found listing with ID: RG61391
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG61391%27 HTTP/1.1" 200 None
2026-03-30 07:45:08 [auto1.de] INFO: Scrape type for RG61391: 2
2026-03-30 07:45:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5063e0d-e5a5-5006-813f-2e566d25a8ef with identifier: RG61391
2026-03-30 07:45:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5063e0d-e5a5-5006-813f-2e566d25a8ef with scrape type 2
2026-03-30 07:45:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5063e0d-e5a5-5006-813f-2e566d25a8ef with scrape type 2
2026-03-30 07:45:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5063e0d-e5a5-5006-813f-2e566d25a8ef, identifier: RG61391
2026-03-30 07:45:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5063e0d-e5a5-5006-813f-2e566d25a8ef with identifier: RG61391
2026-03-30 07:45:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5063e0d-e5a5-5006-813f-2e566d25a8ef with identifier: RG61391
2026-03-30 07:45:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5063e0d-e5a5-5006-813f-2e566d25a8ef with identifier: RG61391 to the API
2026-03-30 07:45:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-30T15:05:00Z',
 'fuel_type': 'petrol',
 'id': 'a5063e0d-e5a5-5006-813f-2e566d25a8ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RG61391',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 148686,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-04',
 'seller_name': None,
 'title': 'MINI Cooper S',
 'transmission': 'manual',
 'trim': '',
 'year': 2017}
2026-03-30 07:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG61391%27 HTTP/1.1" 200 None
2026-03-30 07:45:09 [auto1.de] INFO: Saving data for RG61391: {'auction_closing_time': 1774883100.0, 'created_time': 1774553252.732048, 'last_price_update_time': 1774856709.19001}
2026-03-30 07:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RG61391') HTTP/1.1" 204 0
2026-03-30 07:45:09 [auto1.de] INFO: Found listing with ID: SC10304
2026-03-30 07:45:09 [auto1.de] INFO: Found listing with ID: UY95441
2026-03-30 07:45:09 [auto1.de] INFO: Found listing with ID: XA15787
2026-03-30 07:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA15787%27 HTTP/1.1" 200 None
2026-03-30 07:45:09 [auto1.de] INFO: Scrape type for XA15787: 0
2026-03-30 07:45:09 [auto1.de] INFO: Found listing with ID: HZ88582
2026-03-30 07:45:09 [auto1.de] INFO: Found listing with ID: XG58500
2026-03-30 07:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG58500%27 HTTP/1.1" 200 None
2026-03-30 07:45:09 [auto1.de] INFO: Scrape type for XG58500: 0
2026-03-30 07:45:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:10 [auto1.de] INFO: Channel: 24h | Page: 107 | totalHits: 8329 | hits on page: 40
2026-03-30 07:45:10 [auto1.de] INFO: Found listing with ID: US51436
2026-03-30 07:45:10 [auto1.de] INFO: Found listing with ID: XX83628
2026-03-30 07:45:10 [auto1.de] INFO: Found listing with ID: UT59305
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT59305%27 HTTP/1.1" 200 None
2026-03-30 07:45:10 [auto1.de] INFO: Scrape type for UT59305: 0
2026-03-30 07:45:10 [auto1.de] INFO: Found listing with ID: KM67977
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM67977%27 HTTP/1.1" 200 None
2026-03-30 07:45:10 [auto1.de] INFO: Scrape type for KM67977: 0
2026-03-30 07:45:10 [auto1.de] INFO: Found listing with ID: EJ47615
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47615%27 HTTP/1.1" 200 None
2026-03-30 07:45:10 [auto1.de] INFO: Scrape type for EJ47615: 2
2026-03-30 07:45:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13f23cf6-3143-5294-aef5-0325e9e616b2 with identifier: EJ47615
2026-03-30 07:45:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13f23cf6-3143-5294-aef5-0325e9e616b2 with scrape type 2
2026-03-30 07:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13f23cf6-3143-5294-aef5-0325e9e616b2 with scrape type 2
2026-03-30 07:45:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13f23cf6-3143-5294-aef5-0325e9e616b2, identifier: EJ47615
2026-03-30 07:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13f23cf6-3143-5294-aef5-0325e9e616b2 with identifier: EJ47615
2026-03-30 07:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13f23cf6-3143-5294-aef5-0325e9e616b2 with identifier: EJ47615
2026-03-30 07:45:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13f23cf6-3143-5294-aef5-0325e9e616b2 with identifier: EJ47615 to the API
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:13:50Z',
 'fuel_type': 'petrol',
 'id': '13f23cf6-3143-5294-aef5-0325e9e616b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ47615',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 140249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-14',
 'seller_name': None,
 'title': 'Skoda Octavia 1.8 TSI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2008}
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ47615%27 HTTP/1.1" 200 None
2026-03-30 07:45:10 [auto1.de] INFO: Saving data for EJ47615: {'auction_closing_time': 1774883630.0, 'created_time': 1774550161.6458, 'last_price_update_time': 1774856710.530354}
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EJ47615') HTTP/1.1" 204 0
2026-03-30 07:45:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:10 [auto1.de] INFO: Found listing with ID: DU13341
2026-03-30 07:45:10 [auto1.de] INFO: Found listing with ID: PG49368
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG49368%27 HTTP/1.1" 200 None
2026-03-30 07:45:10 [auto1.de] INFO: Scrape type for PG49368: 2
2026-03-30 07:45:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63917e11-5bbd-54d1-b0e6-822d332adb84 with identifier: PG49368
2026-03-30 07:45:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63917e11-5bbd-54d1-b0e6-822d332adb84 with scrape type 2
2026-03-30 07:45:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 63917e11-5bbd-54d1-b0e6-822d332adb84 with scrape type 2
2026-03-30 07:45:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 63917e11-5bbd-54d1-b0e6-822d332adb84, identifier: PG49368
2026-03-30 07:45:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 63917e11-5bbd-54d1-b0e6-822d332adb84 with identifier: PG49368
2026-03-30 07:45:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 63917e11-5bbd-54d1-b0e6-822d332adb84 with identifier: PG49368
2026-03-30 07:45:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 63917e11-5bbd-54d1-b0e6-822d332adb84 with identifier: PG49368 to the API
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:33:52Z',
 'fuel_type': 'petrol',
 'id': '63917e11-5bbd-54d1-b0e6-822d332adb84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG49368',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 147676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-01',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 400 CGI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2015}
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG49368%27 HTTP/1.1" 200 None
2026-03-30 07:45:11 [auto1.de] INFO: Saving data for PG49368: {'auction_closing_time': 1774884832.0, 'created_time': 1773946122.845236, 'last_price_update_time': 1774856711.115737}
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG49368') HTTP/1.1" 204 0
2026-03-30 07:45:11 [auto1.de] INFO: Found listing with ID: PA77354
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA77354%27 HTTP/1.1" 200 None
2026-03-30 07:45:11 [auto1.de] INFO: Scrape type for PA77354: 2
2026-03-30 07:45:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fc96ba6-ba3d-5607-ba97-394886380936 with identifier: PA77354
2026-03-30 07:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc96ba6-ba3d-5607-ba97-394886380936 with scrape type 2
2026-03-30 07:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fc96ba6-ba3d-5607-ba97-394886380936 with scrape type 2
2026-03-30 07:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fc96ba6-ba3d-5607-ba97-394886380936, identifier: PA77354
2026-03-30 07:45:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fc96ba6-ba3d-5607-ba97-394886380936 with identifier: PA77354
2026-03-30 07:45:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fc96ba6-ba3d-5607-ba97-394886380936 with identifier: PA77354
2026-03-30 07:45:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fc96ba6-ba3d-5607-ba97-394886380936 with identifier: PA77354 to the API
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:38:28Z',
 'fuel_type': 'diesel',
 'id': '0fc96ba6-ba3d-5607-ba97-394886380936',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA77354',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 235848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2016}
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA77354%27 HTTP/1.1" 200 None
2026-03-30 07:45:11 [auto1.de] INFO: Saving data for PA77354: {'auction_closing_time': 1774885108.0, 'created_time': 1774553206.36597, 'last_price_update_time': 1774856711.627486}
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PA77354') HTTP/1.1" 204 0
2026-03-30 07:45:11 [auto1.de] INFO: Found listing with ID: TY82930
2026-03-30 07:45:11 [auto1.de] INFO: Found listing with ID: EB22696
2026-03-30 07:45:11 [auto1.de] INFO: Found listing with ID: NC35007
2026-03-30 07:45:11 [auto1.de] INFO: Found listing with ID: YT04304
2026-03-30 07:45:11 [auto1.de] INFO: Found listing with ID: SW44796
2026-03-30 07:45:11 [auto1.de] INFO: Found listing with ID: BB73401
2026-03-30 07:45:11 [auto1.de] INFO: Found listing with ID: YB02361
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB02361%27 HTTP/1.1" 200 None
2026-03-30 07:45:11 [auto1.de] INFO: Scrape type for YB02361: 2
2026-03-30 07:45:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2da39ca-38cd-505d-b354-ee15dc12ca4f with identifier: YB02361
2026-03-30 07:45:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2da39ca-38cd-505d-b354-ee15dc12ca4f with scrape type 2
2026-03-30 07:45:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2da39ca-38cd-505d-b354-ee15dc12ca4f with scrape type 2
2026-03-30 07:45:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e2da39ca-38cd-505d-b354-ee15dc12ca4f, identifier: YB02361
2026-03-30 07:45:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e2da39ca-38cd-505d-b354-ee15dc12ca4f with identifier: YB02361
2026-03-30 07:45:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e2da39ca-38cd-505d-b354-ee15dc12ca4f with identifier: YB02361
2026-03-30 07:45:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e2da39ca-38cd-505d-b354-ee15dc12ca4f with identifier: YB02361 to the API
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:35:27Z',
 'fuel_type': 'petrol',
 'id': 'e2da39ca-38cd-505d-b354-ee15dc12ca4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB02361',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 160590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-19',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB02361%27 HTTP/1.1" 200 None
2026-03-30 07:45:12 [auto1.de] INFO: Saving data for YB02361: {'auction_closing_time': 1774884927.0, 'created_time': 1774639969.35691, 'last_price_update_time': 1774856712.023933}
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB02361') HTTP/1.1" 204 0
2026-03-30 07:45:12 [auto1.de] INFO: Found listing with ID: WP48150
2026-03-30 07:45:12 [auto1.de] INFO: Found listing with ID: PG96137
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96137%27 HTTP/1.1" 200 None
2026-03-30 07:45:12 [auto1.de] INFO: Scrape type for PG96137: 2
2026-03-30 07:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with identifier: PG96137
2026-03-30 07:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with scrape type 2
2026-03-30 07:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with scrape type 2
2026-03-30 07:45:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c587baa0-ea6d-5899-9247-93b9b9d3d4b5, identifier: PG96137
2026-03-30 07:45:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with identifier: PG96137
2026-03-30 07:45:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with identifier: PG96137
2026-03-30 07:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c587baa0-ea6d-5899-9247-93b9b9d3d4b5 with identifier: PG96137 to the API
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:28:37Z',
 'fuel_type': 'petrol',
 'id': 'c587baa0-ea6d-5899-9247-93b9b9d3d4b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PG96137',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 8321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-30',
 'seller_name': None,
 'title': 'Hyundai i20 1.0 TGDI Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2024}
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG96137%27 HTTP/1.1" 200 None
2026-03-30 07:45:12 [auto1.de] INFO: Saving data for PG96137: {'auction_closing_time': 1774884517.0, 'created_time': 1774551554.027858, 'last_price_update_time': 1774856712.439016}
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PG96137') HTTP/1.1" 204 0
2026-03-30 07:45:12 [auto1.de] INFO: Found listing with ID: XM92815
2026-03-30 07:45:12 [auto1.de] INFO: Found listing with ID: GE16975
2026-03-30 07:45:12 [auto1.de] INFO: Found listing with ID: XL13857
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL13857%27 HTTP/1.1" 200 None
2026-03-30 07:45:12 [auto1.de] INFO: Scrape type for XL13857: 0
2026-03-30 07:45:12 [auto1.de] INFO: Found listing with ID: TJ39363
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ39363%27 HTTP/1.1" 200 None
2026-03-30 07:45:12 [auto1.de] INFO: Scrape type for TJ39363: 0
2026-03-30 07:45:12 [auto1.de] INFO: Found listing with ID: PN86617
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN86617%27 HTTP/1.1" 200 None
2026-03-30 07:45:12 [auto1.de] INFO: Scrape type for PN86617: 2
2026-03-30 07:45:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 210310bd-e47b-5d49-8937-d07d01a3ed4e with identifier: PN86617
2026-03-30 07:45:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 210310bd-e47b-5d49-8937-d07d01a3ed4e with scrape type 2
2026-03-30 07:45:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 210310bd-e47b-5d49-8937-d07d01a3ed4e with scrape type 2
2026-03-30 07:45:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 210310bd-e47b-5d49-8937-d07d01a3ed4e, identifier: PN86617
2026-03-30 07:45:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 210310bd-e47b-5d49-8937-d07d01a3ed4e with identifier: PN86617
2026-03-30 07:45:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 210310bd-e47b-5d49-8937-d07d01a3ed4e with identifier: PN86617
2026-03-30 07:45:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 210310bd-e47b-5d49-8937-d07d01a3ed4e with identifier: PN86617 to the API
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:15:09Z',
 'fuel_type': 'petrol',
 'id': '210310bd-e47b-5d49-8937-d07d01a3ed4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN86617',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 186932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-24',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Copa',
 'transmission': 'manual',
 'trim': 'Copa',
 'year': 2011}
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN86617%27 HTTP/1.1" 200 None
2026-03-30 07:45:12 [auto1.de] INFO: Saving data for PN86617: {'auction_closing_time': 1774883709.0, 'created_time': 1774639458.90257, 'last_price_update_time': 1774856712.872436}
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN86617') HTTP/1.1" 204 0
2026-03-30 07:45:12 [auto1.de] INFO: Found listing with ID: KP27245
2026-03-30 07:45:12 [auto1.de] INFO: Found listing with ID: NY45710
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY45710%27 HTTP/1.1" 200 None
2026-03-30 07:45:13 [auto1.de] INFO: Scrape type for NY45710: 0
2026-03-30 07:45:13 [auto1.de] INFO: Found listing with ID: MG32866
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG32866%27 HTTP/1.1" 200 None
2026-03-30 07:45:13 [auto1.de] INFO: Scrape type for MG32866: 2
2026-03-30 07:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f767b67a-f6e3-5ff4-a583-5673ce610fd4 with identifier: MG32866
2026-03-30 07:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f767b67a-f6e3-5ff4-a583-5673ce610fd4 with scrape type 2
2026-03-30 07:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f767b67a-f6e3-5ff4-a583-5673ce610fd4 with scrape type 2
2026-03-30 07:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f767b67a-f6e3-5ff4-a583-5673ce610fd4, identifier: MG32866
2026-03-30 07:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f767b67a-f6e3-5ff4-a583-5673ce610fd4 with identifier: MG32866
2026-03-30 07:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f767b67a-f6e3-5ff4-a583-5673ce610fd4 with identifier: MG32866
2026-03-30 07:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f767b67a-f6e3-5ff4-a583-5673ce610fd4 with identifier: MG32866 to the API
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:26:36Z',
 'fuel_type': 'diesel',
 'id': 'f767b67a-f6e3-5ff4-a583-5673ce610fd4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG32866',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 337989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-25',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2013}
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG32866%27 HTTP/1.1" 200 None
2026-03-30 07:45:13 [auto1.de] INFO: Saving data for MG32866: {'auction_closing_time': 1774884396.0, 'created_time': 1774639494.77686, 'last_price_update_time': 1774856713.397054}
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG32866') HTTP/1.1" 204 0
2026-03-30 07:45:13 [auto1.de] INFO: Found listing with ID: BA43321
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA43321%27 HTTP/1.1" 200 None
2026-03-30 07:45:13 [auto1.de] INFO: Scrape type for BA43321: 2
2026-03-30 07:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cddd076c-9a2a-55c4-b1be-54e97fff39f9 with identifier: BA43321
2026-03-30 07:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cddd076c-9a2a-55c4-b1be-54e97fff39f9 with scrape type 2
2026-03-30 07:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cddd076c-9a2a-55c4-b1be-54e97fff39f9 with scrape type 2
2026-03-30 07:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cddd076c-9a2a-55c4-b1be-54e97fff39f9, identifier: BA43321
2026-03-30 07:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cddd076c-9a2a-55c4-b1be-54e97fff39f9 with identifier: BA43321
2026-03-30 07:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cddd076c-9a2a-55c4-b1be-54e97fff39f9 with identifier: BA43321
2026-03-30 07:45:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cddd076c-9a2a-55c4-b1be-54e97fff39f9 with identifier: BA43321 to the API
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:10:31Z',
 'fuel_type': 'petrol',
 'id': 'cddd076c-9a2a-55c4-b1be-54e97fff39f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA43321',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 176474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-31',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 Tour',
 'transmission': 'manual',
 'trim': 'Tour',
 'year': 2007}
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA43321%27 HTTP/1.1" 200 None
2026-03-30 07:45:13 [auto1.de] INFO: Saving data for BA43321: {'auction_closing_time': 1774883431.0, 'created_time': 1774639548.090632, 'last_price_update_time': 1774856713.822626}
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BA43321') HTTP/1.1" 204 0
2026-03-30 07:45:13 [auto1.de] INFO: Found listing with ID: CH25051
2026-03-30 07:45:13 [auto1.de] INFO: Found listing with ID: BK83629
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK83629%27 HTTP/1.1" 200 None
2026-03-30 07:45:13 [auto1.de] INFO: Scrape type for BK83629: 0
2026-03-30 07:45:13 [auto1.de] INFO: Found listing with ID: EW06930
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW06930%27 HTTP/1.1" 200 None
2026-03-30 07:45:13 [auto1.de] INFO: Scrape type for EW06930: 2
2026-03-30 07:45:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b166e828-9d41-5412-a9ef-35424e6c20e4 with identifier: EW06930
2026-03-30 07:45:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b166e828-9d41-5412-a9ef-35424e6c20e4 with scrape type 2
2026-03-30 07:45:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b166e828-9d41-5412-a9ef-35424e6c20e4 with scrape type 2
2026-03-30 07:45:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b166e828-9d41-5412-a9ef-35424e6c20e4, identifier: EW06930
2026-03-30 07:45:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b166e828-9d41-5412-a9ef-35424e6c20e4 with identifier: EW06930
2026-03-30 07:45:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b166e828-9d41-5412-a9ef-35424e6c20e4 with identifier: EW06930
2026-03-30 07:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b166e828-9d41-5412-a9ef-35424e6c20e4 with identifier: EW06930 to the API
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:12:52Z',
 'fuel_type': 'petrol',
 'id': 'b166e828-9d41-5412-a9ef-35424e6c20e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW06930',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 152343,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-08',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 Classic blue 2WD',
 'transmission': 'manual',
 'trim': 'Classic blue 2WD',
 'year': 2017}
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW06930%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Saving data for EW06930: {'auction_closing_time': 1774883572.0, 'created_time': 1774350273.211319, 'last_price_update_time': 1774856714.268149}
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW06930') HTTP/1.1" 204 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: RX49945
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX49945%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for RX49945: 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: VL21879
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: LH67751
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LH67751%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for LH67751: 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: FJ40863
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: UX44500
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: YM46431
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: TS61714
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS61714%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for TS61714: 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for BG27909: 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-30 07:45:14 [auto1.de] INFO: Channel: 24h | Page: 108 | totalHits: 8333 | hits on page: 40
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: DY93616
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: BC55610
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: BG27909
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG27909%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for BG27909: 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: YH78241
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: VH36335
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: EH98635
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: XH00472
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: HY54532
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY54532%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for HY54532: 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: NC31400
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: YR31209
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: CK07133
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: ZK30866
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: GC84828
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC84828%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for GC84828: 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: AY33433
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY33433%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for AY33433: 2
2026-03-30 07:45:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9be7b708-6fc8-5ce8-abcb-e97712956c66 with identifier: AY33433
2026-03-30 07:45:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9be7b708-6fc8-5ce8-abcb-e97712956c66 with scrape type 2
2026-03-30 07:45:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9be7b708-6fc8-5ce8-abcb-e97712956c66 with scrape type 2
2026-03-30 07:45:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9be7b708-6fc8-5ce8-abcb-e97712956c66, identifier: AY33433
2026-03-30 07:45:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9be7b708-6fc8-5ce8-abcb-e97712956c66 with identifier: AY33433
2026-03-30 07:45:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9be7b708-6fc8-5ce8-abcb-e97712956c66 with identifier: AY33433
2026-03-30 07:45:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9be7b708-6fc8-5ce8-abcb-e97712956c66 with identifier: AY33433 to the API
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 450,
 'expiration_date': '2026-03-30T15:37:26Z',
 'fuel_type': 'petrol',
 'id': '9be7b708-6fc8-5ce8-abcb-e97712956c66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY33433',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X6',
 'odometer': 202549,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-27',
 'seller_name': None,
 'title': 'BMW X6 xDrive 50i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY33433%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Saving data for AY33433: {'auction_closing_time': 1774885046.0, 'created_time': 1773306678.29545, 'last_price_update_time': 1774856714.809522}
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY33433') HTTP/1.1" 204 0
2026-03-30 07:45:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: GB85775
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: CN56098
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: SB04104
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB04104%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for SB04104: 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: SA06109
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: AH65486
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH65486%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for AH65486: 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: MH69826
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH69826%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for MH69826: 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: VA96509
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: TC39197
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TC39197%27 HTTP/1.1" 200 None
2026-03-30 07:45:14 [auto1.de] INFO: Scrape type for TC39197: 0
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: LV46830
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: PX02497
2026-03-30 07:45:14 [auto1.de] INFO: Found listing with ID: EU27466
2026-03-30 07:45:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU27466%27 HTTP/1.1" 200 None
2026-03-30 07:45:15 [auto1.de] INFO: Scrape type for EU27466: 0
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: ZR48762
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR48762%27 HTTP/1.1" 200 None
2026-03-30 07:45:15 [auto1.de] INFO: Scrape type for ZR48762: 0
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: GG35295
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: HU76899
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: AU24928
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: BC43890
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC43890%27 HTTP/1.1" 200 None
2026-03-30 07:45:15 [auto1.de] INFO: Scrape type for BC43890: 2
2026-03-30 07:45:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd05619-f972-5c55-8e5f-f9611b26f802 with identifier: BC43890
2026-03-30 07:45:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd05619-f972-5c55-8e5f-f9611b26f802 with scrape type 2
2026-03-30 07:45:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffd05619-f972-5c55-8e5f-f9611b26f802 with scrape type 2
2026-03-30 07:45:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ffd05619-f972-5c55-8e5f-f9611b26f802, identifier: BC43890
2026-03-30 07:45:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ffd05619-f972-5c55-8e5f-f9611b26f802 with identifier: BC43890
2026-03-30 07:45:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ffd05619-f972-5c55-8e5f-f9611b26f802 with identifier: BC43890
2026-03-30 07:45:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ffd05619-f972-5c55-8e5f-f9611b26f802 with identifier: BC43890 to the API
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:02:04Z',
 'fuel_type': 'diesel',
 'id': 'ffd05619-f972-5c55-8e5f-f9611b26f802',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC43890',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 47067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-19',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Sportline',
 'transmission': 'automatic',
 'trim': 'Sportline',
 'year': 2013}
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC43890%27 HTTP/1.1" 200 None
2026-03-30 07:45:15 [auto1.de] INFO: Saving data for BC43890: {'auction_closing_time': 1774882924.0, 'created_time': 1773229296.384062, 'last_price_update_time': 1774856715.433206}
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC43890') HTTP/1.1" 204 0
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: DZ70756
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ70756%27 HTTP/1.1" 200 None
2026-03-30 07:45:15 [auto1.de] INFO: Scrape type for DZ70756: 0
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: KC98509
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC98509%27 HTTP/1.1" 200 None
2026-03-30 07:45:15 [auto1.de] INFO: Scrape type for KC98509: 0
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: XM85964
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: ZY67532
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67532%27 HTTP/1.1" 200 None
2026-03-30 07:45:15 [auto1.de] INFO: Scrape type for ZY67532: 0
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: NB74696
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: RN84486
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN84486%27 HTTP/1.1" 200 None
2026-03-30 07:45:15 [auto1.de] INFO: Scrape type for RN84486: 0
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: TT79830
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-30 07:45:15 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-30 07:45:15 [auto1.de] INFO: Scrape type for PZ64082: 0
2026-03-30 07:45:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:16 [auto1.de] INFO: Channel: 24h | Page: 109 | totalHits: 8336 | hits on page: 40
2026-03-30 07:45:16 [auto1.de] INFO: Found listing with ID: EV07676
2026-03-30 07:45:16 [auto1.de] INFO: Found listing with ID: BJ76765
2026-03-30 07:45:16 [auto1.de] INFO: Found listing with ID: PZ64082
2026-03-30 07:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ64082%27 HTTP/1.1" 200 None
2026-03-30 07:45:16 [auto1.de] INFO: Scrape type for PZ64082: 0
2026-03-30 07:45:16 [auto1.de] INFO: Found listing with ID: BS83474
2026-03-30 07:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS83474%27 HTTP/1.1" 200 None
2026-03-30 07:45:16 [auto1.de] INFO: Scrape type for BS83474: 0
2026-03-30 07:45:16 [auto1.de] INFO: Found listing with ID: FY30353
2026-03-30 07:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY30353%27 HTTP/1.1" 200 None
2026-03-30 07:45:16 [auto1.de] INFO: Scrape type for FY30353: 0
2026-03-30 07:45:16 [auto1.de] INFO: Found listing with ID: EB23649
2026-03-30 07:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB23649%27 HTTP/1.1" 200 None
2026-03-30 07:45:16 [auto1.de] INFO: Scrape type for EB23649: 2
2026-03-30 07:45:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cbd7f3e-9b31-509f-8abc-9398c5c65557 with identifier: EB23649
2026-03-30 07:45:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cbd7f3e-9b31-509f-8abc-9398c5c65557 with scrape type 2
2026-03-30 07:45:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cbd7f3e-9b31-509f-8abc-9398c5c65557 with scrape type 2
2026-03-30 07:45:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4cbd7f3e-9b31-509f-8abc-9398c5c65557, identifier: EB23649
2026-03-30 07:45:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4cbd7f3e-9b31-509f-8abc-9398c5c65557 with identifier: EB23649
2026-03-30 07:45:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4cbd7f3e-9b31-509f-8abc-9398c5c65557 with identifier: EB23649
2026-03-30 07:45:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4cbd7f3e-9b31-509f-8abc-9398c5c65557 with identifier: EB23649 to the API
2026-03-30 07:45:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:35:11Z',
 'fuel_type': 'diesel',
 'id': '4cbd7f3e-9b31-509f-8abc-9398c5c65557',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB23649',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand Tourneo Connect',
 'odometer': 142528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-21',
 'seller_name': None,
 'title': 'Ford Grand Tourneo Connect 1.5 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB23649%27 HTTP/1.1" 200 None
2026-03-30 07:45:17 [auto1.de] INFO: Saving data for EB23649: {'auction_closing_time': 1774884911.0, 'created_time': 1773346258.894659, 'last_price_update_time': 1774856717.137871}
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB23649') HTTP/1.1" 204 0
2026-03-30 07:45:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:17 [auto1.de] INFO: Found listing with ID: DW20402
2026-03-30 07:45:17 [auto1.de] INFO: Found listing with ID: WR55651
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR55651%27 HTTP/1.1" 200 None
2026-03-30 07:45:17 [auto1.de] INFO: Scrape type for WR55651: 2
2026-03-30 07:45:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 538f7d47-b299-5fa2-ba3b-7ef59429df8a with identifier: WR55651
2026-03-30 07:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 538f7d47-b299-5fa2-ba3b-7ef59429df8a with scrape type 2
2026-03-30 07:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 538f7d47-b299-5fa2-ba3b-7ef59429df8a with scrape type 2
2026-03-30 07:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 538f7d47-b299-5fa2-ba3b-7ef59429df8a, identifier: WR55651
2026-03-30 07:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 538f7d47-b299-5fa2-ba3b-7ef59429df8a with identifier: WR55651
2026-03-30 07:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 538f7d47-b299-5fa2-ba3b-7ef59429df8a with identifier: WR55651
2026-03-30 07:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 538f7d47-b299-5fa2-ba3b-7ef59429df8a with identifier: WR55651 to the API
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-30T15:05:17Z',
 'fuel_type': 'diesel',
 'id': '538f7d47-b299-5fa2-ba3b-7ef59429df8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR55651',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 98280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-16',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Generation Six',
 'transmission': 'automatic',
 'trim': 'Generation Six',
 'year': 2019}
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR55651%27 HTTP/1.1" 200 None
2026-03-30 07:45:17 [auto1.de] INFO: Saving data for WR55651: {'auction_closing_time': 1774883117.0, 'created_time': 1774553242.649856, 'last_price_update_time': 1774856717.647954}
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WR55651') HTTP/1.1" 204 0
2026-03-30 07:45:17 [auto1.de] INFO: Found listing with ID: RU04475
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU04475%27 HTTP/1.1" 200 None
2026-03-30 07:45:17 [auto1.de] INFO: Scrape type for RU04475: 0
2026-03-30 07:45:17 [auto1.de] INFO: Found listing with ID: CM46932
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46932%27 HTTP/1.1" 200 None
2026-03-30 07:45:17 [auto1.de] INFO: Scrape type for CM46932: 2
2026-03-30 07:45:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0c3ac8d-87d2-54fc-ac2f-e6626cabc3dd with identifier: CM46932
2026-03-30 07:45:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0c3ac8d-87d2-54fc-ac2f-e6626cabc3dd with scrape type 2
2026-03-30 07:45:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0c3ac8d-87d2-54fc-ac2f-e6626cabc3dd with scrape type 2
2026-03-30 07:45:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0c3ac8d-87d2-54fc-ac2f-e6626cabc3dd, identifier: CM46932
2026-03-30 07:45:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0c3ac8d-87d2-54fc-ac2f-e6626cabc3dd with identifier: CM46932
2026-03-30 07:45:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0c3ac8d-87d2-54fc-ac2f-e6626cabc3dd with identifier: CM46932
2026-03-30 07:45:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0c3ac8d-87d2-54fc-ac2f-e6626cabc3dd with identifier: CM46932 to the API
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:18:18Z',
 'fuel_type': 'petrol',
 'id': 'e0c3ac8d-87d2-54fc-ac2f-e6626cabc3dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM46932',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'CC',
 'odometer': 153755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-24',
 'seller_name': None,
 'title': 'Volkswagen CC 2.0 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM46932%27 HTTP/1.1" 200 None
2026-03-30 07:45:18 [auto1.de] INFO: Saving data for CM46932: {'auction_closing_time': 1774883898.0, 'created_time': 1773308387.617539, 'last_price_update_time': 1774856718.105348}
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM46932') HTTP/1.1" 204 0
2026-03-30 07:45:18 [auto1.de] INFO: Found listing with ID: RJ05854
2026-03-30 07:45:18 [auto1.de] INFO: Found listing with ID: YU99321
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU99321%27 HTTP/1.1" 200 None
2026-03-30 07:45:18 [auto1.de] INFO: Scrape type for YU99321: 2
2026-03-30 07:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2865997-ca44-5bbb-aeaa-7a1024293033 with identifier: YU99321
2026-03-30 07:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2865997-ca44-5bbb-aeaa-7a1024293033 with scrape type 2
2026-03-30 07:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2865997-ca44-5bbb-aeaa-7a1024293033 with scrape type 2
2026-03-30 07:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2865997-ca44-5bbb-aeaa-7a1024293033, identifier: YU99321
2026-03-30 07:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2865997-ca44-5bbb-aeaa-7a1024293033 with identifier: YU99321
2026-03-30 07:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2865997-ca44-5bbb-aeaa-7a1024293033 with identifier: YU99321
2026-03-30 07:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2865997-ca44-5bbb-aeaa-7a1024293033 with identifier: YU99321 to the API
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:18Z',
 'fuel_type': 'petrol',
 'id': 'd2865997-ca44-5bbb-aeaa-7a1024293033',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU99321',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 65779,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2021}
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU99321%27 HTTP/1.1" 200 None
2026-03-30 07:45:18 [auto1.de] INFO: Saving data for YU99321: {'auction_closing_time': 1774885398.0, 'created_time': 1774640012.33742, 'last_price_update_time': 1774856718.535714}
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YU99321') HTTP/1.1" 204 0
2026-03-30 07:45:18 [auto1.de] INFO: Found listing with ID: LZ09190
2026-03-30 07:45:18 [auto1.de] INFO: Found listing with ID: GR11096
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR11096%27 HTTP/1.1" 200 None
2026-03-30 07:45:18 [auto1.de] INFO: Scrape type for GR11096: 0
2026-03-30 07:45:18 [auto1.de] INFO: Found listing with ID: BS30478
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS30478%27 HTTP/1.1" 200 None
2026-03-30 07:45:18 [auto1.de] INFO: Scrape type for BS30478: 2
2026-03-30 07:45:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 937251a1-fa73-558e-991e-76bb20e492ca with identifier: BS30478
2026-03-30 07:45:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 937251a1-fa73-558e-991e-76bb20e492ca with scrape type 2
2026-03-30 07:45:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 937251a1-fa73-558e-991e-76bb20e492ca with scrape type 2
2026-03-30 07:45:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 937251a1-fa73-558e-991e-76bb20e492ca, identifier: BS30478
2026-03-30 07:45:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 937251a1-fa73-558e-991e-76bb20e492ca with identifier: BS30478
2026-03-30 07:45:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 937251a1-fa73-558e-991e-76bb20e492ca with identifier: BS30478
2026-03-30 07:45:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 937251a1-fa73-558e-991e-76bb20e492ca with identifier: BS30478 to the API
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:15:30Z',
 'fuel_type': 'petrol',
 'id': '937251a1-fa73-558e-991e-76bb20e492ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS30478',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 129793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-29',
 'seller_name': None,
 'title': 'Renault Twingo 0.9 Energy Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2014}
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS30478%27 HTTP/1.1" 200 None
2026-03-30 07:45:18 [auto1.de] INFO: Saving data for BS30478: {'auction_closing_time': 1774883730.0, 'created_time': 1774550325.429398, 'last_price_update_time': 1774856718.961533}
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS30478') HTTP/1.1" 204 0
2026-03-30 07:45:18 [auto1.de] INFO: Found listing with ID: AU06034
2026-03-30 07:45:18 [auto1.de] INFO: Found listing with ID: BU34226
2026-03-30 07:45:18 [auto1.de] INFO: Found listing with ID: LM64010
2026-03-30 07:45:18 [auto1.de] INFO: Found listing with ID: CH30601
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH30601%27 HTTP/1.1" 200 None
2026-03-30 07:45:18 [auto1.de] INFO: Scrape type for CH30601: 0
2026-03-30 07:45:18 [auto1.de] INFO: Found listing with ID: UZ43090
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43090%27 HTTP/1.1" 200 None
2026-03-30 07:45:19 [auto1.de] INFO: Scrape type for UZ43090: 0
2026-03-30 07:45:19 [auto1.de] INFO: Found listing with ID: BP69696
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP69696%27 HTTP/1.1" 200 None
2026-03-30 07:45:19 [auto1.de] INFO: Scrape type for BP69696: 0
2026-03-30 07:45:19 [auto1.de] INFO: Found listing with ID: VS98384
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS98384%27 HTTP/1.1" 200 None
2026-03-30 07:45:19 [auto1.de] INFO: Scrape type for VS98384: 2
2026-03-30 07:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 145f8591-d586-5d42-8b9f-4082b34ae055 with identifier: VS98384
2026-03-30 07:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 145f8591-d586-5d42-8b9f-4082b34ae055 with scrape type 2
2026-03-30 07:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 145f8591-d586-5d42-8b9f-4082b34ae055 with scrape type 2
2026-03-30 07:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 145f8591-d586-5d42-8b9f-4082b34ae055, identifier: VS98384
2026-03-30 07:45:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 145f8591-d586-5d42-8b9f-4082b34ae055 with identifier: VS98384
2026-03-30 07:45:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 145f8591-d586-5d42-8b9f-4082b34ae055 with identifier: VS98384
2026-03-30 07:45:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 145f8591-d586-5d42-8b9f-4082b34ae055 with identifier: VS98384 to the API
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:31:56Z',
 'fuel_type': 'petrol',
 'id': '145f8591-d586-5d42-8b9f-4082b34ae055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS98384',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 162361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-02-29',
 'seller_name': None,
 'title': 'Toyota Corolla 1.4 Liftback Terra',
 'transmission': 'manual',
 'trim': 'Liftback Terra',
 'year': 2000}
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS98384%27 HTTP/1.1" 200 None
2026-03-30 07:45:19 [auto1.de] INFO: Saving data for VS98384: {'auction_closing_time': 1774884716.0, 'created_time': 1774550639.451163, 'last_price_update_time': 1774856719.441511}
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS98384') HTTP/1.1" 204 0
2026-03-30 07:45:19 [auto1.de] INFO: Found listing with ID: LW30512
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW30512%27 HTTP/1.1" 200 None
2026-03-30 07:45:19 [auto1.de] INFO: Scrape type for LW30512: 0
2026-03-30 07:45:19 [auto1.de] INFO: Found listing with ID: DB30141
2026-03-30 07:45:19 [auto1.de] INFO: Found listing with ID: GB27132
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB27132%27 HTTP/1.1" 200 None
2026-03-30 07:45:19 [auto1.de] INFO: Scrape type for GB27132: 0
2026-03-30 07:45:19 [auto1.de] INFO: Found listing with ID: KG01306
2026-03-30 07:45:19 [auto1.de] INFO: Found listing with ID: GW76676
2026-03-30 07:45:19 [auto1.de] INFO: Found listing with ID: JR98479
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR98479%27 HTTP/1.1" 200 None
2026-03-30 07:45:19 [auto1.de] INFO: Scrape type for JR98479: 0
2026-03-30 07:45:19 [auto1.de] INFO: Found listing with ID: ZD70727
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD70727%27 HTTP/1.1" 200 None
2026-03-30 07:45:19 [auto1.de] INFO: Scrape type for ZD70727: 2
2026-03-30 07:45:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4fe22a5-c396-57f7-b7ba-14892afb6bfa with identifier: ZD70727
2026-03-30 07:45:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4fe22a5-c396-57f7-b7ba-14892afb6bfa with scrape type 2
2026-03-30 07:45:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4fe22a5-c396-57f7-b7ba-14892afb6bfa with scrape type 2
2026-03-30 07:45:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4fe22a5-c396-57f7-b7ba-14892afb6bfa, identifier: ZD70727
2026-03-30 07:45:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4fe22a5-c396-57f7-b7ba-14892afb6bfa with identifier: ZD70727
2026-03-30 07:45:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4fe22a5-c396-57f7-b7ba-14892afb6bfa with identifier: ZD70727
2026-03-30 07:45:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4fe22a5-c396-57f7-b7ba-14892afb6bfa with identifier: ZD70727 to the API
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:14:13Z',
 'fuel_type': 'petrol',
 'id': 'b4fe22a5-c396-57f7-b7ba-14892afb6bfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZD70727',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 83192,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TSI GTI',
 'transmission': 'automatic',
 'trim': 'GTI',
 'year': 2020}
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD70727%27 HTTP/1.1" 200 None
2026-03-30 07:45:20 [auto1.de] INFO: Saving data for ZD70727: {'auction_closing_time': 1774883653.0, 'created_time': 1774550666.193685, 'last_price_update_time': 1774856720.016827}
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZD70727') HTTP/1.1" 204 0
2026-03-30 07:45:20 [auto1.de] INFO: Found listing with ID: RW15562
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW15562%27 HTTP/1.1" 200 None
2026-03-30 07:45:20 [auto1.de] INFO: Scrape type for RW15562: 2
2026-03-30 07:45:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bacae09-2669-50ba-b443-a8bbf546c428 with identifier: RW15562
2026-03-30 07:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bacae09-2669-50ba-b443-a8bbf546c428 with scrape type 2
2026-03-30 07:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bacae09-2669-50ba-b443-a8bbf546c428 with scrape type 2
2026-03-30 07:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bacae09-2669-50ba-b443-a8bbf546c428, identifier: RW15562
2026-03-30 07:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bacae09-2669-50ba-b443-a8bbf546c428 with identifier: RW15562
2026-03-30 07:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bacae09-2669-50ba-b443-a8bbf546c428 with identifier: RW15562
2026-03-30 07:45:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bacae09-2669-50ba-b443-a8bbf546c428 with identifier: RW15562 to the API
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:29:53Z',
 'fuel_type': 'petrol',
 'id': '8bacae09-2669-50ba-b443-a8bbf546c428',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW15562',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 104004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2014}
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW15562%27 HTTP/1.1" 200 None
2026-03-30 07:45:20 [auto1.de] INFO: Saving data for RW15562: {'auction_closing_time': 1774884593.0, 'created_time': 1773307709.762617, 'last_price_update_time': 1774856720.444567}
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RW15562') HTTP/1.1" 204 0
2026-03-30 07:45:20 [auto1.de] INFO: Found listing with ID: NZ56847
2026-03-30 07:45:20 [auto1.de] INFO: Found listing with ID: RX78889
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78889%27 HTTP/1.1" 200 None
2026-03-30 07:45:20 [auto1.de] INFO: Scrape type for RX78889: 2
2026-03-30 07:45:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cecb328-01e5-5494-9508-ba161b7b0f76 with identifier: RX78889
2026-03-30 07:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cecb328-01e5-5494-9508-ba161b7b0f76 with scrape type 2
2026-03-30 07:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cecb328-01e5-5494-9508-ba161b7b0f76 with scrape type 2
2026-03-30 07:45:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0cecb328-01e5-5494-9508-ba161b7b0f76, identifier: RX78889
2026-03-30 07:45:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0cecb328-01e5-5494-9508-ba161b7b0f76 with identifier: RX78889
2026-03-30 07:45:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0cecb328-01e5-5494-9508-ba161b7b0f76 with identifier: RX78889
2026-03-30 07:45:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0cecb328-01e5-5494-9508-ba161b7b0f76 with identifier: RX78889 to the API
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:30:43Z',
 'fuel_type': 'diesel',
 'id': '0cecb328-01e5-5494-9508-ba161b7b0f76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX78889',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C6',
 'odometer': 189396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-01-20',
 'seller_name': None,
 'title': 'Citroen C6 2.7 V6 HDi Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2008}
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX78889%27 HTTP/1.1" 200 None
2026-03-30 07:45:20 [auto1.de] INFO: Saving data for RX78889: {'auction_closing_time': 1774884643.0, 'created_time': 1774550739.545257, 'last_price_update_time': 1774856720.854614}
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX78889') HTTP/1.1" 204 0
2026-03-30 07:45:20 [auto1.de] INFO: Found listing with ID: AV32823
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV32823%27 HTTP/1.1" 200 None
2026-03-30 07:45:20 [auto1.de] INFO: Scrape type for AV32823: 0
2026-03-30 07:45:20 [auto1.de] INFO: Found listing with ID: VS80969
2026-03-30 07:45:20 [auto1.de] INFO: Found listing with ID: FB42809
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB42809%27 HTTP/1.1" 200 None
2026-03-30 07:45:20 [auto1.de] INFO: Scrape type for FB42809: 2
2026-03-30 07:45:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5fd4966f-237a-511c-b7dc-844ea7522f81 with identifier: FB42809
2026-03-30 07:45:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5fd4966f-237a-511c-b7dc-844ea7522f81 with scrape type 2
2026-03-30 07:45:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5fd4966f-237a-511c-b7dc-844ea7522f81 with scrape type 2
2026-03-30 07:45:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5fd4966f-237a-511c-b7dc-844ea7522f81, identifier: FB42809
2026-03-30 07:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5fd4966f-237a-511c-b7dc-844ea7522f81 with identifier: FB42809
2026-03-30 07:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5fd4966f-237a-511c-b7dc-844ea7522f81 with identifier: FB42809
2026-03-30 07:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5fd4966f-237a-511c-b7dc-844ea7522f81 with identifier: FB42809 to the API
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:11:51Z',
 'fuel_type': 'diesel',
 'id': '5fd4966f-237a-511c-b7dc-844ea7522f81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB42809',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 193817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-20',
 'seller_name': None,
 'title': 'BMW 4er 420d Gran Coupé Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2016}
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB42809%27 HTTP/1.1" 200 None
2026-03-30 07:45:21 [auto1.de] INFO: Saving data for FB42809: {'auction_closing_time': 1774883511.0, 'created_time': 1774639642.127237, 'last_price_update_time': 1774856721.311825}
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB42809') HTTP/1.1" 204 0
2026-03-30 07:45:21 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-30 07:45:21 [auto1.de] INFO: Scrape type for YT12990: 0
2026-03-30 07:45:21 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD28346%27 HTTP/1.1" 200 None
2026-03-30 07:45:21 [auto1.de] INFO: Scrape type for DD28346: 2
2026-03-30 07:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbfb717b-6fea-57d4-8930-327e953a7cfd with identifier: DD28346
2026-03-30 07:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbfb717b-6fea-57d4-8930-327e953a7cfd with scrape type 2
2026-03-30 07:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbfb717b-6fea-57d4-8930-327e953a7cfd with scrape type 2
2026-03-30 07:45:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbfb717b-6fea-57d4-8930-327e953a7cfd, identifier: DD28346
2026-03-30 07:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbfb717b-6fea-57d4-8930-327e953a7cfd with identifier: DD28346
2026-03-30 07:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbfb717b-6fea-57d4-8930-327e953a7cfd with identifier: DD28346
2026-03-30 07:45:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbfb717b-6fea-57d4-8930-327e953a7cfd with identifier: DD28346 to the API
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:28:21Z',
 'fuel_type': 'diesel',
 'id': 'fbfb717b-6fea-57d4-8930-327e953a7cfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD28346',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka',
 'odometer': 94350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-16',
 'seller_name': None,
 'title': 'Opel Mokka 1.6 CDTI DPF Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2015}
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD28346%27 HTTP/1.1" 200 None
2026-03-30 07:45:21 [auto1.de] INFO: Saving data for DD28346: {'auction_closing_time': 1774884501.0, 'created_time': 1774350276.47139, 'last_price_update_time': 1774856721.814322}
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DD28346') HTTP/1.1" 204 0
2026-03-30 07:45:21 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT59111%27 HTTP/1.1" 200 None
2026-03-30 07:45:21 [auto1.de] INFO: Scrape type for MT59111: 2
2026-03-30 07:45:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fedb076-2f34-58c3-8ce0-690f0857368d with identifier: MT59111
2026-03-30 07:45:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fedb076-2f34-58c3-8ce0-690f0857368d with scrape type 2
2026-03-30 07:45:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fedb076-2f34-58c3-8ce0-690f0857368d with scrape type 2
2026-03-30 07:45:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fedb076-2f34-58c3-8ce0-690f0857368d, identifier: MT59111
2026-03-30 07:45:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fedb076-2f34-58c3-8ce0-690f0857368d with identifier: MT59111
2026-03-30 07:45:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fedb076-2f34-58c3-8ce0-690f0857368d with identifier: MT59111
2026-03-30 07:45:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fedb076-2f34-58c3-8ce0-690f0857368d with identifier: MT59111 to the API
2026-03-30 07:45:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:52:45Z',
 'fuel_type': 'diesel',
 'id': '8fedb076-2f34-58c3-8ce0-690f0857368d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT59111',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 296218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-13',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2015}
2026-03-30 07:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT59111%27 HTTP/1.1" 200 None
2026-03-30 07:45:22 [auto1.de] INFO: Saving data for MT59111: {'auction_closing_time': 1774885965.0, 'created_time': 1773946805.151834, 'last_price_update_time': 1774856722.357888}
2026-03-30 07:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT59111') HTTP/1.1" 204 0
2026-03-30 07:45:22 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-30 07:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-30 07:45:22 [auto1.de] INFO: Scrape type for WU34060: 0
2026-03-30 07:45:22 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-30 07:45:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:23 [auto1.de] INFO: Channel: 24h | Page: 110 | totalHits: 8341 | hits on page: 40
2026-03-30 07:45:23 [auto1.de] INFO: Found listing with ID: YT12990
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT12990%27 HTTP/1.1" 200 None
2026-03-30 07:45:23 [auto1.de] INFO: Scrape type for YT12990: 0
2026-03-30 07:45:23 [auto1.de] INFO: Found listing with ID: DD28346
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD28346%27 HTTP/1.1" 200 None
2026-03-30 07:45:23 [auto1.de] INFO: Scrape type for DD28346: 0
2026-03-30 07:45:23 [auto1.de] INFO: Found listing with ID: MT59111
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT59111%27 HTTP/1.1" 200 None
2026-03-30 07:45:23 [auto1.de] INFO: Scrape type for MT59111: 0
2026-03-30 07:45:23 [auto1.de] INFO: Found listing with ID: WU34060
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU34060%27 HTTP/1.1" 200 None
2026-03-30 07:45:23 [auto1.de] INFO: Scrape type for WU34060: 0
2026-03-30 07:45:23 [auto1.de] INFO: Found listing with ID: GE37655
2026-03-30 07:45:23 [auto1.de] INFO: Found listing with ID: HV33102
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV33102%27 HTTP/1.1" 200 None
2026-03-30 07:45:23 [auto1.de] INFO: Scrape type for HV33102: 2
2026-03-30 07:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48227bdb-6ca0-554c-a3e3-9748981abb60 with identifier: HV33102
2026-03-30 07:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48227bdb-6ca0-554c-a3e3-9748981abb60 with scrape type 2
2026-03-30 07:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48227bdb-6ca0-554c-a3e3-9748981abb60 with scrape type 2
2026-03-30 07:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48227bdb-6ca0-554c-a3e3-9748981abb60, identifier: HV33102
2026-03-30 07:45:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48227bdb-6ca0-554c-a3e3-9748981abb60 with identifier: HV33102
2026-03-30 07:45:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48227bdb-6ca0-554c-a3e3-9748981abb60 with identifier: HV33102
2026-03-30 07:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48227bdb-6ca0-554c-a3e3-9748981abb60 with identifier: HV33102 to the API
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 197,
 'expiration_date': '2026-03-30T15:26:01Z',
 'fuel_type': 'petrol',
 'id': '48227bdb-6ca0-554c-a3e3-9748981abb60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV33102',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 47866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-19',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B4 Mild-Hybrid Inscription 2WD',
 'transmission': 'automatic',
 'trim': 'Inscription 2WD',
 'year': 2022}
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV33102%27 HTTP/1.1" 200 None
2026-03-30 07:45:23 [auto1.de] INFO: Saving data for HV33102: {'auction_closing_time': 1774884361.0, 'created_time': 1773307683.992316, 'last_price_update_time': 1774856723.62782}
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV33102') HTTP/1.1" 204 0
2026-03-30 07:45:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:23 [auto1.de] INFO: Found listing with ID: VX14305
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX14305%27 HTTP/1.1" 200 None
2026-03-30 07:45:23 [auto1.de] INFO: Scrape type for VX14305: 0
2026-03-30 07:45:23 [auto1.de] INFO: Found listing with ID: LS36397
2026-03-30 07:45:23 [auto1.de] INFO: Found listing with ID: VZ15565
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ15565%27 HTTP/1.1" 200 None
2026-03-30 07:45:23 [auto1.de] INFO: Scrape type for VZ15565: 0
2026-03-30 07:45:23 [auto1.de] INFO: Found listing with ID: NV00892
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV00892%27 HTTP/1.1" 200 None
2026-03-30 07:45:23 [auto1.de] INFO: Scrape type for NV00892: 2
2026-03-30 07:45:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5ddf365-3f62-50d9-aa10-70d604d12fcd with identifier: NV00892
2026-03-30 07:45:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5ddf365-3f62-50d9-aa10-70d604d12fcd with scrape type 2
2026-03-30 07:45:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5ddf365-3f62-50d9-aa10-70d604d12fcd with scrape type 2
2026-03-30 07:45:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e5ddf365-3f62-50d9-aa10-70d604d12fcd, identifier: NV00892
2026-03-30 07:45:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e5ddf365-3f62-50d9-aa10-70d604d12fcd with identifier: NV00892
2026-03-30 07:45:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e5ddf365-3f62-50d9-aa10-70d604d12fcd with identifier: NV00892
2026-03-30 07:45:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e5ddf365-3f62-50d9-aa10-70d604d12fcd with identifier: NV00892 to the API
2026-03-30 07:45:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:37:16Z',
 'fuel_type': 'petrol',
 'id': 'e5ddf365-3f62-50d9-aa10-70d604d12fcd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV00892',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 59880,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-25',
 'seller_name': None,
 'title': 'BMW 4er 420i Gran Coupé xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2021}
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV00892%27 HTTP/1.1" 200 None
2026-03-30 07:45:24 [auto1.de] INFO: Saving data for NV00892: {'auction_closing_time': 1774885036.0, 'created_time': 1774034074.689706, 'last_price_update_time': 1774856724.242382}
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV00892') HTTP/1.1" 204 0
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: PF67152
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: YT58518
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: RN98053
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: CV84531
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV84531%27 HTTP/1.1" 200 None
2026-03-30 07:45:24 [auto1.de] INFO: Scrape type for CV84531: 2
2026-03-30 07:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3feddba4-b8d5-585d-84c0-9897ffd93776 with identifier: CV84531
2026-03-30 07:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3feddba4-b8d5-585d-84c0-9897ffd93776 with scrape type 2
2026-03-30 07:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3feddba4-b8d5-585d-84c0-9897ffd93776 with scrape type 2
2026-03-30 07:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3feddba4-b8d5-585d-84c0-9897ffd93776, identifier: CV84531
2026-03-30 07:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3feddba4-b8d5-585d-84c0-9897ffd93776 with identifier: CV84531
2026-03-30 07:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3feddba4-b8d5-585d-84c0-9897ffd93776 with identifier: CV84531
2026-03-30 07:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3feddba4-b8d5-585d-84c0-9897ffd93776 with identifier: CV84531 to the API
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:12:27Z',
 'fuel_type': 'petrol',
 'id': '3feddba4-b8d5-585d-84c0-9897ffd93776',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV84531',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 122246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-19',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Jam',
 'transmission': 'manual',
 'trim': 'Jam',
 'year': 2015}
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV84531%27 HTTP/1.1" 200 None
2026-03-30 07:45:24 [auto1.de] INFO: Saving data for CV84531: {'auction_closing_time': 1774883547.0, 'created_time': 1774552372.083399, 'last_price_update_time': 1774856724.655306}
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV84531') HTTP/1.1" 204 0
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: CT73600
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: CK72791
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: XR25495
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: GX89038
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: MB36683
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: AK97582
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: CM72901
2026-03-30 07:45:24 [auto1.de] INFO: Found listing with ID: UF17826
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF17826%27 HTTP/1.1" 200 None
2026-03-30 07:45:24 [auto1.de] INFO: Scrape type for UF17826: 2
2026-03-30 07:45:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c1a54e9-e3ed-528f-baac-d6660855835c with identifier: UF17826
2026-03-30 07:45:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c1a54e9-e3ed-528f-baac-d6660855835c with scrape type 2
2026-03-30 07:45:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c1a54e9-e3ed-528f-baac-d6660855835c with scrape type 2
2026-03-30 07:45:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c1a54e9-e3ed-528f-baac-d6660855835c, identifier: UF17826
2026-03-30 07:45:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c1a54e9-e3ed-528f-baac-d6660855835c with identifier: UF17826
2026-03-30 07:45:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c1a54e9-e3ed-528f-baac-d6660855835c with identifier: UF17826
2026-03-30 07:45:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c1a54e9-e3ed-528f-baac-d6660855835c with identifier: UF17826 to the API
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 299,
 'expiration_date': '2026-03-30T15:48:42Z',
 'fuel_type': 'hybrid',
 'id': '6c1a54e9-e3ed-528f-baac-d6660855835c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF17826',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 62810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-21',
 'seller_name': None,
 'title': 'Audi A6 50 TFSIe quattro sport',
 'transmission': 'automatic',
 'trim': 'quattro sport',
 'year': 2021}
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF17826%27 HTTP/1.1" 200 None
2026-03-30 07:45:25 [auto1.de] INFO: Saving data for UF17826: {'auction_closing_time': 1774885722.0, 'created_time': 1773831483.057111, 'last_price_update_time': 1774856725.055059}
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF17826') HTTP/1.1" 204 0
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: RY42515
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: BX09216
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: ZS44353
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS44353%27 HTTP/1.1" 200 None
2026-03-30 07:45:25 [auto1.de] INFO: Scrape type for ZS44353: 2
2026-03-30 07:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a55434e-982d-5388-b6d4-ce0c398dbfc5 with identifier: ZS44353
2026-03-30 07:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a55434e-982d-5388-b6d4-ce0c398dbfc5 with scrape type 2
2026-03-30 07:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a55434e-982d-5388-b6d4-ce0c398dbfc5 with scrape type 2
2026-03-30 07:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a55434e-982d-5388-b6d4-ce0c398dbfc5, identifier: ZS44353
2026-03-30 07:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a55434e-982d-5388-b6d4-ce0c398dbfc5 with identifier: ZS44353
2026-03-30 07:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a55434e-982d-5388-b6d4-ce0c398dbfc5 with identifier: ZS44353
2026-03-30 07:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a55434e-982d-5388-b6d4-ce0c398dbfc5 with identifier: ZS44353 to the API
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:02:27Z',
 'fuel_type': 'diesel',
 'id': '6a55434e-982d-5388-b6d4-ce0c398dbfc5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS44353',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 140232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2018}
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS44353%27 HTTP/1.1" 200 None
2026-03-30 07:45:25 [auto1.de] INFO: Saving data for ZS44353: {'auction_closing_time': 1774882947.0, 'created_time': 1774637283.912142, 'last_price_update_time': 1774856725.541964}
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS44353') HTTP/1.1" 204 0
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: KW79987
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: ZY07029
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY07029%27 HTTP/1.1" 200 None
2026-03-30 07:45:25 [auto1.de] INFO: Scrape type for ZY07029: 0
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: KA83953
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA83953%27 HTTP/1.1" 200 None
2026-03-30 07:45:25 [auto1.de] INFO: Scrape type for KA83953: 0
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: XD89320
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD89320%27 HTTP/1.1" 200 None
2026-03-30 07:45:25 [auto1.de] INFO: Scrape type for XD89320: 0
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: EV39961
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: SC48990
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: XA52388
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA52388%27 HTTP/1.1" 200 None
2026-03-30 07:45:25 [auto1.de] INFO: Scrape type for XA52388: 0
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: ZF45936
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: GK14526
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: MW62166
2026-03-30 07:45:25 [auto1.de] INFO: Found listing with ID: NB97805
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB97805%27 HTTP/1.1" 200 None
2026-03-30 07:45:25 [auto1.de] INFO: Scrape type for NB97805: 2
2026-03-30 07:45:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cef8387-d48c-5a25-a634-20e8b1fc131b with identifier: NB97805
2026-03-30 07:45:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cef8387-d48c-5a25-a634-20e8b1fc131b with scrape type 2
2026-03-30 07:45:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cef8387-d48c-5a25-a634-20e8b1fc131b with scrape type 2
2026-03-30 07:45:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6cef8387-d48c-5a25-a634-20e8b1fc131b, identifier: NB97805
2026-03-30 07:45:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6cef8387-d48c-5a25-a634-20e8b1fc131b with identifier: NB97805
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-30 07:45:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-30 07:45:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6cef8387-d48c-5a25-a634-20e8b1fc131b with identifier: NB97805
2026-03-30 07:45:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6cef8387-d48c-5a25-a634-20e8b1fc131b with identifier: NB97805 to the API
2026-03-30 07:45:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gold',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:26:36Z',
 'fuel_type': 'petrol',
 'id': '6cef8387-d48c-5a25-a634-20e8b1fc131b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB97805',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 84291,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-06-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.6 1st Ghia',
 'transmission': 'manual',
 'trim': '1st Ghia',
 'year': 2002}
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB97805%27 HTTP/1.1" 200 None
2026-03-30 07:45:26 [auto1.de] INFO: Saving data for NB97805: {'auction_closing_time': 1774884396.0, 'created_time': 1774035341.225435, 'last_price_update_time': 1774856726.155911}
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB97805') HTTP/1.1" 204 0
2026-03-30 07:45:26 [auto1.de] INFO: Found listing with ID: AA38517
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38517%27 HTTP/1.1" 200 None
2026-03-30 07:45:26 [auto1.de] INFO: Scrape type for AA38517: 2
2026-03-30 07:45:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e34fcb9-e063-5787-9fae-5f148cc60365 with identifier: AA38517
2026-03-30 07:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e34fcb9-e063-5787-9fae-5f148cc60365 with scrape type 2
2026-03-30 07:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e34fcb9-e063-5787-9fae-5f148cc60365 with scrape type 2
2026-03-30 07:45:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e34fcb9-e063-5787-9fae-5f148cc60365, identifier: AA38517
2026-03-30 07:45:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e34fcb9-e063-5787-9fae-5f148cc60365 with identifier: AA38517
2026-03-30 07:45:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e34fcb9-e063-5787-9fae-5f148cc60365 with identifier: AA38517
2026-03-30 07:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e34fcb9-e063-5787-9fae-5f148cc60365 with identifier: AA38517 to the API
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:33:20Z',
 'fuel_type': 'diesel',
 'id': '9e34fcb9-e063-5787-9fae-5f148cc60365',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA38517',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 219132,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-28',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2006}
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA38517%27 HTTP/1.1" 200 None
2026-03-30 07:45:26 [auto1.de] INFO: Saving data for AA38517: {'auction_closing_time': 1774884800.0, 'created_time': 1774638740.45466, 'last_price_update_time': 1774856726.648267}
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA38517') HTTP/1.1" 204 0
2026-03-30 07:45:26 [auto1.de] INFO: Found listing with ID: BZ60217
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ60217%27 HTTP/1.1" 200 None
2026-03-30 07:45:26 [auto1.de] INFO: Scrape type for BZ60217: 2
2026-03-30 07:45:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1ce36b1-413f-576f-bb78-fb5155d23546 with identifier: BZ60217
2026-03-30 07:45:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1ce36b1-413f-576f-bb78-fb5155d23546 with scrape type 2
2026-03-30 07:45:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1ce36b1-413f-576f-bb78-fb5155d23546 with scrape type 2
2026-03-30 07:45:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1ce36b1-413f-576f-bb78-fb5155d23546, identifier: BZ60217
2026-03-30 07:45:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1ce36b1-413f-576f-bb78-fb5155d23546 with identifier: BZ60217
2026-03-30 07:45:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1ce36b1-413f-576f-bb78-fb5155d23546 with identifier: BZ60217
2026-03-30 07:45:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1ce36b1-413f-576f-bb78-fb5155d23546 with identifier: BZ60217 to the API
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:17:50Z',
 'fuel_type': 'petrol',
 'id': 'c1ce36b1-413f-576f-bb78-fb5155d23546',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ60217',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 30915,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-11',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Turbo Business Elegance Start/Stop',
 'transmission': 'automatic',
 'trim': 'Business Elegance Start/Stop',
 'year': 2022}
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ60217%27 HTTP/1.1" 200 None
2026-03-30 07:45:27 [auto1.de] INFO: Saving data for BZ60217: {'auction_closing_time': 1774883870.0, 'created_time': 1773307296.541978, 'last_price_update_time': 1774856727.056449}
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ60217') HTTP/1.1" 204 0
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: TP70009
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-30 07:45:27 [auto1.de] INFO: Scrape type for LN58071: 0
2026-03-30 07:45:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:27 [auto1.de] INFO: Channel: 24h | Page: 111 | totalHits: 8342 | hits on page: 40
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: LN58071
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN58071%27 HTTP/1.1" 200 None
2026-03-30 07:45:27 [auto1.de] INFO: Scrape type for LN58071: 0
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: VY10701
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: SC45462
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: DJ74169
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: AF42457
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: DZ52896
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: BD46064
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD46064%27 HTTP/1.1" 200 None
2026-03-30 07:45:27 [auto1.de] INFO: Scrape type for BD46064: 2
2026-03-30 07:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 608fbea5-8d38-55b1-98ec-5265ad0ebe06 with identifier: BD46064
2026-03-30 07:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 608fbea5-8d38-55b1-98ec-5265ad0ebe06 with scrape type 2
2026-03-30 07:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 608fbea5-8d38-55b1-98ec-5265ad0ebe06 with scrape type 2
2026-03-30 07:45:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 608fbea5-8d38-55b1-98ec-5265ad0ebe06, identifier: BD46064
2026-03-30 07:45:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 608fbea5-8d38-55b1-98ec-5265ad0ebe06 with identifier: BD46064
2026-03-30 07:45:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 608fbea5-8d38-55b1-98ec-5265ad0ebe06 with identifier: BD46064
2026-03-30 07:45:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 608fbea5-8d38-55b1-98ec-5265ad0ebe06 with identifier: BD46064 to the API
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:33:51Z',
 'fuel_type': 'petrol',
 'id': '608fbea5-8d38-55b1-98ec-5265ad0ebe06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD46064',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Courier',
 'odometer': 5726,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-07-29',
 'seller_name': None,
 'title': 'Ford Tourneo Courier 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2025}
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD46064%27 HTTP/1.1" 200 None
2026-03-30 07:45:27 [auto1.de] INFO: Saving data for BD46064: {'auction_closing_time': 1774884831.0, 'created_time': 1774639618.921881, 'last_price_update_time': 1774856727.76952}
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BD46064') HTTP/1.1" 204 0
2026-03-30 07:45:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: AD28287
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: NL59823
2026-03-30 07:45:27 [auto1.de] INFO: Found listing with ID: JP54184
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54184%27 HTTP/1.1" 200 None
2026-03-30 07:45:27 [auto1.de] INFO: Scrape type for JP54184: 2
2026-03-30 07:45:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e411b841-168c-5ed6-84cc-e84ecfdba6fe with identifier: JP54184
2026-03-30 07:45:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e411b841-168c-5ed6-84cc-e84ecfdba6fe with scrape type 2
2026-03-30 07:45:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e411b841-168c-5ed6-84cc-e84ecfdba6fe with scrape type 2
2026-03-30 07:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e411b841-168c-5ed6-84cc-e84ecfdba6fe, identifier: JP54184
2026-03-30 07:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e411b841-168c-5ed6-84cc-e84ecfdba6fe with identifier: JP54184
2026-03-30 07:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e411b841-168c-5ed6-84cc-e84ecfdba6fe with identifier: JP54184
2026-03-30 07:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e411b841-168c-5ed6-84cc-e84ecfdba6fe with identifier: JP54184 to the API
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:03:37Z',
 'fuel_type': 'diesel',
 'id': 'e411b841-168c-5ed6-84cc-e84ecfdba6fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP54184',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60 Cross Country',
 'odometer': 118230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-16',
 'seller_name': None,
 'title': 'Volvo S60 Cross Country 2.0 D4 Summum',
 'transmission': 'automatic',
 'trim': 'Summum',
 'year': 2015}
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54184%27 HTTP/1.1" 200 None
2026-03-30 07:45:28 [auto1.de] INFO: Saving data for JP54184: {'auction_closing_time': 1774883017.0, 'created_time': 1773831519.46606, 'last_price_update_time': 1774856728.285489}
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP54184') HTTP/1.1" 204 0
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: FY25163
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: AW80903
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80903%27 HTTP/1.1" 200 None
2026-03-30 07:45:28 [auto1.de] INFO: Scrape type for AW80903: 0
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: SC26693
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: FB84476
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB84476%27 HTTP/1.1" 200 None
2026-03-30 07:45:28 [auto1.de] INFO: Scrape type for FB84476: 0
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: TN14580
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: NG89372
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG89372%27 HTTP/1.1" 200 None
2026-03-30 07:45:28 [auto1.de] INFO: Scrape type for NG89372: 2
2026-03-30 07:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2032200-e758-557c-8027-697441036d14 with identifier: NG89372
2026-03-30 07:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2032200-e758-557c-8027-697441036d14 with scrape type 2
2026-03-30 07:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2032200-e758-557c-8027-697441036d14 with scrape type 2
2026-03-30 07:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2032200-e758-557c-8027-697441036d14, identifier: NG89372
2026-03-30 07:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2032200-e758-557c-8027-697441036d14 with identifier: NG89372
2026-03-30 07:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2032200-e758-557c-8027-697441036d14 with identifier: NG89372
2026-03-30 07:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2032200-e758-557c-8027-697441036d14 with identifier: NG89372 to the API
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:18:50Z',
 'fuel_type': 'petrol',
 'id': 'd2032200-e758-557c-8027-697441036d14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG89372',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 75603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-29',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2019}
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG89372%27 HTTP/1.1" 200 None
2026-03-30 07:45:28 [auto1.de] INFO: Saving data for NG89372: {'auction_closing_time': 1774883930.0, 'created_time': 1774636767.56003, 'last_price_update_time': 1774856728.721607}
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG89372') HTTP/1.1" 204 0
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: PY44699
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: AR53020
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: VZ83010
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ83010%27 HTTP/1.1" 200 None
2026-03-30 07:45:28 [auto1.de] INFO: Scrape type for VZ83010: 0
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: GB74339
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: CK11382
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK11382%27 HTTP/1.1" 200 None
2026-03-30 07:45:28 [auto1.de] INFO: Scrape type for CK11382: 0
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: NG94369
2026-03-30 07:45:28 [auto1.de] INFO: Found listing with ID: MC98877
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98877%27 HTTP/1.1" 200 None
2026-03-30 07:45:28 [auto1.de] INFO: Scrape type for MC98877: 2
2026-03-30 07:45:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4efaab31-91ec-5744-8cc1-a376ba7d60fe with identifier: MC98877
2026-03-30 07:45:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4efaab31-91ec-5744-8cc1-a376ba7d60fe with scrape type 2
2026-03-30 07:45:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4efaab31-91ec-5744-8cc1-a376ba7d60fe with scrape type 2
2026-03-30 07:45:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4efaab31-91ec-5744-8cc1-a376ba7d60fe, identifier: MC98877
2026-03-30 07:45:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4efaab31-91ec-5744-8cc1-a376ba7d60fe with identifier: MC98877
2026-03-30 07:45:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4efaab31-91ec-5744-8cc1-a376ba7d60fe with identifier: MC98877
2026-03-30 07:45:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4efaab31-91ec-5744-8cc1-a376ba7d60fe with identifier: MC98877 to the API
2026-03-30 07:45:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:04:52Z',
 'fuel_type': 'petrol',
 'id': '4efaab31-91ec-5744-8cc1-a376ba7d60fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC98877',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 125280,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-12-08',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.8 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 1996}
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC98877%27 HTTP/1.1" 200 None
2026-03-30 07:45:29 [auto1.de] INFO: Saving data for MC98877: {'auction_closing_time': 1774883092.0, 'created_time': 1774639337.149463, 'last_price_update_time': 1774856729.167733}
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC98877') HTTP/1.1" 204 0
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: VN54723
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN54723%27 HTTP/1.1" 200 None
2026-03-30 07:45:29 [auto1.de] INFO: Scrape type for VN54723: 0
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: NH53597
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH53597%27 HTTP/1.1" 200 None
2026-03-30 07:45:29 [auto1.de] INFO: Scrape type for NH53597: 0
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: HG94589
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: WY91699
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: LM89812
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: MC93517
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC93517%27 HTTP/1.1" 200 None
2026-03-30 07:45:29 [auto1.de] INFO: Scrape type for MC93517: 2
2026-03-30 07:45:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbd8c61a-5d56-58c2-8a20-892d44a79a10 with identifier: MC93517
2026-03-30 07:45:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbd8c61a-5d56-58c2-8a20-892d44a79a10 with scrape type 2
2026-03-30 07:45:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbd8c61a-5d56-58c2-8a20-892d44a79a10 with scrape type 2
2026-03-30 07:45:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbd8c61a-5d56-58c2-8a20-892d44a79a10, identifier: MC93517
2026-03-30 07:45:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbd8c61a-5d56-58c2-8a20-892d44a79a10 with identifier: MC93517
2026-03-30 07:45:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbd8c61a-5d56-58c2-8a20-892d44a79a10 with identifier: MC93517
2026-03-30 07:45:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbd8c61a-5d56-58c2-8a20-892d44a79a10 with identifier: MC93517 to the API
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:18:47Z',
 'fuel_type': 'petrol',
 'id': 'bbd8c61a-5d56-58c2-8a20-892d44a79a10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC93517',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 36524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-19',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC93517%27 HTTP/1.1" 200 None
2026-03-30 07:45:29 [auto1.de] INFO: Saving data for MC93517: {'auction_closing_time': 1774883927.0, 'created_time': 1774350227.059747, 'last_price_update_time': 1774856729.768939}
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC93517') HTTP/1.1" 204 0
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: PA91230
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA91230%27 HTTP/1.1" 200 None
2026-03-30 07:45:29 [auto1.de] INFO: Scrape type for PA91230: 0
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: KM30220
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM30220%27 HTTP/1.1" 200 None
2026-03-30 07:45:29 [auto1.de] INFO: Scrape type for KM30220: 0
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: PA88457
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: LD06025
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: XN51512
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: NE52715
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: EP96455
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP96455%27 HTTP/1.1" 200 None
2026-03-30 07:45:29 [auto1.de] INFO: Scrape type for EP96455: 0
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: BB27376
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: XU64075
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: TL87064
2026-03-30 07:45:29 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-30 07:45:29 [auto1.de] INFO: Scrape type for BE80399: 0
2026-03-30 07:45:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:30 [auto1.de] INFO: Channel: 24h | Page: 112 | totalHits: 8343 | hits on page: 40
2026-03-30 07:45:30 [auto1.de] INFO: Found listing with ID: BE80399
2026-03-30 07:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE80399%27 HTTP/1.1" 200 None
2026-03-30 07:45:30 [auto1.de] INFO: Scrape type for BE80399: 0
2026-03-30 07:45:30 [auto1.de] INFO: Found listing with ID: YZ86105
2026-03-30 07:45:30 [auto1.de] INFO: Found listing with ID: BC65369
2026-03-30 07:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC65369%27 HTTP/1.1" 200 None
2026-03-30 07:45:30 [auto1.de] INFO: Scrape type for BC65369: 2
2026-03-30 07:45:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7987c6f4-3184-58f9-bbc8-7bbb7b8ab7ab with identifier: BC65369
2026-03-30 07:45:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7987c6f4-3184-58f9-bbc8-7bbb7b8ab7ab with scrape type 2
2026-03-30 07:45:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7987c6f4-3184-58f9-bbc8-7bbb7b8ab7ab with scrape type 2
2026-03-30 07:45:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7987c6f4-3184-58f9-bbc8-7bbb7b8ab7ab, identifier: BC65369
2026-03-30 07:45:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7987c6f4-3184-58f9-bbc8-7bbb7b8ab7ab with identifier: BC65369
2026-03-30 07:45:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7987c6f4-3184-58f9-bbc8-7bbb7b8ab7ab with identifier: BC65369
2026-03-30 07:45:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7987c6f4-3184-58f9-bbc8-7bbb7b8ab7ab with identifier: BC65369 to the API
2026-03-30 07:45:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:38:26Z',
 'fuel_type': 'diesel',
 'id': '7987c6f4-3184-58f9-bbc8-7bbb7b8ab7ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC65369',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 126755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-02-23',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI RS 4x4',
 'transmission': 'automatic',
 'trim': 'RS 4x4',
 'year': 2016}
2026-03-30 07:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC65369%27 HTTP/1.1" 200 None
2026-03-30 07:45:31 [auto1.de] INFO: Saving data for BC65369: {'auction_closing_time': 1774885106.0, 'created_time': 1774639857.629006, 'last_price_update_time': 1774856731.792535}
2026-03-30 07:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC65369') HTTP/1.1" 204 0
2026-03-30 07:45:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:31 [auto1.de] INFO: Found listing with ID: AR55742
2026-03-30 07:45:31 [auto1.de] INFO: Found listing with ID: VS51325
2026-03-30 07:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS51325%27 HTTP/1.1" 200 None
2026-03-30 07:45:31 [auto1.de] INFO: Scrape type for VS51325: 2
2026-03-30 07:45:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52f5c4e5-3bec-5c2d-b4fa-f0c27dbd770e with identifier: VS51325
2026-03-30 07:45:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52f5c4e5-3bec-5c2d-b4fa-f0c27dbd770e with scrape type 2
2026-03-30 07:45:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52f5c4e5-3bec-5c2d-b4fa-f0c27dbd770e with scrape type 2
2026-03-30 07:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52f5c4e5-3bec-5c2d-b4fa-f0c27dbd770e, identifier: VS51325
2026-03-30 07:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52f5c4e5-3bec-5c2d-b4fa-f0c27dbd770e with identifier: VS51325
2026-03-30 07:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52f5c4e5-3bec-5c2d-b4fa-f0c27dbd770e with identifier: VS51325
2026-03-30 07:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52f5c4e5-3bec-5c2d-b4fa-f0c27dbd770e with identifier: VS51325 to the API
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 111,
 'expiration_date': '2026-03-30T15:07:21Z',
 'fuel_type': 'petrol',
 'id': '52f5c4e5-3bec-5c2d-b4fa-f0c27dbd770e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS51325',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Vitara',
 'odometer': 145673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': None,
 'title': 'Suzuki Vitara 1.0 BoosterJet Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2019}
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS51325%27 HTTP/1.1" 200 None
2026-03-30 07:45:32 [auto1.de] INFO: Saving data for VS51325: {'auction_closing_time': 1774883241.0, 'created_time': 1773380716.075241, 'last_price_update_time': 1774856732.317903}
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS51325') HTTP/1.1" 204 0
2026-03-30 07:45:32 [auto1.de] INFO: Found listing with ID: BK59777
2026-03-30 07:45:32 [auto1.de] INFO: Found listing with ID: HP91359
2026-03-30 07:45:32 [auto1.de] INFO: Found listing with ID: VF41212
2026-03-30 07:45:32 [auto1.de] INFO: Found listing with ID: SM38981
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM38981%27 HTTP/1.1" 200 None
2026-03-30 07:45:32 [auto1.de] INFO: Scrape type for SM38981: 2
2026-03-30 07:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f4e88ea-1320-56d5-ab18-2178498f3c4a with identifier: SM38981
2026-03-30 07:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f4e88ea-1320-56d5-ab18-2178498f3c4a with scrape type 2
2026-03-30 07:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f4e88ea-1320-56d5-ab18-2178498f3c4a with scrape type 2
2026-03-30 07:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f4e88ea-1320-56d5-ab18-2178498f3c4a, identifier: SM38981
2026-03-30 07:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f4e88ea-1320-56d5-ab18-2178498f3c4a with identifier: SM38981
2026-03-30 07:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f4e88ea-1320-56d5-ab18-2178498f3c4a with identifier: SM38981
2026-03-30 07:45:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f4e88ea-1320-56d5-ab18-2178498f3c4a with identifier: SM38981 to the API
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-30T15:12:01Z',
 'fuel_type': 'diesel',
 'id': '1f4e88ea-1320-56d5-ab18-2178498f3c4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM38981',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 235403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro Sport selection',
 'transmission': 'automatic',
 'trim': 'quattro Sport selection',
 'year': 2012}
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM38981%27 HTTP/1.1" 200 None
2026-03-30 07:45:32 [auto1.de] INFO: Saving data for SM38981: {'auction_closing_time': 1774883521.0, 'created_time': 1774349997.16183, 'last_price_update_time': 1774856732.762092}
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM38981') HTTP/1.1" 204 0
2026-03-30 07:45:32 [auto1.de] INFO: Found listing with ID: HF06660
2026-03-30 07:45:32 [auto1.de] INFO: Found listing with ID: CM37211
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM37211%27 HTTP/1.1" 200 None
2026-03-30 07:45:32 [auto1.de] INFO: Scrape type for CM37211: 2
2026-03-30 07:45:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 667846d2-21a2-5c95-a8c8-765fc293051c with identifier: CM37211
2026-03-30 07:45:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 667846d2-21a2-5c95-a8c8-765fc293051c with scrape type 2
2026-03-30 07:45:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 667846d2-21a2-5c95-a8c8-765fc293051c with scrape type 2
2026-03-30 07:45:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 667846d2-21a2-5c95-a8c8-765fc293051c, identifier: CM37211
2026-03-30 07:45:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 667846d2-21a2-5c95-a8c8-765fc293051c with identifier: CM37211
2026-03-30 07:45:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 667846d2-21a2-5c95-a8c8-765fc293051c with identifier: CM37211
2026-03-30 07:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 667846d2-21a2-5c95-a8c8-765fc293051c with identifier: CM37211 to the API
2026-03-30 07:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:14:24Z',
 'fuel_type': 'petrol',
 'id': '667846d2-21a2-5c95-a8c8-765fc293051c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM37211',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 59777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-21',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 07:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM37211%27 HTTP/1.1" 200 None
2026-03-30 07:45:33 [auto1.de] INFO: Saving data for CM37211: {'auction_closing_time': 1774883664.0, 'created_time': 1773917361.646168, 'last_price_update_time': 1774856733.199051}
2026-03-30 07:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM37211') HTTP/1.1" 204 0
2026-03-30 07:45:33 [auto1.de] INFO: Found listing with ID: AM68343
2026-03-30 07:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM68343%27 HTTP/1.1" 200 None
2026-03-30 07:45:33 [auto1.de] INFO: Scrape type for AM68343: 2
2026-03-30 07:45:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55da8eec-858e-5784-b49f-0478b7c2e1f7 with identifier: AM68343
2026-03-30 07:45:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55da8eec-858e-5784-b49f-0478b7c2e1f7 with scrape type 2
2026-03-30 07:45:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55da8eec-858e-5784-b49f-0478b7c2e1f7 with scrape type 2
2026-03-30 07:45:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55da8eec-858e-5784-b49f-0478b7c2e1f7, identifier: AM68343
2026-03-30 07:45:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55da8eec-858e-5784-b49f-0478b7c2e1f7 with identifier: AM68343
2026-03-30 07:45:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55da8eec-858e-5784-b49f-0478b7c2e1f7 with identifier: AM68343
2026-03-30 07:45:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55da8eec-858e-5784-b49f-0478b7c2e1f7 with identifier: AM68343 to the API
2026-03-30 07:45:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:44:06Z',
 'fuel_type': 'petrol',
 'id': '55da8eec-858e-5784-b49f-0478b7c2e1f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM68343',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 161070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM68343%27 HTTP/1.1" 200 None
2026-03-30 07:45:34 [auto1.de] INFO: Saving data for AM68343: {'auction_closing_time': 1774885446.0, 'created_time': 1774639473.414336, 'last_price_update_time': 1774856734.087894}
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM68343') HTTP/1.1" 204 0
2026-03-30 07:45:34 [auto1.de] INFO: Found listing with ID: ZK10618
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK10618%27 HTTP/1.1" 200 None
2026-03-30 07:45:34 [auto1.de] INFO: Scrape type for ZK10618: 2
2026-03-30 07:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fefb1c9b-020c-55b0-a841-7edda4e84408 with identifier: ZK10618
2026-03-30 07:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fefb1c9b-020c-55b0-a841-7edda4e84408 with scrape type 2
2026-03-30 07:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fefb1c9b-020c-55b0-a841-7edda4e84408 with scrape type 2
2026-03-30 07:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fefb1c9b-020c-55b0-a841-7edda4e84408, identifier: ZK10618
2026-03-30 07:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fefb1c9b-020c-55b0-a841-7edda4e84408 with identifier: ZK10618
2026-03-30 07:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fefb1c9b-020c-55b0-a841-7edda4e84408 with identifier: ZK10618
2026-03-30 07:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fefb1c9b-020c-55b0-a841-7edda4e84408 with identifier: ZK10618 to the API
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:10:04Z',
 'fuel_type': 'diesel',
 'id': 'fefb1c9b-020c-55b0-a841-7edda4e84408',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK10618',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 180622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-06',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Ambition-A 4x4',
 'transmission': 'manual',
 'trim': 'Ambition-A 4x4',
 'year': 2011}
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK10618%27 HTTP/1.1" 200 None
2026-03-30 07:45:34 [auto1.de] INFO: Saving data for ZK10618: {'auction_closing_time': 1774883404.0, 'created_time': 1774552829.168627, 'last_price_update_time': 1774856734.6089}
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK10618') HTTP/1.1" 204 0
2026-03-30 07:45:34 [auto1.de] INFO: Found listing with ID: WD52714
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD52714%27 HTTP/1.1" 200 None
2026-03-30 07:45:34 [auto1.de] INFO: Scrape type for WD52714: 0
2026-03-30 07:45:34 [auto1.de] INFO: Found listing with ID: PS74193
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS74193%27 HTTP/1.1" 200 None
2026-03-30 07:45:34 [auto1.de] INFO: Scrape type for PS74193: 0
2026-03-30 07:45:34 [auto1.de] INFO: Found listing with ID: JE50334
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE50334%27 HTTP/1.1" 200 None
2026-03-30 07:45:34 [auto1.de] INFO: Scrape type for JE50334: 2
2026-03-30 07:45:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3ff9c6-8536-5f14-836f-d772e5fc3a21 with identifier: JE50334
2026-03-30 07:45:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3ff9c6-8536-5f14-836f-d772e5fc3a21 with scrape type 2
2026-03-30 07:45:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e3ff9c6-8536-5f14-836f-d772e5fc3a21 with scrape type 2
2026-03-30 07:45:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e3ff9c6-8536-5f14-836f-d772e5fc3a21, identifier: JE50334
2026-03-30 07:45:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e3ff9c6-8536-5f14-836f-d772e5fc3a21 with identifier: JE50334
2026-03-30 07:45:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e3ff9c6-8536-5f14-836f-d772e5fc3a21 with identifier: JE50334
2026-03-30 07:45:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e3ff9c6-8536-5f14-836f-d772e5fc3a21 with identifier: JE50334 to the API
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:47:48Z',
 'fuel_type': 'diesel',
 'id': '0e3ff9c6-8536-5f14-836f-d772e5fc3a21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE50334',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 75517,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline FWD',
 'transmission': 'manual',
 'trim': 'Trendline FWD',
 'year': 2021}
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE50334%27 HTTP/1.1" 200 None
2026-03-30 07:45:35 [auto1.de] INFO: Saving data for JE50334: {'auction_closing_time': 1774885668.0, 'created_time': 1773559875.393138, 'last_price_update_time': 1774856735.108101}
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE50334') HTTP/1.1" 204 0
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: WY19584
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: YA26169
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA26169%27 HTTP/1.1" 200 None
2026-03-30 07:45:35 [auto1.de] INFO: Scrape type for YA26169: 0
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: CT00605
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: NX98723
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX98723%27 HTTP/1.1" 200 None
2026-03-30 07:45:35 [auto1.de] INFO: Scrape type for NX98723: 0
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: WG93130
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: XN16480
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN16480%27 HTTP/1.1" 200 None
2026-03-30 07:45:35 [auto1.de] INFO: Scrape type for XN16480: 0
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: VY28868
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY28868%27 HTTP/1.1" 200 None
2026-03-30 07:45:35 [auto1.de] INFO: Scrape type for VY28868: 0
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: DE97424
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE97424%27 HTTP/1.1" 200 None
2026-03-30 07:45:35 [auto1.de] INFO: Scrape type for DE97424: 0
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: PZ11168
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: EN50331
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: CD67065
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD67065%27 HTTP/1.1" 200 None
2026-03-30 07:45:35 [auto1.de] INFO: Scrape type for CD67065: 2
2026-03-30 07:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2663f199-c275-57da-b6f4-e22dbd37ef95 with identifier: CD67065
2026-03-30 07:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2663f199-c275-57da-b6f4-e22dbd37ef95 with scrape type 2
2026-03-30 07:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2663f199-c275-57da-b6f4-e22dbd37ef95 with scrape type 2
2026-03-30 07:45:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2663f199-c275-57da-b6f4-e22dbd37ef95, identifier: CD67065
2026-03-30 07:45:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2663f199-c275-57da-b6f4-e22dbd37ef95 with identifier: CD67065
2026-03-30 07:45:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2663f199-c275-57da-b6f4-e22dbd37ef95 with identifier: CD67065
2026-03-30 07:45:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2663f199-c275-57da-b6f4-e22dbd37ef95 with identifier: CD67065 to the API
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:25:24Z',
 'fuel_type': 'diesel',
 'id': '2663f199-c275-57da-b6f4-e22dbd37ef95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD67065',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 269188,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-11',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD67065%27 HTTP/1.1" 200 None
2026-03-30 07:45:35 [auto1.de] INFO: Saving data for CD67065: {'auction_closing_time': 1774884324.0, 'created_time': 1773381634.135908, 'last_price_update_time': 1774856735.851353}
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD67065') HTTP/1.1" 204 0
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: WE44185
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: NF30454
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: SL27608
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: ZG00412
2026-03-30 07:45:35 [auto1.de] INFO: Found listing with ID: BW78905
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW78905%27 HTTP/1.1" 200 None
2026-03-30 07:45:35 [auto1.de] INFO: Scrape type for BW78905: 2
2026-03-30 07:45:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 170ce003-a885-5931-91f2-6df474012271 with identifier: BW78905
2026-03-30 07:45:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 170ce003-a885-5931-91f2-6df474012271 with scrape type 2
2026-03-30 07:45:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 170ce003-a885-5931-91f2-6df474012271 with scrape type 2
2026-03-30 07:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 170ce003-a885-5931-91f2-6df474012271, identifier: BW78905
2026-03-30 07:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 170ce003-a885-5931-91f2-6df474012271 with identifier: BW78905
2026-03-30 07:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 170ce003-a885-5931-91f2-6df474012271 with identifier: BW78905
2026-03-30 07:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 170ce003-a885-5931-91f2-6df474012271 with identifier: BW78905 to the API
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:08:59Z',
 'fuel_type': 'petrol',
 'id': '170ce003-a885-5931-91f2-6df474012271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW78905',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 87262,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-07',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Cup Sport & Style 4Motion',
 'transmission': 'automatic',
 'trim': 'Cup Sport & Style 4Motion',
 'year': 2014}
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW78905%27 HTTP/1.1" 200 None
2026-03-30 07:45:36 [auto1.de] INFO: Saving data for BW78905: {'auction_closing_time': 1774883339.0, 'created_time': 1774552829.553897, 'last_price_update_time': 1774856736.41777}
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW78905') HTTP/1.1" 204 0
2026-03-30 07:45:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:36 [auto1.de] INFO: Found listing with ID: EH58090
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH58090%27 HTTP/1.1" 200 None
2026-03-30 07:45:36 [auto1.de] INFO: Scrape type for EH58090: 2
2026-03-30 07:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f562229-eb6b-585c-a8a6-c03f48ba3270 with identifier: EH58090
2026-03-30 07:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f562229-eb6b-585c-a8a6-c03f48ba3270 with scrape type 2
2026-03-30 07:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f562229-eb6b-585c-a8a6-c03f48ba3270 with scrape type 2
2026-03-30 07:45:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f562229-eb6b-585c-a8a6-c03f48ba3270, identifier: EH58090
2026-03-30 07:45:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f562229-eb6b-585c-a8a6-c03f48ba3270 with identifier: EH58090
2026-03-30 07:45:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f562229-eb6b-585c-a8a6-c03f48ba3270 with identifier: EH58090
2026-03-30 07:45:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f562229-eb6b-585c-a8a6-c03f48ba3270 with identifier: EH58090 to the API
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:04Z',
 'fuel_type': 'diesel',
 'id': '3f562229-eb6b-585c-a8a6-c03f48ba3270',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EH58090',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 237750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-20',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2017}
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH58090%27 HTTP/1.1" 200 None
2026-03-30 07:45:36 [auto1.de] INFO: Saving data for EH58090: {'auction_closing_time': 1774884544.0, 'created_time': 1774350624.859688, 'last_price_update_time': 1774856736.862604}
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EH58090') HTTP/1.1" 204 0
2026-03-30 07:45:36 [auto1.de] INFO: Found listing with ID: JA27410
2026-03-30 07:45:36 [auto1.de] INFO: Found listing with ID: UZ37067
2026-03-30 07:45:36 [auto1.de] INFO: Found listing with ID: SS59240
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS59240%27 HTTP/1.1" 200 None
2026-03-30 07:45:36 [auto1.de] INFO: Scrape type for SS59240: 2
2026-03-30 07:45:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2955a693-3b8c-5ccd-9e66-529e53940ef8 with identifier: SS59240
2026-03-30 07:45:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2955a693-3b8c-5ccd-9e66-529e53940ef8 with scrape type 2
2026-03-30 07:45:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2955a693-3b8c-5ccd-9e66-529e53940ef8 with scrape type 2
2026-03-30 07:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2955a693-3b8c-5ccd-9e66-529e53940ef8, identifier: SS59240
2026-03-30 07:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2955a693-3b8c-5ccd-9e66-529e53940ef8 with identifier: SS59240
2026-03-30 07:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2955a693-3b8c-5ccd-9e66-529e53940ef8 with identifier: SS59240
2026-03-30 07:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2955a693-3b8c-5ccd-9e66-529e53940ef8 with identifier: SS59240 to the API
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:58:16Z',
 'fuel_type': 'petrol',
 'id': '2955a693-3b8c-5ccd-9e66-529e53940ef8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS59240',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 109041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-28',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2017}
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS59240%27 HTTP/1.1" 200 None
2026-03-30 07:45:37 [auto1.de] INFO: Saving data for SS59240: {'auction_closing_time': 1774886296.0, 'created_time': 1774552810.882736, 'last_price_update_time': 1774856737.351208}
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS59240') HTTP/1.1" 204 0
2026-03-30 07:45:37 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK46158%27 HTTP/1.1" 200 None
2026-03-30 07:45:37 [auto1.de] INFO: Scrape type for LK46158: 2
2026-03-30 07:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd6725a-78a6-510c-a61c-96d92a1b92f5 with identifier: LK46158
2026-03-30 07:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd6725a-78a6-510c-a61c-96d92a1b92f5 with scrape type 2
2026-03-30 07:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd6725a-78a6-510c-a61c-96d92a1b92f5 with scrape type 2
2026-03-30 07:45:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fd6725a-78a6-510c-a61c-96d92a1b92f5, identifier: LK46158
2026-03-30 07:45:37 [auto1.de] INFO: Channel: 24h | Page: 113 | totalHits: 8347 | hits on page: 40
2026-03-30 07:45:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fd6725a-78a6-510c-a61c-96d92a1b92f5 with identifier: LK46158
2026-03-30 07:45:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fd6725a-78a6-510c-a61c-96d92a1b92f5 with identifier: LK46158
2026-03-30 07:45:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fd6725a-78a6-510c-a61c-96d92a1b92f5 with identifier: LK46158 to the API
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-30T15:05:53Z',
 'fuel_type': 'petrol',
 'id': '3fd6725a-78a6-510c-a61c-96d92a1b92f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK46158',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 51745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-18',
 'seller_name': None,
 'title': 'BMW X3 M Competition',
 'transmission': 'automatic',
 'trim': 'BW   Competition',
 'year': 2021}
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK46158%27 HTTP/1.1" 200 None
2026-03-30 07:45:37 [auto1.de] INFO: Saving data for LK46158: {'auction_closing_time': 1774883153.0, 'created_time': 1773308077.509693, 'last_price_update_time': 1774856737.80354}
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK46158') HTTP/1.1" 204 0
2026-03-30 07:45:37 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-30 07:45:37 [auto1.de] INFO: Scrape type for LV93529: 0
2026-03-30 07:45:37 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-30 07:45:37 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-30 07:45:37 [auto1.de] INFO: Scrape type for RV26500: 0
2026-03-30 07:45:37 [auto1.de] INFO: Found listing with ID: LK46158
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK46158%27 HTTP/1.1" 200 None
2026-03-30 07:45:37 [auto1.de] INFO: Scrape type for LK46158: 0
2026-03-30 07:45:37 [auto1.de] INFO: Found listing with ID: LV93529
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV93529%27 HTTP/1.1" 200 None
2026-03-30 07:45:37 [auto1.de] INFO: Scrape type for LV93529: 0
2026-03-30 07:45:37 [auto1.de] INFO: Found listing with ID: VR34423
2026-03-30 07:45:37 [auto1.de] INFO: Found listing with ID: RV26500
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV26500%27 HTTP/1.1" 200 None
2026-03-30 07:45:37 [auto1.de] INFO: Scrape type for RV26500: 0
2026-03-30 07:45:37 [auto1.de] INFO: Found listing with ID: UK70882
2026-03-30 07:45:37 [auto1.de] INFO: Found listing with ID: UZ18000
2026-03-30 07:45:37 [auto1.de] INFO: Found listing with ID: DN02562
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN02562%27 HTTP/1.1" 200 None
2026-03-30 07:45:37 [auto1.de] INFO: Scrape type for DN02562: 2
2026-03-30 07:45:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 278739f2-90c6-54af-93fb-a5d4aa2d3edc with identifier: DN02562
2026-03-30 07:45:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 278739f2-90c6-54af-93fb-a5d4aa2d3edc with scrape type 2
2026-03-30 07:45:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 278739f2-90c6-54af-93fb-a5d4aa2d3edc with scrape type 2
2026-03-30 07:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 278739f2-90c6-54af-93fb-a5d4aa2d3edc, identifier: DN02562
2026-03-30 07:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 278739f2-90c6-54af-93fb-a5d4aa2d3edc with identifier: DN02562
2026-03-30 07:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 278739f2-90c6-54af-93fb-a5d4aa2d3edc with identifier: DN02562
2026-03-30 07:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 278739f2-90c6-54af-93fb-a5d4aa2d3edc with identifier: DN02562 to the API
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:08:05Z',
 'fuel_type': 'diesel',
 'id': '278739f2-90c6-54af-93fb-a5d4aa2d3edc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN02562',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 177783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d Mild-Hybrid T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2022}
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN02562%27 HTTP/1.1" 200 None
2026-03-30 07:45:38 [auto1.de] INFO: Saving data for DN02562: {'auction_closing_time': 1774883285.0, 'created_time': 1774553016.160187, 'last_price_update_time': 1774856738.347952}
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DN02562') HTTP/1.1" 204 0
2026-03-30 07:45:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:38 [auto1.de] INFO: Found listing with ID: LB25198
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB25198%27 HTTP/1.1" 200 None
2026-03-30 07:45:38 [auto1.de] INFO: Scrape type for LB25198: 0
2026-03-30 07:45:38 [auto1.de] INFO: Found listing with ID: FP27450
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27450%27 HTTP/1.1" 200 None
2026-03-30 07:45:38 [auto1.de] INFO: Scrape type for FP27450: 2
2026-03-30 07:45:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e78ad8a7-f13a-50bd-aa9f-d5f46fa4bb3e with identifier: FP27450
2026-03-30 07:45:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e78ad8a7-f13a-50bd-aa9f-d5f46fa4bb3e with scrape type 2
2026-03-30 07:45:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e78ad8a7-f13a-50bd-aa9f-d5f46fa4bb3e with scrape type 2
2026-03-30 07:45:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e78ad8a7-f13a-50bd-aa9f-d5f46fa4bb3e, identifier: FP27450
2026-03-30 07:45:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e78ad8a7-f13a-50bd-aa9f-d5f46fa4bb3e with identifier: FP27450
2026-03-30 07:45:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e78ad8a7-f13a-50bd-aa9f-d5f46fa4bb3e with identifier: FP27450
2026-03-30 07:45:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e78ad8a7-f13a-50bd-aa9f-d5f46fa4bb3e with identifier: FP27450 to the API
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:39:50Z',
 'fuel_type': 'diesel',
 'id': 'e78ad8a7-f13a-50bd-aa9f-d5f46fa4bb3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP27450',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 252088,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-24',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP27450%27 HTTP/1.1" 200 None
2026-03-30 07:45:39 [auto1.de] INFO: Saving data for FP27450: {'auction_closing_time': 1774885190.0, 'created_time': 1774639208.833432, 'last_price_update_time': 1774856739.026779}
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP27450') HTTP/1.1" 204 0
2026-03-30 07:45:39 [auto1.de] INFO: Found listing with ID: TV01596
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV01596%27 HTTP/1.1" 200 None
2026-03-30 07:45:39 [auto1.de] INFO: Scrape type for TV01596: 2
2026-03-30 07:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee9d7896-8c7c-51f2-b1d0-fe7fa3e25514 with identifier: TV01596
2026-03-30 07:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee9d7896-8c7c-51f2-b1d0-fe7fa3e25514 with scrape type 2
2026-03-30 07:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee9d7896-8c7c-51f2-b1d0-fe7fa3e25514 with scrape type 2
2026-03-30 07:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee9d7896-8c7c-51f2-b1d0-fe7fa3e25514, identifier: TV01596
2026-03-30 07:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee9d7896-8c7c-51f2-b1d0-fe7fa3e25514 with identifier: TV01596
2026-03-30 07:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee9d7896-8c7c-51f2-b1d0-fe7fa3e25514 with identifier: TV01596
2026-03-30 07:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee9d7896-8c7c-51f2-b1d0-fe7fa3e25514 with identifier: TV01596 to the API
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:41:36Z',
 'fuel_type': 'diesel',
 'id': 'ee9d7896-8c7c-51f2-b1d0-fe7fa3e25514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV01596',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 409037,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CDI T BlueEfficiency Classic',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Classic',
 'year': 2012}
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV01596%27 HTTP/1.1" 200 None
2026-03-30 07:45:39 [auto1.de] INFO: Saving data for TV01596: {'auction_closing_time': 1774885296.0, 'created_time': 1774639231.629009, 'last_price_update_time': 1774856739.436561}
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV01596') HTTP/1.1" 204 0
2026-03-30 07:45:39 [auto1.de] INFO: Found listing with ID: MU97238
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU97238%27 HTTP/1.1" 200 None
2026-03-30 07:45:39 [auto1.de] INFO: Scrape type for MU97238: 2
2026-03-30 07:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16933ab5-691f-572a-908c-ec8524b5b724 with identifier: MU97238
2026-03-30 07:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16933ab5-691f-572a-908c-ec8524b5b724 with scrape type 2
2026-03-30 07:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16933ab5-691f-572a-908c-ec8524b5b724 with scrape type 2
2026-03-30 07:45:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16933ab5-691f-572a-908c-ec8524b5b724, identifier: MU97238
2026-03-30 07:45:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16933ab5-691f-572a-908c-ec8524b5b724 with identifier: MU97238
2026-03-30 07:45:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16933ab5-691f-572a-908c-ec8524b5b724 with identifier: MU97238
2026-03-30 07:45:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16933ab5-691f-572a-908c-ec8524b5b724 with identifier: MU97238 to the API
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-30T15:46:41Z',
 'fuel_type': 'petrol',
 'id': '16933ab5-691f-572a-908c-ec8524b5b724',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU97238',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 136719,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-23',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2011}
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU97238%27 HTTP/1.1" 200 None
2026-03-30 07:45:39 [auto1.de] INFO: Saving data for MU97238: {'auction_closing_time': 1774885601.0, 'created_time': 1774552694.833639, 'last_price_update_time': 1774856739.838609}
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU97238') HTTP/1.1" 204 0
2026-03-30 07:45:39 [auto1.de] INFO: Found listing with ID: TJ83975
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ83975%27 HTTP/1.1" 200 None
2026-03-30 07:45:39 [auto1.de] INFO: Scrape type for TJ83975: 0
2026-03-30 07:45:39 [auto1.de] INFO: Found listing with ID: NA32054
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA32054%27 HTTP/1.1" 200 None
2026-03-30 07:45:39 [auto1.de] INFO: Scrape type for NA32054: 0
2026-03-30 07:45:39 [auto1.de] INFO: Found listing with ID: SU94182
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU94182%27 HTTP/1.1" 200 None
2026-03-30 07:45:39 [auto1.de] INFO: Scrape type for SU94182: 0
2026-03-30 07:45:39 [auto1.de] INFO: Found listing with ID: YT16103
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16103%27 HTTP/1.1" 200 None
2026-03-30 07:45:39 [auto1.de] INFO: Scrape type for YT16103: 2
2026-03-30 07:45:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ceaa0bf-d930-54b9-8336-308adc0e0f95 with identifier: YT16103
2026-03-30 07:45:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ceaa0bf-d930-54b9-8336-308adc0e0f95 with scrape type 2
2026-03-30 07:45:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ceaa0bf-d930-54b9-8336-308adc0e0f95 with scrape type 2
2026-03-30 07:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ceaa0bf-d930-54b9-8336-308adc0e0f95, identifier: YT16103
2026-03-30 07:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ceaa0bf-d930-54b9-8336-308adc0e0f95 with identifier: YT16103
2026-03-30 07:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ceaa0bf-d930-54b9-8336-308adc0e0f95 with identifier: YT16103
2026-03-30 07:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ceaa0bf-d930-54b9-8336-308adc0e0f95 with identifier: YT16103 to the API
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:19:49Z',
 'fuel_type': 'petrol',
 'id': '1ceaa0bf-d930-54b9-8336-308adc0e0f95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT16103',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 152434,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-19',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT16103%27 HTTP/1.1" 200 None
2026-03-30 07:45:40 [auto1.de] INFO: Saving data for YT16103: {'auction_closing_time': 1774883989.0, 'created_time': 1774550402.385048, 'last_price_update_time': 1774856740.284212}
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT16103') HTTP/1.1" 204 0
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: TJ16115
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: BJ70582
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ70582%27 HTTP/1.1" 200 None
2026-03-30 07:45:40 [auto1.de] INFO: Scrape type for BJ70582: 2
2026-03-30 07:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1232db2-492b-595b-95d5-ce62194c89bb with identifier: BJ70582
2026-03-30 07:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1232db2-492b-595b-95d5-ce62194c89bb with scrape type 2
2026-03-30 07:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1232db2-492b-595b-95d5-ce62194c89bb with scrape type 2
2026-03-30 07:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a1232db2-492b-595b-95d5-ce62194c89bb, identifier: BJ70582
2026-03-30 07:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a1232db2-492b-595b-95d5-ce62194c89bb with identifier: BJ70582
2026-03-30 07:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a1232db2-492b-595b-95d5-ce62194c89bb with identifier: BJ70582
2026-03-30 07:45:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a1232db2-492b-595b-95d5-ce62194c89bb with identifier: BJ70582 to the API
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:47:20Z',
 'fuel_type': 'petrol',
 'id': 'a1232db2-492b-595b-95d5-ce62194c89bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BJ70582',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 70211,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-15',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency',
 'year': 2011}
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ70582%27 HTTP/1.1" 200 None
2026-03-30 07:45:40 [auto1.de] INFO: Saving data for BJ70582: {'auction_closing_time': 1774885640.0, 'created_time': 1774638722.173986, 'last_price_update_time': 1774856740.70133}
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BJ70582') HTTP/1.1" 204 0
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: VN46305
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: JK31212
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: SK51641
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: SP10059
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: DW51780
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW51780%27 HTTP/1.1" 200 None
2026-03-30 07:45:40 [auto1.de] INFO: Scrape type for DW51780: 0
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: SM03586
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: JB08013
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB08013%27 HTTP/1.1" 200 None
2026-03-30 07:45:40 [auto1.de] INFO: Scrape type for JB08013: 0
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: MY29921
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: ZM08692
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: UN13511
2026-03-30 07:45:40 [auto1.de] INFO: Found listing with ID: RC44114
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC44114%27 HTTP/1.1" 200 None
2026-03-30 07:45:40 [auto1.de] INFO: Scrape type for RC44114: 2
2026-03-30 07:45:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2af67686-3a71-57b3-a7f5-f4da5df32f77 with identifier: RC44114
2026-03-30 07:45:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2af67686-3a71-57b3-a7f5-f4da5df32f77 with scrape type 2
2026-03-30 07:45:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2af67686-3a71-57b3-a7f5-f4da5df32f77 with scrape type 2
2026-03-30 07:45:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2af67686-3a71-57b3-a7f5-f4da5df32f77, identifier: RC44114
2026-03-30 07:45:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2af67686-3a71-57b3-a7f5-f4da5df32f77 with identifier: RC44114
2026-03-30 07:45:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2af67686-3a71-57b3-a7f5-f4da5df32f77 with identifier: RC44114
2026-03-30 07:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2af67686-3a71-57b3-a7f5-f4da5df32f77 with identifier: RC44114 to the API
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:57:05Z',
 'fuel_type': 'petrol',
 'id': '2af67686-3a71-57b3-a7f5-f4da5df32f77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC44114',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 173587,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-05',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC44114%27 HTTP/1.1" 200 None
2026-03-30 07:45:41 [auto1.de] INFO: Saving data for RC44114: {'auction_closing_time': 1774886225.0, 'created_time': 1774638328.15814, 'last_price_update_time': 1774856741.248619}
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC44114') HTTP/1.1" 204 0
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: AE57502
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE57502%27 HTTP/1.1" 200 None
2026-03-30 07:45:41 [auto1.de] INFO: Scrape type for AE57502: 2
2026-03-30 07:45:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca87e67e-5b2c-546a-b426-728eb883e099 with identifier: AE57502
2026-03-30 07:45:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca87e67e-5b2c-546a-b426-728eb883e099 with scrape type 2
2026-03-30 07:45:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca87e67e-5b2c-546a-b426-728eb883e099 with scrape type 2
2026-03-30 07:45:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca87e67e-5b2c-546a-b426-728eb883e099, identifier: AE57502
2026-03-30 07:45:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca87e67e-5b2c-546a-b426-728eb883e099 with identifier: AE57502
2026-03-30 07:45:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca87e67e-5b2c-546a-b426-728eb883e099 with identifier: AE57502
2026-03-30 07:45:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca87e67e-5b2c-546a-b426-728eb883e099 with identifier: AE57502 to the API
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:42:54Z',
 'fuel_type': 'petrol',
 'id': 'ca87e67e-5b2c-546a-b426-728eb883e099',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE57502',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 43714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-25',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE57502%27 HTTP/1.1" 200 None
2026-03-30 07:45:41 [auto1.de] INFO: Saving data for AE57502: {'auction_closing_time': 1774885374.0, 'created_time': 1774350124.774663, 'last_price_update_time': 1774856741.769964}
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE57502') HTTP/1.1" 204 0
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: GD61504
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: HC05500
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC05500%27 HTTP/1.1" 200 None
2026-03-30 07:45:41 [auto1.de] INFO: Scrape type for HC05500: 0
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: KE06488
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE06488%27 HTTP/1.1" 200 None
2026-03-30 07:45:41 [auto1.de] INFO: Scrape type for KE06488: 0
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: RC86111
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: VR75394
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: GA86041
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA86041%27 HTTP/1.1" 200 None
2026-03-30 07:45:41 [auto1.de] INFO: Scrape type for GA86041: 0
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: SU61840
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU61840%27 HTTP/1.1" 200 None
2026-03-30 07:45:41 [auto1.de] INFO: Scrape type for SU61840: 0
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: XJ26035
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: GH26905
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY91581%27 HTTP/1.1" 200 None
2026-03-30 07:45:41 [auto1.de] INFO: Scrape type for BY91581: 0
2026-03-30 07:45:41 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-30 07:45:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:42 [auto1.de] INFO: Channel: 24h | Page: 114 | totalHits: 8349 | hits on page: 40
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: BY91581
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY91581%27 HTTP/1.1" 200 None
2026-03-30 07:45:42 [auto1.de] INFO: Scrape type for BY91581: 0
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: GP45415
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: CV30078
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV30078%27 HTTP/1.1" 200 None
2026-03-30 07:45:42 [auto1.de] INFO: Scrape type for CV30078: 0
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: LR33805
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR33805%27 HTTP/1.1" 200 None
2026-03-30 07:45:42 [auto1.de] INFO: Scrape type for LR33805: 0
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: YN77653
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: FE22716
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: GK55952
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK55952%27 HTTP/1.1" 200 None
2026-03-30 07:45:42 [auto1.de] INFO: Scrape type for GK55952: 0
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: RD90808
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90808%27 HTTP/1.1" 200 None
2026-03-30 07:45:42 [auto1.de] INFO: Scrape type for RD90808: 2
2026-03-30 07:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d426bc2-f28d-5b66-a379-8bde0b4bf181 with identifier: RD90808
2026-03-30 07:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d426bc2-f28d-5b66-a379-8bde0b4bf181 with scrape type 2
2026-03-30 07:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d426bc2-f28d-5b66-a379-8bde0b4bf181 with scrape type 2
2026-03-30 07:45:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d426bc2-f28d-5b66-a379-8bde0b4bf181, identifier: RD90808
2026-03-30 07:45:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d426bc2-f28d-5b66-a379-8bde0b4bf181 with identifier: RD90808
2026-03-30 07:45:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d426bc2-f28d-5b66-a379-8bde0b4bf181 with identifier: RD90808
2026-03-30 07:45:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d426bc2-f28d-5b66-a379-8bde0b4bf181 with identifier: RD90808 to the API
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 188,
 'expiration_date': '2026-03-30T15:44:35Z',
 'fuel_type': 'petrol',
 'id': '9d426bc2-f28d-5b66-a379-8bde0b4bf181',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD90808',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Magentis',
 'odometer': 26679,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-01',
 'seller_name': None,
 'title': 'Kia Magentis 2.7 EX Top',
 'transmission': 'automatic',
 'trim': 'EX Top',
 'year': 2006}
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90808%27 HTTP/1.1" 200 None
2026-03-30 07:45:42 [auto1.de] INFO: Saving data for RD90808: {'auction_closing_time': 1774885475.0, 'created_time': 1773383735.962182, 'last_price_update_time': 1774856742.785333}
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RD90808') HTTP/1.1" 204 0
2026-03-30 07:45:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: ZU59417
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: CS57817
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: GY49475
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY49475%27 HTTP/1.1" 200 None
2026-03-30 07:45:42 [auto1.de] INFO: Scrape type for GY49475: 0
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: DK64287
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK64287%27 HTTP/1.1" 200 None
2026-03-30 07:45:42 [auto1.de] INFO: Scrape type for DK64287: 0
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: YT00833
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT00833%27 HTTP/1.1" 200 None
2026-03-30 07:45:42 [auto1.de] INFO: Scrape type for YT00833: 0
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: PN07086
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: DD95746
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: SA17140
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: ZK33939
2026-03-30 07:45:42 [auto1.de] INFO: Found listing with ID: CG01662
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG01662%27 HTTP/1.1" 200 None
2026-03-30 07:45:42 [auto1.de] INFO: Scrape type for CG01662: 2
2026-03-30 07:45:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e71d555-4a48-5f35-b215-099f121be258 with identifier: CG01662
2026-03-30 07:45:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e71d555-4a48-5f35-b215-099f121be258 with scrape type 2
2026-03-30 07:45:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e71d555-4a48-5f35-b215-099f121be258 with scrape type 2
2026-03-30 07:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e71d555-4a48-5f35-b215-099f121be258, identifier: CG01662
2026-03-30 07:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e71d555-4a48-5f35-b215-099f121be258 with identifier: CG01662
2026-03-30 07:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e71d555-4a48-5f35-b215-099f121be258 with identifier: CG01662
2026-03-30 07:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e71d555-4a48-5f35-b215-099f121be258 with identifier: CG01662 to the API
2026-03-30 07:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:16:38Z',
 'fuel_type': 'petrol',
 'id': '6e71d555-4a48-5f35-b215-099f121be258',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG01662',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 117191,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-29',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Urban Move',
 'transmission': 'manual',
 'trim': 'Urban Move',
 'year': 2010}
2026-03-30 07:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG01662%27 HTTP/1.1" 200 None
2026-03-30 07:45:43 [auto1.de] INFO: Saving data for CG01662: {'auction_closing_time': 1774883798.0, 'created_time': 1774349869.43464, 'last_price_update_time': 1774856743.366937}
2026-03-30 07:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG01662') HTTP/1.1" 204 0
2026-03-30 07:45:43 [auto1.de] INFO: Found listing with ID: EA89472
2026-03-30 07:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA89472%27 HTTP/1.1" 200 None
2026-03-30 07:45:43 [auto1.de] INFO: Scrape type for EA89472: 2
2026-03-30 07:45:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a75e2c9-9bd9-5329-b06e-dc785aa20ddf with identifier: EA89472
2026-03-30 07:45:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a75e2c9-9bd9-5329-b06e-dc785aa20ddf with scrape type 2
2026-03-30 07:45:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a75e2c9-9bd9-5329-b06e-dc785aa20ddf with scrape type 2
2026-03-30 07:45:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a75e2c9-9bd9-5329-b06e-dc785aa20ddf, identifier: EA89472
2026-03-30 07:45:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a75e2c9-9bd9-5329-b06e-dc785aa20ddf with identifier: EA89472
2026-03-30 07:45:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a75e2c9-9bd9-5329-b06e-dc785aa20ddf with identifier: EA89472
2026-03-30 07:45:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a75e2c9-9bd9-5329-b06e-dc785aa20ddf with identifier: EA89472 to the API
2026-03-30 07:45:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:15:41Z',
 'fuel_type': 'diesel',
 'id': '8a75e2c9-9bd9-5329-b06e-dc785aa20ddf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA89472',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 215314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-30',
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA89472%27 HTTP/1.1" 200 None
2026-03-30 07:45:44 [auto1.de] INFO: Saving data for EA89472: {'auction_closing_time': 1774883741.0, 'created_time': 1774639218.252782, 'last_price_update_time': 1774856744.116926}
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA89472') HTTP/1.1" 204 0
2026-03-30 07:45:44 [auto1.de] INFO: Found listing with ID: RV27706
2026-03-30 07:45:44 [auto1.de] INFO: Found listing with ID: KX83133
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83133%27 HTTP/1.1" 200 None
2026-03-30 07:45:44 [auto1.de] INFO: Scrape type for KX83133: 2
2026-03-30 07:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e49e8d09-c1de-5bf0-8306-9cab53e98958 with identifier: KX83133
2026-03-30 07:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e49e8d09-c1de-5bf0-8306-9cab53e98958 with scrape type 2
2026-03-30 07:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e49e8d09-c1de-5bf0-8306-9cab53e98958 with scrape type 2
2026-03-30 07:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e49e8d09-c1de-5bf0-8306-9cab53e98958, identifier: KX83133
2026-03-30 07:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e49e8d09-c1de-5bf0-8306-9cab53e98958 with identifier: KX83133
2026-03-30 07:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e49e8d09-c1de-5bf0-8306-9cab53e98958 with identifier: KX83133
2026-03-30 07:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e49e8d09-c1de-5bf0-8306-9cab53e98958 with identifier: KX83133 to the API
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:46:42Z',
 'fuel_type': 'diesel',
 'id': 'e49e8d09-c1de-5bf0-8306-9cab53e98958',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX83133',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 90826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-17',
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX83133%27 HTTP/1.1" 200 None
2026-03-30 07:45:44 [auto1.de] INFO: Saving data for KX83133: {'auction_closing_time': 1774885602.0, 'created_time': 1774550152.702302, 'last_price_update_time': 1774856744.640118}
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX83133') HTTP/1.1" 204 0
2026-03-30 07:45:44 [auto1.de] INFO: Found listing with ID: TZ90006
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90006%27 HTTP/1.1" 200 None
2026-03-30 07:45:44 [auto1.de] INFO: Scrape type for TZ90006: 2
2026-03-30 07:45:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 185ffc02-6dc3-5c85-a1fa-9be670beff36 with identifier: TZ90006
2026-03-30 07:45:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 185ffc02-6dc3-5c85-a1fa-9be670beff36 with scrape type 2
2026-03-30 07:45:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 185ffc02-6dc3-5c85-a1fa-9be670beff36 with scrape type 2
2026-03-30 07:45:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 185ffc02-6dc3-5c85-a1fa-9be670beff36, identifier: TZ90006
2026-03-30 07:45:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 185ffc02-6dc3-5c85-a1fa-9be670beff36 with identifier: TZ90006
2026-03-30 07:45:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 185ffc02-6dc3-5c85-a1fa-9be670beff36 with identifier: TZ90006
2026-03-30 07:45:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 185ffc02-6dc3-5c85-a1fa-9be670beff36 with identifier: TZ90006 to the API
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:59:56Z',
 'fuel_type': 'petrol',
 'id': '185ffc02-6dc3-5c85-a1fa-9be670beff36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ90006',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 38459,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-06',
 'seller_name': None,
 'title': "Kia cee'd 1.0 TGDI Edition 7",
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2023}
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90006%27 HTTP/1.1" 200 None
2026-03-30 07:45:45 [auto1.de] INFO: Saving data for TZ90006: {'auction_closing_time': 1774886396.0, 'created_time': 1774552928.058074, 'last_price_update_time': 1774856745.090985}
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TZ90006') HTTP/1.1" 204 0
2026-03-30 07:45:45 [auto1.de] INFO: Found listing with ID: HE21190
2026-03-30 07:45:45 [auto1.de] INFO: Found listing with ID: WY51014
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY51014%27 HTTP/1.1" 200 None
2026-03-30 07:45:45 [auto1.de] INFO: Scrape type for WY51014: 2
2026-03-30 07:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e7a78c1-9655-58d4-b994-ca7295b35e81 with identifier: WY51014
2026-03-30 07:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e7a78c1-9655-58d4-b994-ca7295b35e81 with scrape type 2
2026-03-30 07:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e7a78c1-9655-58d4-b994-ca7295b35e81 with scrape type 2
2026-03-30 07:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e7a78c1-9655-58d4-b994-ca7295b35e81, identifier: WY51014
2026-03-30 07:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e7a78c1-9655-58d4-b994-ca7295b35e81 with identifier: WY51014
2026-03-30 07:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e7a78c1-9655-58d4-b994-ca7295b35e81 with identifier: WY51014
2026-03-30 07:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e7a78c1-9655-58d4-b994-ca7295b35e81 with identifier: WY51014 to the API
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:41:06Z',
 'fuel_type': 'petrol',
 'id': '0e7a78c1-9655-58d4-b994-ca7295b35e81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY51014',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 106995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-28',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY51014%27 HTTP/1.1" 200 None
2026-03-30 07:45:45 [auto1.de] INFO: Saving data for WY51014: {'auction_closing_time': 1774885266.0, 'created_time': 1774639594.144833, 'last_price_update_time': 1774856745.528527}
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY51014') HTTP/1.1" 204 0
2026-03-30 07:45:45 [auto1.de] INFO: Found listing with ID: US71241
2026-03-30 07:45:45 [auto1.de] INFO: Found listing with ID: PV05136
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV05136%27 HTTP/1.1" 200 None
2026-03-30 07:45:45 [auto1.de] INFO: Scrape type for PV05136: 0
2026-03-30 07:45:45 [auto1.de] INFO: Found listing with ID: ZF08436
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF08436%27 HTTP/1.1" 200 None
2026-03-30 07:45:45 [auto1.de] INFO: Scrape type for ZF08436: 2
2026-03-30 07:45:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d50592c-e45f-5a61-8523-ec624aa78d44 with identifier: ZF08436
2026-03-30 07:45:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d50592c-e45f-5a61-8523-ec624aa78d44 with scrape type 2
2026-03-30 07:45:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d50592c-e45f-5a61-8523-ec624aa78d44 with scrape type 2
2026-03-30 07:45:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d50592c-e45f-5a61-8523-ec624aa78d44, identifier: ZF08436
2026-03-30 07:45:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d50592c-e45f-5a61-8523-ec624aa78d44 with identifier: ZF08436
2026-03-30 07:45:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d50592c-e45f-5a61-8523-ec624aa78d44 with identifier: ZF08436
2026-03-30 07:45:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d50592c-e45f-5a61-8523-ec624aa78d44 with identifier: ZF08436 to the API
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:07:34Z',
 'fuel_type': 'diesel',
 'id': '7d50592c-e45f-5a61-8523-ec624aa78d44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF08436',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 215068,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-04',
 'seller_name': None,
 'title': 'Renault Megane 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2012}
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF08436%27 HTTP/1.1" 200 None
2026-03-30 07:45:45 [auto1.de] INFO: Saving data for ZF08436: {'auction_closing_time': 1774883254.0, 'created_time': 1773303335.440149, 'last_price_update_time': 1774856745.956995}
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF08436') HTTP/1.1" 204 0
2026-03-30 07:45:45 [auto1.de] INFO: Found listing with ID: CR70146
2026-03-30 07:45:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR70146%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for CR70146: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: MY97637
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: NB27251
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB27251%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for NB27251: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: EW68189
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW68189%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for EW68189: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: WC52225
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC52225%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for WC52225: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: HR27692
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR27692%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for HR27692: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: TT67708
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67708%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for TT67708: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: PN60983
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN60983%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for PN60983: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: YY49162
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: JR21224
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36521%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for VU36521: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for TL68554: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN53329%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for LN53329: 2
2026-03-30 07:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5964f151-a269-5a7e-8a9f-f0285c606028 with identifier: LN53329
2026-03-30 07:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5964f151-a269-5a7e-8a9f-f0285c606028 with scrape type 2
2026-03-30 07:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5964f151-a269-5a7e-8a9f-f0285c606028 with scrape type 2
2026-03-30 07:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5964f151-a269-5a7e-8a9f-f0285c606028, identifier: LN53329
2026-03-30 07:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5964f151-a269-5a7e-8a9f-f0285c606028 with identifier: LN53329
2026-03-30 07:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5964f151-a269-5a7e-8a9f-f0285c606028 with identifier: LN53329
2026-03-30 07:45:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5964f151-a269-5a7e-8a9f-f0285c606028 with identifier: LN53329 to the API
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:38:14Z',
 'fuel_type': 'petrol',
 'id': '5964f151-a269-5a7e-8a9f-f0285c606028',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN53329',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 135857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2010}
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN53329%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Saving data for LN53329: {'auction_closing_time': 1774885094.0, 'created_time': 1774637509.604228, 'last_price_update_time': 1774856746.541892}
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN53329') HTTP/1.1" 204 0
2026-03-30 07:45:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:46 [auto1.de] INFO: Channel: 24h | Page: 115 | totalHits: 8352 | hits on page: 40
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: VU36521
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36521%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for VU36521: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: TL68554
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL68554%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for TL68554: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: LN53329
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN53329%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for LN53329: 0
2026-03-30 07:45:46 [auto1.de] INFO: Found listing with ID: EZ09435
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ09435%27 HTTP/1.1" 200 None
2026-03-30 07:45:46 [auto1.de] INFO: Scrape type for EZ09435: 2
2026-03-30 07:45:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a857167c-4a2e-51b4-8a66-51f6ce27f733 with identifier: EZ09435
2026-03-30 07:45:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a857167c-4a2e-51b4-8a66-51f6ce27f733 with scrape type 2
2026-03-30 07:45:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a857167c-4a2e-51b4-8a66-51f6ce27f733 with scrape type 2
2026-03-30 07:45:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a857167c-4a2e-51b4-8a66-51f6ce27f733, identifier: EZ09435
2026-03-30 07:45:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a857167c-4a2e-51b4-8a66-51f6ce27f733 with identifier: EZ09435
2026-03-30 07:45:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a857167c-4a2e-51b4-8a66-51f6ce27f733 with identifier: EZ09435
2026-03-30 07:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a857167c-4a2e-51b4-8a66-51f6ce27f733 with identifier: EZ09435 to the API
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:28:06Z',
 'fuel_type': 'diesel',
 'id': 'a857167c-4a2e-51b4-8a66-51f6ce27f733',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ09435',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 266629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-01',
 'seller_name': None,
 'title': 'BMW X4 xDrive 30d M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ09435%27 HTTP/1.1" 200 None
2026-03-30 07:45:47 [auto1.de] INFO: Saving data for EZ09435: {'auction_closing_time': 1774884486.0, 'created_time': 1774638699.767855, 'last_price_update_time': 1774856747.177325}
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EZ09435') HTTP/1.1" 204 0
2026-03-30 07:45:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:47 [auto1.de] INFO: Found listing with ID: GW17934
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW17934%27 HTTP/1.1" 200 None
2026-03-30 07:45:47 [auto1.de] INFO: Scrape type for GW17934: 2
2026-03-30 07:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b71422a4-b716-5e86-9ac8-af09308a96d0 with identifier: GW17934
2026-03-30 07:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b71422a4-b716-5e86-9ac8-af09308a96d0 with scrape type 2
2026-03-30 07:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b71422a4-b716-5e86-9ac8-af09308a96d0 with scrape type 2
2026-03-30 07:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b71422a4-b716-5e86-9ac8-af09308a96d0, identifier: GW17934
2026-03-30 07:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b71422a4-b716-5e86-9ac8-af09308a96d0 with identifier: GW17934
2026-03-30 07:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b71422a4-b716-5e86-9ac8-af09308a96d0 with identifier: GW17934
2026-03-30 07:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b71422a4-b716-5e86-9ac8-af09308a96d0 with identifier: GW17934 to the API
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:40:36Z',
 'fuel_type': 'petrol',
 'id': 'b71422a4-b716-5e86-9ac8-af09308a96d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW17934',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 203788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-07-25',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW17934%27 HTTP/1.1" 200 None
2026-03-30 07:45:47 [auto1.de] INFO: Saving data for GW17934: {'auction_closing_time': 1774885236.0, 'created_time': 1773917128.075718, 'last_price_update_time': 1774856747.593354}
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW17934') HTTP/1.1" 204 0
2026-03-30 07:45:47 [auto1.de] INFO: Found listing with ID: HG38928
2026-03-30 07:45:47 [auto1.de] INFO: Found listing with ID: JT99615
2026-03-30 07:45:47 [auto1.de] INFO: Found listing with ID: DF59303
2026-03-30 07:45:47 [auto1.de] INFO: Found listing with ID: UE69699
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE69699%27 HTTP/1.1" 200 None
2026-03-30 07:45:47 [auto1.de] INFO: Scrape type for UE69699: 2
2026-03-30 07:45:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8f2da0d-81c4-591b-a900-6d708ae7e0e5 with identifier: UE69699
2026-03-30 07:45:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f2da0d-81c4-591b-a900-6d708ae7e0e5 with scrape type 2
2026-03-30 07:45:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8f2da0d-81c4-591b-a900-6d708ae7e0e5 with scrape type 2
2026-03-30 07:45:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8f2da0d-81c4-591b-a900-6d708ae7e0e5, identifier: UE69699
2026-03-30 07:45:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8f2da0d-81c4-591b-a900-6d708ae7e0e5 with identifier: UE69699
2026-03-30 07:45:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8f2da0d-81c4-591b-a900-6d708ae7e0e5 with identifier: UE69699
2026-03-30 07:45:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8f2da0d-81c4-591b-a900-6d708ae7e0e5 with identifier: UE69699 to the API
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:13:59Z',
 'fuel_type': 'petrol',
 'id': 'd8f2da0d-81c4-591b-a900-6d708ae7e0e5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE69699',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 21329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-28',
 'seller_name': None,
 'title': 'Renault Captur 1.3 TCe Intens',
 'transmission': 'automatic',
 'trim': 'Intens',
 'year': 2019}
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE69699%27 HTTP/1.1" 200 None
2026-03-30 07:45:48 [auto1.de] INFO: Saving data for UE69699: {'auction_closing_time': 1774883639.0, 'created_time': 1774636809.896323, 'last_price_update_time': 1774856748.001093}
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE69699') HTTP/1.1" 204 0
2026-03-30 07:45:48 [auto1.de] INFO: Found listing with ID: LK78678
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK78678%27 HTTP/1.1" 200 None
2026-03-30 07:45:48 [auto1.de] INFO: Scrape type for LK78678: 0
2026-03-30 07:45:48 [auto1.de] INFO: Found listing with ID: HD50866
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD50866%27 HTTP/1.1" 200 None
2026-03-30 07:45:48 [auto1.de] INFO: Scrape type for HD50866: 2
2026-03-30 07:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6940f15a-76ac-515b-ba6e-2408e26dfe73 with identifier: HD50866
2026-03-30 07:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6940f15a-76ac-515b-ba6e-2408e26dfe73 with scrape type 2
2026-03-30 07:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6940f15a-76ac-515b-ba6e-2408e26dfe73 with scrape type 2
2026-03-30 07:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6940f15a-76ac-515b-ba6e-2408e26dfe73, identifier: HD50866
2026-03-30 07:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6940f15a-76ac-515b-ba6e-2408e26dfe73 with identifier: HD50866
2026-03-30 07:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6940f15a-76ac-515b-ba6e-2408e26dfe73 with identifier: HD50866
2026-03-30 07:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6940f15a-76ac-515b-ba6e-2408e26dfe73 with identifier: HD50866 to the API
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:44:01Z',
 'fuel_type': 'diesel',
 'id': '6940f15a-76ac-515b-ba6e-2408e26dfe73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD50866',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 243740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-03',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI BlueMotion',
 'transmission': 'automatic',
 'trim': 'BlueMotion',
 'year': 2013}
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD50866%27 HTTP/1.1" 200 None
2026-03-30 07:45:48 [auto1.de] INFO: Saving data for HD50866: {'auction_closing_time': 1774885441.0, 'created_time': 1774638923.643557, 'last_price_update_time': 1774856748.639942}
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HD50866') HTTP/1.1" 204 0
2026-03-30 07:45:48 [auto1.de] INFO: Found listing with ID: HY74574
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY74574%27 HTTP/1.1" 200 None
2026-03-30 07:45:48 [auto1.de] INFO: Scrape type for HY74574: 0
2026-03-30 07:45:48 [auto1.de] INFO: Found listing with ID: SN40806
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40806%27 HTTP/1.1" 200 None
2026-03-30 07:45:48 [auto1.de] INFO: Scrape type for SN40806: 2
2026-03-30 07:45:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b227d964-7050-585d-8aa9-d88ee45e6971 with identifier: SN40806
2026-03-30 07:45:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b227d964-7050-585d-8aa9-d88ee45e6971 with scrape type 2
2026-03-30 07:45:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b227d964-7050-585d-8aa9-d88ee45e6971 with scrape type 2
2026-03-30 07:45:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b227d964-7050-585d-8aa9-d88ee45e6971, identifier: SN40806
2026-03-30 07:45:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b227d964-7050-585d-8aa9-d88ee45e6971 with identifier: SN40806
2026-03-30 07:45:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b227d964-7050-585d-8aa9-d88ee45e6971 with identifier: SN40806
2026-03-30 07:45:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b227d964-7050-585d-8aa9-d88ee45e6971 with identifier: SN40806 to the API
2026-03-30 07:45:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:43:47Z',
 'fuel_type': 'petrol',
 'id': 'b227d964-7050-585d-8aa9-d88ee45e6971',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN40806',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Scirocco',
 'odometer': 206890,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-19',
 'seller_name': None,
 'title': 'Volkswagen Scirocco 1.4 TSI',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN40806%27 HTTP/1.1" 200 None
2026-03-30 07:45:49 [auto1.de] INFO: Saving data for SN40806: {'auction_closing_time': 1774885427.0, 'created_time': 1774589755.699264, 'last_price_update_time': 1774856749.167198}
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN40806') HTTP/1.1" 204 0
2026-03-30 07:45:49 [auto1.de] INFO: Found listing with ID: EN90928
2026-03-30 07:45:49 [auto1.de] INFO: Found listing with ID: WZ14073
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ14073%27 HTTP/1.1" 200 None
2026-03-30 07:45:49 [auto1.de] INFO: Scrape type for WZ14073: 0
2026-03-30 07:45:49 [auto1.de] INFO: Found listing with ID: HM04457
2026-03-30 07:45:49 [auto1.de] INFO: Found listing with ID: KP72429
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72429%27 HTTP/1.1" 200 None
2026-03-30 07:45:49 [auto1.de] INFO: Scrape type for KP72429: 0
2026-03-30 07:45:49 [auto1.de] INFO: Found listing with ID: JY33610
2026-03-30 07:45:49 [auto1.de] INFO: Found listing with ID: VW56389
2026-03-30 07:45:49 [auto1.de] INFO: Found listing with ID: KG29776
2026-03-30 07:45:49 [auto1.de] INFO: Found listing with ID: MU35402
2026-03-30 07:45:49 [auto1.de] INFO: Found listing with ID: YV87591
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV87591%27 HTTP/1.1" 200 None
2026-03-30 07:45:49 [auto1.de] INFO: Scrape type for YV87591: 2
2026-03-30 07:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7523891f-7640-515d-89c8-ee371a7970d4 with identifier: YV87591
2026-03-30 07:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7523891f-7640-515d-89c8-ee371a7970d4 with scrape type 2
2026-03-30 07:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7523891f-7640-515d-89c8-ee371a7970d4 with scrape type 2
2026-03-30 07:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7523891f-7640-515d-89c8-ee371a7970d4, identifier: YV87591
2026-03-30 07:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7523891f-7640-515d-89c8-ee371a7970d4 with identifier: YV87591
2026-03-30 07:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7523891f-7640-515d-89c8-ee371a7970d4 with identifier: YV87591
2026-03-30 07:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7523891f-7640-515d-89c8-ee371a7970d4 with identifier: YV87591 to the API
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:54Z',
 'fuel_type': 'petrol',
 'id': '7523891f-7640-515d-89c8-ee371a7970d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV87591',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 55544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-17',
 'seller_name': None,
 'title': 'Seat Leon 1.5 eTSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2022}
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV87591%27 HTTP/1.1" 200 None
2026-03-30 07:45:49 [auto1.de] INFO: Saving data for YV87591: {'auction_closing_time': 1774885614.0, 'created_time': 1774636972.082059, 'last_price_update_time': 1774856749.625412}
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV87591') HTTP/1.1" 204 0
2026-03-30 07:45:49 [auto1.de] INFO: Found listing with ID: BC48090
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC48090%27 HTTP/1.1" 200 None
2026-03-30 07:45:49 [auto1.de] INFO: Scrape type for BC48090: 2
2026-03-30 07:45:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f3fdbe2-7545-5371-8879-6c826f8f3fdc with identifier: BC48090
2026-03-30 07:45:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f3fdbe2-7545-5371-8879-6c826f8f3fdc with scrape type 2
2026-03-30 07:45:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f3fdbe2-7545-5371-8879-6c826f8f3fdc with scrape type 2
2026-03-30 07:45:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f3fdbe2-7545-5371-8879-6c826f8f3fdc, identifier: BC48090
2026-03-30 07:45:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f3fdbe2-7545-5371-8879-6c826f8f3fdc with identifier: BC48090
2026-03-30 07:45:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f3fdbe2-7545-5371-8879-6c826f8f3fdc with identifier: BC48090
2026-03-30 07:45:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f3fdbe2-7545-5371-8879-6c826f8f3fdc with identifier: BC48090 to the API
2026-03-30 07:45:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:16:22Z',
 'fuel_type': 'petrol',
 'id': '9f3fdbe2-7545-5371-8879-6c826f8f3fdc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC48090',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 39741,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-01-30',
 'seller_name': None,
 'title': 'Opel Mokka X 1.2 Turbo GS Line',
 'transmission': 'automatic',
 'trim': 'GS Line',
 'year': 2024}
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC48090%27 HTTP/1.1" 200 None
2026-03-30 07:45:50 [auto1.de] INFO: Saving data for BC48090: {'auction_closing_time': 1774883782.0, 'created_time': 1774550360.079774, 'last_price_update_time': 1774856750.128545}
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC48090') HTTP/1.1" 204 0
2026-03-30 07:45:50 [auto1.de] INFO: Found listing with ID: RB29698
2026-03-30 07:45:50 [auto1.de] INFO: Found listing with ID: VU37583
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU37583%27 HTTP/1.1" 200 None
2026-03-30 07:45:50 [auto1.de] INFO: Scrape type for VU37583: 2
2026-03-30 07:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24b2b4de-f130-5145-84de-97e6bd0f82ad with identifier: VU37583
2026-03-30 07:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24b2b4de-f130-5145-84de-97e6bd0f82ad with scrape type 2
2026-03-30 07:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24b2b4de-f130-5145-84de-97e6bd0f82ad with scrape type 2
2026-03-30 07:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 24b2b4de-f130-5145-84de-97e6bd0f82ad, identifier: VU37583
2026-03-30 07:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 24b2b4de-f130-5145-84de-97e6bd0f82ad with identifier: VU37583
2026-03-30 07:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 24b2b4de-f130-5145-84de-97e6bd0f82ad with identifier: VU37583
2026-03-30 07:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 24b2b4de-f130-5145-84de-97e6bd0f82ad with identifier: VU37583 to the API
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:39:40Z',
 'fuel_type': 'diesel',
 'id': '24b2b4de-f130-5145-84de-97e6bd0f82ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VU37583',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 215656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-12',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
 'transmission': 'automatic',
 'trim': 'Sports-Line',
 'year': 2014}
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU37583%27 HTTP/1.1" 200 None
2026-03-30 07:45:50 [auto1.de] INFO: Saving data for VU37583: {'auction_closing_time': 1774885180.0, 'created_time': 1774639026.081227, 'last_price_update_time': 1774856750.533824}
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VU37583') HTTP/1.1" 204 0
2026-03-30 07:45:50 [auto1.de] INFO: Found listing with ID: LH09734
2026-03-30 07:45:50 [auto1.de] INFO: Found listing with ID: ZV83127
2026-03-30 07:45:50 [auto1.de] INFO: Found listing with ID: VS89065
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89065%27 HTTP/1.1" 200 None
2026-03-30 07:45:50 [auto1.de] INFO: Scrape type for VS89065: 2
2026-03-30 07:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb346027-6314-5db1-9469-7b1a4eb87cda with identifier: VS89065
2026-03-30 07:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb346027-6314-5db1-9469-7b1a4eb87cda with scrape type 2
2026-03-30 07:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb346027-6314-5db1-9469-7b1a4eb87cda with scrape type 2
2026-03-30 07:45:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb346027-6314-5db1-9469-7b1a4eb87cda, identifier: VS89065
2026-03-30 07:45:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb346027-6314-5db1-9469-7b1a4eb87cda with identifier: VS89065
2026-03-30 07:45:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb346027-6314-5db1-9469-7b1a4eb87cda with identifier: VS89065
2026-03-30 07:45:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb346027-6314-5db1-9469-7b1a4eb87cda with identifier: VS89065 to the API
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:24:16Z',
 'fuel_type': 'diesel',
 'id': 'bb346027-6314-5db1-9469-7b1a4eb87cda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS89065',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 150889,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS89065%27 HTTP/1.1" 200 None
2026-03-30 07:45:50 [auto1.de] INFO: Saving data for VS89065: {'auction_closing_time': 1774884256.0, 'created_time': 1774552820.291533, 'last_price_update_time': 1774856750.929998}
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS89065') HTTP/1.1" 204 0
2026-03-30 07:45:50 [auto1.de] INFO: Found listing with ID: CK79873
2026-03-30 07:45:50 [auto1.de] INFO: Found listing with ID: KK06519
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK06519%27 HTTP/1.1" 200 None
2026-03-30 07:45:50 [auto1.de] INFO: Scrape type for KK06519: 0
2026-03-30 07:45:50 [auto1.de] INFO: Found listing with ID: CZ89661
2026-03-30 07:45:50 [auto1.de] INFO: Found listing with ID: NT80809
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT80809%27 HTTP/1.1" 200 None
2026-03-30 07:45:50 [auto1.de] INFO: Scrape type for NT80809: 2
2026-03-30 07:45:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3bd45fc-2e42-5d19-b3f2-84f8918a3f1f with identifier: NT80809
2026-03-30 07:45:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3bd45fc-2e42-5d19-b3f2-84f8918a3f1f with scrape type 2
2026-03-30 07:45:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3bd45fc-2e42-5d19-b3f2-84f8918a3f1f with scrape type 2
2026-03-30 07:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b3bd45fc-2e42-5d19-b3f2-84f8918a3f1f, identifier: NT80809
2026-03-30 07:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b3bd45fc-2e42-5d19-b3f2-84f8918a3f1f with identifier: NT80809
2026-03-30 07:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b3bd45fc-2e42-5d19-b3f2-84f8918a3f1f with identifier: NT80809
2026-03-30 07:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b3bd45fc-2e42-5d19-b3f2-84f8918a3f1f with identifier: NT80809 to the API
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:08:16Z',
 'fuel_type': 'petrol',
 'id': 'b3bd45fc-2e42-5d19-b3f2-84f8918a3f1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT80809',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 82400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2017}
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT80809%27 HTTP/1.1" 200 None
2026-03-30 07:45:51 [auto1.de] INFO: Saving data for NT80809: {'auction_closing_time': 1774883296.0, 'created_time': 1773383143.205723, 'last_price_update_time': 1774856751.395981}
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NT80809') HTTP/1.1" 204 0
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: HV64790
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV64790%27 HTTP/1.1" 200 None
2026-03-30 07:45:51 [auto1.de] INFO: Scrape type for HV64790: 0
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: YA77478
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: XL73598
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-30 07:45:51 [auto1.de] INFO: Scrape type for LR85001: 0
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK79183%27 HTTP/1.1" 200 None
2026-03-30 07:45:51 [auto1.de] INFO: Scrape type for MK79183: 2
2026-03-30 07:45:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92a2b027-5730-565e-ba24-77475815b5c4 with identifier: MK79183
2026-03-30 07:45:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92a2b027-5730-565e-ba24-77475815b5c4 with scrape type 2
2026-03-30 07:45:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92a2b027-5730-565e-ba24-77475815b5c4 with scrape type 2
2026-03-30 07:45:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92a2b027-5730-565e-ba24-77475815b5c4, identifier: MK79183
2026-03-30 07:45:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92a2b027-5730-565e-ba24-77475815b5c4 with identifier: MK79183
2026-03-30 07:45:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92a2b027-5730-565e-ba24-77475815b5c4 with identifier: MK79183
2026-03-30 07:45:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92a2b027-5730-565e-ba24-77475815b5c4 with identifier: MK79183 to the API
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-30T15:13:04Z',
 'fuel_type': 'petrol',
 'id': '92a2b027-5730-565e-ba24-77475815b5c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK79183',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 72237,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2021}
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK79183%27 HTTP/1.1" 200 None
2026-03-30 07:45:51 [auto1.de] INFO: Saving data for MK79183: {'auction_closing_time': 1774883584.0, 'created_time': 1774552364.024809, 'last_price_update_time': 1774856751.846948}
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK79183') HTTP/1.1" 204 0
2026-03-30 07:45:51 [auto1.de] INFO: Channel: 24h | Page: 116 | totalHits: 8357 | hits on page: 40
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: UU18213
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: MW99572
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: LR85001
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR85001%27 HTTP/1.1" 200 None
2026-03-30 07:45:51 [auto1.de] INFO: Scrape type for LR85001: 0
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: HJ94843
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: MK79183
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK79183%27 HTTP/1.1" 200 None
2026-03-30 07:45:51 [auto1.de] INFO: Scrape type for MK79183: 0
2026-03-30 07:45:51 [auto1.de] INFO: Found listing with ID: NF12247
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12247%27 HTTP/1.1" 200 None
2026-03-30 07:45:52 [auto1.de] INFO: Scrape type for NF12247: 2
2026-03-30 07:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with identifier: NF12247
2026-03-30 07:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with scrape type 2
2026-03-30 07:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with scrape type 2
2026-03-30 07:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a9e4dd7c-ac41-5b0a-b33d-1f48982beb85, identifier: NF12247
2026-03-30 07:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with identifier: NF12247
2026-03-30 07:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with identifier: NF12247
2026-03-30 07:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a9e4dd7c-ac41-5b0a-b33d-1f48982beb85 with identifier: NF12247 to the API
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:06:28Z',
 'fuel_type': 'diesel',
 'id': 'a9e4dd7c-ac41-5b0a-b33d-1f48982beb85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NF12247',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 193711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-02',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Sports-Line AWD',
 'transmission': 'manual',
 'trim': 'Sports-Line AWD',
 'year': 2016}
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF12247%27 HTTP/1.1" 200 None
2026-03-30 07:45:52 [auto1.de] INFO: Saving data for NF12247: {'auction_closing_time': 1774883188.0, 'created_time': 1774552916.097325, 'last_price_update_time': 1774856752.361489}
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NF12247') HTTP/1.1" 204 0
2026-03-30 07:45:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:52 [auto1.de] INFO: Found listing with ID: ZY56723
2026-03-30 07:45:52 [auto1.de] INFO: Found listing with ID: TW44182
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW44182%27 HTTP/1.1" 200 None
2026-03-30 07:45:52 [auto1.de] INFO: Scrape type for TW44182: 0
2026-03-30 07:45:52 [auto1.de] INFO: Found listing with ID: BW06665
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06665%27 HTTP/1.1" 200 None
2026-03-30 07:45:52 [auto1.de] INFO: Scrape type for BW06665: 2
2026-03-30 07:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 251ad846-e101-52d4-ba72-cd8743ff731c with identifier: BW06665
2026-03-30 07:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 251ad846-e101-52d4-ba72-cd8743ff731c with scrape type 2
2026-03-30 07:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 251ad846-e101-52d4-ba72-cd8743ff731c with scrape type 2
2026-03-30 07:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 251ad846-e101-52d4-ba72-cd8743ff731c, identifier: BW06665
2026-03-30 07:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 251ad846-e101-52d4-ba72-cd8743ff731c with identifier: BW06665
2026-03-30 07:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 251ad846-e101-52d4-ba72-cd8743ff731c with identifier: BW06665
2026-03-30 07:45:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 251ad846-e101-52d4-ba72-cd8743ff731c with identifier: BW06665 to the API
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:56:36Z',
 'fuel_type': 'diesel',
 'id': '251ad846-e101-52d4-ba72-cd8743ff731c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW06665',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 158937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2017}
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW06665%27 HTTP/1.1" 200 None
2026-03-30 07:45:52 [auto1.de] INFO: Saving data for BW06665: {'auction_closing_time': 1774886196.0, 'created_time': 1774550127.239988, 'last_price_update_time': 1774856752.788185}
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BW06665') HTTP/1.1" 204 0
2026-03-30 07:45:52 [auto1.de] INFO: Found listing with ID: BW33957
2026-03-30 07:45:52 [auto1.de] INFO: Found listing with ID: RJ71204
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ71204%27 HTTP/1.1" 200 None
2026-03-30 07:45:52 [auto1.de] INFO: Scrape type for RJ71204: 0
2026-03-30 07:45:52 [auto1.de] INFO: Found listing with ID: RK85869
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK85869%27 HTTP/1.1" 200 None
2026-03-30 07:45:52 [auto1.de] INFO: Scrape type for RK85869: 2
2026-03-30 07:45:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2e000f8-9dbe-5756-b0b5-48fb666b220a with identifier: RK85869
2026-03-30 07:45:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2e000f8-9dbe-5756-b0b5-48fb666b220a with scrape type 2
2026-03-30 07:45:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2e000f8-9dbe-5756-b0b5-48fb666b220a with scrape type 2
2026-03-30 07:45:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2e000f8-9dbe-5756-b0b5-48fb666b220a, identifier: RK85869
2026-03-30 07:45:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2e000f8-9dbe-5756-b0b5-48fb666b220a with identifier: RK85869
2026-03-30 07:45:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2e000f8-9dbe-5756-b0b5-48fb666b220a with identifier: RK85869
2026-03-30 07:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2e000f8-9dbe-5756-b0b5-48fb666b220a with identifier: RK85869 to the API
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:26:07Z',
 'fuel_type': 'diesel',
 'id': 'b2e000f8-9dbe-5756-b0b5-48fb666b220a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK85869',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia',
 'odometer': 506983,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-28',
 'seller_name': None,
 'title': 'Opel Insignia 2.0 CDTI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2014}
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK85869%27 HTTP/1.1" 200 None
2026-03-30 07:45:53 [auto1.de] INFO: Saving data for RK85869: {'auction_closing_time': 1774884367.0, 'created_time': 1773138004.642708, 'last_price_update_time': 1774856753.215439}
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK85869') HTTP/1.1" 204 0
2026-03-30 07:45:53 [auto1.de] INFO: Found listing with ID: ZH34670
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH34670%27 HTTP/1.1" 200 None
2026-03-30 07:45:53 [auto1.de] INFO: Scrape type for ZH34670: 2
2026-03-30 07:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea451211-25d3-58b9-8828-88d99d3fbf99 with identifier: ZH34670
2026-03-30 07:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea451211-25d3-58b9-8828-88d99d3fbf99 with scrape type 2
2026-03-30 07:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea451211-25d3-58b9-8828-88d99d3fbf99 with scrape type 2
2026-03-30 07:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea451211-25d3-58b9-8828-88d99d3fbf99, identifier: ZH34670
2026-03-30 07:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea451211-25d3-58b9-8828-88d99d3fbf99 with identifier: ZH34670
2026-03-30 07:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea451211-25d3-58b9-8828-88d99d3fbf99 with identifier: ZH34670
2026-03-30 07:45:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea451211-25d3-58b9-8828-88d99d3fbf99 with identifier: ZH34670 to the API
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:57:53Z',
 'fuel_type': 'petrol',
 'id': 'ea451211-25d3-58b9-8828-88d99d3fbf99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH34670',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 43657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-27',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2021}
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH34670%27 HTTP/1.1" 200 None
2026-03-30 07:45:53 [auto1.de] INFO: Saving data for ZH34670: {'auction_closing_time': 1774886273.0, 'created_time': 1774552733.628097, 'last_price_update_time': 1774856753.782389}
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH34670') HTTP/1.1" 204 0
2026-03-30 07:45:53 [auto1.de] INFO: Found listing with ID: ZU42459
2026-03-30 07:45:53 [auto1.de] INFO: Found listing with ID: BE15343
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE15343%27 HTTP/1.1" 200 None
2026-03-30 07:45:53 [auto1.de] INFO: Scrape type for BE15343: 0
2026-03-30 07:45:53 [auto1.de] INFO: Found listing with ID: CA27289
2026-03-30 07:45:53 [auto1.de] INFO: Found listing with ID: YD60070
2026-03-30 07:45:53 [auto1.de] INFO: Found listing with ID: ZF67159
2026-03-30 07:45:53 [auto1.de] INFO: Found listing with ID: CW80278
2026-03-30 07:45:53 [auto1.de] INFO: Found listing with ID: WD35847
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD35847%27 HTTP/1.1" 200 None
2026-03-30 07:45:53 [auto1.de] INFO: Scrape type for WD35847: 2
2026-03-30 07:45:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6731196-3410-564d-94b9-b3070b774bba with identifier: WD35847
2026-03-30 07:45:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6731196-3410-564d-94b9-b3070b774bba with scrape type 2
2026-03-30 07:45:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6731196-3410-564d-94b9-b3070b774bba with scrape type 2
2026-03-30 07:45:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6731196-3410-564d-94b9-b3070b774bba, identifier: WD35847
2026-03-30 07:45:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6731196-3410-564d-94b9-b3070b774bba with identifier: WD35847
2026-03-30 07:45:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6731196-3410-564d-94b9-b3070b774bba with identifier: WD35847
2026-03-30 07:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6731196-3410-564d-94b9-b3070b774bba with identifier: WD35847 to the API
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:08:21Z',
 'fuel_type': 'petrol',
 'id': 'e6731196-3410-564d-94b9-b3070b774bba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD35847',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 53485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-25',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2019}
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD35847%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Saving data for WD35847: {'auction_closing_time': 1774883301.0, 'created_time': 1773344602.294182, 'last_price_update_time': 1774856754.21136}
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD35847') HTTP/1.1" 204 0
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: WR99181
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: LW43520
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: MS83797
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS83797%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Scrape type for MS83797: 0
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: XD58993
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: EN88282
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN88282%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Scrape type for EN88282: 0
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: ZY80421
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY80421%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Scrape type for ZY80421: 0
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: PU85783
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU85783%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Scrape type for PU85783: 0
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: JD54519
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JD54519%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Scrape type for JD54519: 0
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: WP47747
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: XK33490
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK33490%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Scrape type for XK33490: 0
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: KS42383
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS42383%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Scrape type for KS42383: 0
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: YB86536
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86536%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Scrape type for YB86536: 2
2026-03-30 07:45:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eebeb800-320a-5635-abf0-2a1af077d0e0 with identifier: YB86536
2026-03-30 07:45:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eebeb800-320a-5635-abf0-2a1af077d0e0 with scrape type 2
2026-03-30 07:45:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eebeb800-320a-5635-abf0-2a1af077d0e0 with scrape type 2
2026-03-30 07:45:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eebeb800-320a-5635-abf0-2a1af077d0e0, identifier: YB86536
2026-03-30 07:45:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eebeb800-320a-5635-abf0-2a1af077d0e0 with identifier: YB86536
2026-03-30 07:45:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eebeb800-320a-5635-abf0-2a1af077d0e0 with identifier: YB86536
2026-03-30 07:45:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eebeb800-320a-5635-abf0-2a1af077d0e0 with identifier: YB86536 to the API
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:51:55Z',
 'fuel_type': 'diesel',
 'id': 'eebeb800-320a-5635-abf0-2a1af077d0e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB86536',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 158768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-01',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB86536%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Saving data for YB86536: {'auction_closing_time': 1774885915.0, 'created_time': 1774589756.569713, 'last_price_update_time': 1774856754.755051}
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB86536') HTTP/1.1" 204 0
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: ME12043
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: FG75722
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG75722%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Scrape type for FG75722: 0
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: LG84508
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG84508%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Scrape type for LG84508: 0
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: SD97280
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: BP02747
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-30 07:45:54 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ43779%27 HTTP/1.1" 200 None
2026-03-30 07:45:54 [auto1.de] INFO: Scrape type for AJ43779: 0
2026-03-30 07:45:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:55 [auto1.de] INFO: Channel: 24h | Page: 117 | totalHits: 8360 | hits on page: 40
2026-03-30 07:45:55 [auto1.de] INFO: Found listing with ID: BT37883
2026-03-30 07:45:55 [auto1.de] INFO: Found listing with ID: ST29936
2026-03-30 07:45:55 [auto1.de] INFO: Found listing with ID: AJ43779
2026-03-30 07:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ43779%27 HTTP/1.1" 200 None
2026-03-30 07:45:55 [auto1.de] INFO: Scrape type for AJ43779: 0
2026-03-30 07:45:55 [auto1.de] INFO: Found listing with ID: VW79588
2026-03-30 07:45:55 [auto1.de] INFO: Found listing with ID: FV26342
2026-03-30 07:45:55 [auto1.de] INFO: Found listing with ID: RX04560
2026-03-30 07:45:55 [auto1.de] INFO: Found listing with ID: DX03120
2026-03-30 07:45:55 [auto1.de] INFO: Found listing with ID: YZ54178
2026-03-30 07:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ54178%27 HTTP/1.1" 200 None
2026-03-30 07:45:55 [auto1.de] INFO: Scrape type for YZ54178: 0
2026-03-30 07:45:55 [auto1.de] INFO: Found listing with ID: UW12612
2026-03-30 07:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW12612%27 HTTP/1.1" 200 None
2026-03-30 07:45:55 [auto1.de] INFO: Scrape type for UW12612: 0
2026-03-30 07:45:55 [auto1.de] INFO: Found listing with ID: UV59464
2026-03-30 07:45:55 [auto1.de] INFO: Found listing with ID: NR35132
2026-03-30 07:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35132%27 HTTP/1.1" 200 None
2026-03-30 07:45:55 [auto1.de] INFO: Scrape type for NR35132: 2
2026-03-30 07:45:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0515e77-5901-5bf6-9e8e-2b86437bea98 with identifier: NR35132
2026-03-30 07:45:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0515e77-5901-5bf6-9e8e-2b86437bea98 with scrape type 2
2026-03-30 07:45:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0515e77-5901-5bf6-9e8e-2b86437bea98 with scrape type 2
2026-03-30 07:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0515e77-5901-5bf6-9e8e-2b86437bea98, identifier: NR35132
2026-03-30 07:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0515e77-5901-5bf6-9e8e-2b86437bea98 with identifier: NR35132
2026-03-30 07:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0515e77-5901-5bf6-9e8e-2b86437bea98 with identifier: NR35132
2026-03-30 07:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0515e77-5901-5bf6-9e8e-2b86437bea98 with identifier: NR35132 to the API
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:06:38Z',
 'fuel_type': 'petrol',
 'id': 'd0515e77-5901-5bf6-9e8e-2b86437bea98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR35132',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 323476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-08',
 'seller_name': None,
 'title': 'Volvo XC90 2.5 T',
 'transmission': 'automatic',
 'trim': '',
 'year': 2004}
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR35132%27 HTTP/1.1" 200 None
2026-03-30 07:45:56 [auto1.de] INFO: Saving data for NR35132: {'auction_closing_time': 1774883198.0, 'created_time': 1774553249.413059, 'last_price_update_time': 1774856756.316736}
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR35132') HTTP/1.1" 204 0
2026-03-30 07:45:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:45:56 [auto1.de] INFO: Found listing with ID: GS49465
2026-03-30 07:45:56 [auto1.de] INFO: Found listing with ID: AC77037
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC77037%27 HTTP/1.1" 200 None
2026-03-30 07:45:56 [auto1.de] INFO: Scrape type for AC77037: 2
2026-03-30 07:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df1f293e-ab28-5192-ade4-0cd77012ff14 with identifier: AC77037
2026-03-30 07:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df1f293e-ab28-5192-ade4-0cd77012ff14 with scrape type 2
2026-03-30 07:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df1f293e-ab28-5192-ade4-0cd77012ff14 with scrape type 2
2026-03-30 07:45:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df1f293e-ab28-5192-ade4-0cd77012ff14, identifier: AC77037
2026-03-30 07:45:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df1f293e-ab28-5192-ade4-0cd77012ff14 with identifier: AC77037
2026-03-30 07:45:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df1f293e-ab28-5192-ade4-0cd77012ff14 with identifier: AC77037
2026-03-30 07:45:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df1f293e-ab28-5192-ade4-0cd77012ff14 with identifier: AC77037 to the API
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:08:16Z',
 'fuel_type': 'diesel',
 'id': 'df1f293e-ab28-5192-ade4-0cd77012ff14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC77037',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Discovery',
 'odometer': 311598,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-04',
 'seller_name': None,
 'title': 'Land Rover Discovery 2.7 Td V6 TD HSE',
 'transmission': 'automatic',
 'trim': 'TD HSE',
 'year': 2009}
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC77037%27 HTTP/1.1" 200 None
2026-03-30 07:45:56 [auto1.de] INFO: Saving data for AC77037: {'auction_closing_time': 1774883296.0, 'created_time': 1774639443.356265, 'last_price_update_time': 1774856756.793662}
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC77037') HTTP/1.1" 204 0
2026-03-30 07:45:56 [auto1.de] INFO: Found listing with ID: LT68556
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT68556%27 HTTP/1.1" 200 None
2026-03-30 07:45:56 [auto1.de] INFO: Scrape type for LT68556: 0
2026-03-30 07:45:56 [auto1.de] INFO: Found listing with ID: NS17757
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17757%27 HTTP/1.1" 200 None
2026-03-30 07:45:56 [auto1.de] INFO: Scrape type for NS17757: 0
2026-03-30 07:45:56 [auto1.de] INFO: Found listing with ID: KE42269
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE42269%27 HTTP/1.1" 200 None
2026-03-30 07:45:56 [auto1.de] INFO: Scrape type for KE42269: 0
2026-03-30 07:45:56 [auto1.de] INFO: Found listing with ID: PA20304
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA20304%27 HTTP/1.1" 200 None
2026-03-30 07:45:56 [auto1.de] INFO: Scrape type for PA20304: 0
2026-03-30 07:45:56 [auto1.de] INFO: Found listing with ID: RF69391
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF69391%27 HTTP/1.1" 200 None
2026-03-30 07:45:56 [auto1.de] INFO: Scrape type for RF69391: 2
2026-03-30 07:45:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f669818a-56e8-5daf-b085-482f92de7fe2 with identifier: RF69391
2026-03-30 07:45:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f669818a-56e8-5daf-b085-482f92de7fe2 with scrape type 2
2026-03-30 07:45:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f669818a-56e8-5daf-b085-482f92de7fe2 with scrape type 2
2026-03-30 07:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f669818a-56e8-5daf-b085-482f92de7fe2, identifier: RF69391
2026-03-30 07:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f669818a-56e8-5daf-b085-482f92de7fe2 with identifier: RF69391
2026-03-30 07:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f669818a-56e8-5daf-b085-482f92de7fe2 with identifier: RF69391
2026-03-30 07:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f669818a-56e8-5daf-b085-482f92de7fe2 with identifier: RF69391 to the API
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:44:02Z',
 'fuel_type': 'petrol',
 'id': 'f669818a-56e8-5daf-b085-482f92de7fe2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF69391',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Qubo',
 'odometer': 155901,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-27',
 'seller_name': None,
 'title': 'Fiat Qubo 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF69391%27 HTTP/1.1" 200 None
2026-03-30 07:45:57 [auto1.de] INFO: Saving data for RF69391: {'auction_closing_time': 1774885442.0, 'created_time': 1774639283.471974, 'last_price_update_time': 1774856757.313702}
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RF69391') HTTP/1.1" 204 0
2026-03-30 07:45:57 [auto1.de] INFO: Found listing with ID: HF35410
2026-03-30 07:45:57 [auto1.de] INFO: Found listing with ID: NS53664
2026-03-30 07:45:57 [auto1.de] INFO: Found listing with ID: TU97792
2026-03-30 07:45:57 [auto1.de] INFO: Found listing with ID: HZ51579
2026-03-30 07:45:57 [auto1.de] INFO: Found listing with ID: GY67479
2026-03-30 07:45:57 [auto1.de] INFO: Found listing with ID: VG52113
2026-03-30 07:45:57 [auto1.de] INFO: Found listing with ID: LL99453
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL99453%27 HTTP/1.1" 200 None
2026-03-30 07:45:57 [auto1.de] INFO: Scrape type for LL99453: 2
2026-03-30 07:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 466fb675-e6d3-57a6-adf1-bfc280942a1a with identifier: LL99453
2026-03-30 07:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 466fb675-e6d3-57a6-adf1-bfc280942a1a with scrape type 2
2026-03-30 07:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 466fb675-e6d3-57a6-adf1-bfc280942a1a with scrape type 2
2026-03-30 07:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 466fb675-e6d3-57a6-adf1-bfc280942a1a, identifier: LL99453
2026-03-30 07:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 466fb675-e6d3-57a6-adf1-bfc280942a1a with identifier: LL99453
2026-03-30 07:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 466fb675-e6d3-57a6-adf1-bfc280942a1a with identifier: LL99453
2026-03-30 07:45:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 466fb675-e6d3-57a6-adf1-bfc280942a1a with identifier: LL99453 to the API
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:16:17Z',
 'fuel_type': 'petrol',
 'id': '466fb675-e6d3-57a6-adf1-bfc280942a1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL99453',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 188084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-31',
 'seller_name': None,
 'title': 'Kia Picanto 1.1 Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2011}
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL99453%27 HTTP/1.1" 200 None
2026-03-30 07:45:57 [auto1.de] INFO: Saving data for LL99453: {'auction_closing_time': 1774883777.0, 'created_time': 1774553222.722959, 'last_price_update_time': 1774856757.709355}
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL99453') HTTP/1.1" 204 0
2026-03-30 07:45:57 [auto1.de] INFO: Found listing with ID: MA44978
2026-03-30 07:45:57 [auto1.de] INFO: Found listing with ID: GV20028
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV20028%27 HTTP/1.1" 200 None
2026-03-30 07:45:57 [auto1.de] INFO: Scrape type for GV20028: 0
2026-03-30 07:45:57 [auto1.de] INFO: Found listing with ID: SM28331
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM28331%27 HTTP/1.1" 200 None
2026-03-30 07:45:57 [auto1.de] INFO: Scrape type for SM28331: 0
2026-03-30 07:45:57 [auto1.de] INFO: Found listing with ID: YT13980
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT13980%27 HTTP/1.1" 200 None
2026-03-30 07:45:57 [auto1.de] INFO: Scrape type for YT13980: 2
2026-03-30 07:45:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94c1943d-3cb3-5b32-8a01-efd3ab40b00f with identifier: YT13980
2026-03-30 07:45:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94c1943d-3cb3-5b32-8a01-efd3ab40b00f with scrape type 2
2026-03-30 07:45:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94c1943d-3cb3-5b32-8a01-efd3ab40b00f with scrape type 2
2026-03-30 07:45:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94c1943d-3cb3-5b32-8a01-efd3ab40b00f, identifier: YT13980
2026-03-30 07:45:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94c1943d-3cb3-5b32-8a01-efd3ab40b00f with identifier: YT13980
2026-03-30 07:45:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94c1943d-3cb3-5b32-8a01-efd3ab40b00f with identifier: YT13980
2026-03-30 07:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94c1943d-3cb3-5b32-8a01-efd3ab40b00f with identifier: YT13980 to the API
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:47:35Z',
 'fuel_type': 'petrol',
 'id': '94c1943d-3cb3-5b32-8a01-efd3ab40b00f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT13980',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 199764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-06',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT13980%27 HTTP/1.1" 200 None
2026-03-30 07:45:58 [auto1.de] INFO: Saving data for YT13980: {'auction_closing_time': 1774885655.0, 'created_time': 1774639287.206715, 'last_price_update_time': 1774856758.278398}
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT13980') HTTP/1.1" 204 0
2026-03-30 07:45:58 [auto1.de] INFO: Found listing with ID: VJ08081
2026-03-30 07:45:58 [auto1.de] INFO: Found listing with ID: CX62190
2026-03-30 07:45:58 [auto1.de] INFO: Found listing with ID: RE06888
2026-03-30 07:45:58 [auto1.de] INFO: Found listing with ID: XY66672
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY66672%27 HTTP/1.1" 200 None
2026-03-30 07:45:58 [auto1.de] INFO: Scrape type for XY66672: 2
2026-03-30 07:45:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 551306b7-395f-5f18-85fc-82aeedbd60a4 with identifier: XY66672
2026-03-30 07:45:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 551306b7-395f-5f18-85fc-82aeedbd60a4 with scrape type 2
2026-03-30 07:45:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 551306b7-395f-5f18-85fc-82aeedbd60a4 with scrape type 2
2026-03-30 07:45:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 551306b7-395f-5f18-85fc-82aeedbd60a4, identifier: XY66672
2026-03-30 07:45:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 551306b7-395f-5f18-85fc-82aeedbd60a4 with identifier: XY66672
2026-03-30 07:45:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 551306b7-395f-5f18-85fc-82aeedbd60a4 with identifier: XY66672
2026-03-30 07:45:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 551306b7-395f-5f18-85fc-82aeedbd60a4 with identifier: XY66672 to the API
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:45:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:01:15Z',
 'fuel_type': 'diesel',
 'id': '551306b7-395f-5f18-85fc-82aeedbd60a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY66672',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 190522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-28',
 'seller_name': None,
 'title': 'Nissan Juke 1.5 Turbodiesel Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2011}
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY66672%27 HTTP/1.1" 200 None
2026-03-30 07:45:58 [auto1.de] INFO: Saving data for XY66672: {'auction_closing_time': 1774882875.0, 'created_time': 1773917332.921626, 'last_price_update_time': 1774856758.700175}
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY66672') HTTP/1.1" 204 0
2026-03-30 07:45:58 [auto1.de] INFO: Found listing with ID: WK73698
2026-03-30 07:45:58 [auto1.de] INFO: Found listing with ID: EE83038
2026-03-30 07:45:58 [auto1.de] INFO: Found listing with ID: XJ33844
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ33844%27 HTTP/1.1" 200 None
2026-03-30 07:45:58 [auto1.de] INFO: Scrape type for XJ33844: 0
2026-03-30 07:45:58 [auto1.de] INFO: Found listing with ID: HE92439
2026-03-30 07:45:58 [auto1.de] INFO: Found listing with ID: MM36361
2026-03-30 07:45:58 [auto1.de] INFO: Found listing with ID: SH26484
2026-03-30 07:45:58 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-30 07:45:58 [auto1.de] INFO: Scrape type for TP66547: 0
2026-03-30 07:45:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:45:59 [auto1.de] INFO: Channel: 24h | Page: 118 | totalHits: 8361 | hits on page: 40
2026-03-30 07:45:59 [auto1.de] INFO: Found listing with ID: TP66547
2026-03-30 07:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP66547%27 HTTP/1.1" 200 None
2026-03-30 07:45:59 [auto1.de] INFO: Scrape type for TP66547: 0
2026-03-30 07:45:59 [auto1.de] INFO: Found listing with ID: NX72393
2026-03-30 07:45:59 [auto1.de] INFO: Found listing with ID: VP25295
2026-03-30 07:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP25295%27 HTTP/1.1" 200 None
2026-03-30 07:45:59 [auto1.de] INFO: Scrape type for VP25295: 0
2026-03-30 07:45:59 [auto1.de] INFO: Found listing with ID: BK52975
2026-03-30 07:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:45:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK52975%27 HTTP/1.1" 200 None
2026-03-30 07:45:59 [auto1.de] INFO: Scrape type for BK52975: 2
2026-03-30 07:45:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7f5fa40-a07c-5fbd-88b4-fd73c95166ac with identifier: BK52975
2026-03-30 07:45:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7f5fa40-a07c-5fbd-88b4-fd73c95166ac with scrape type 2
2026-03-30 07:45:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7f5fa40-a07c-5fbd-88b4-fd73c95166ac with scrape type 2
2026-03-30 07:45:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7f5fa40-a07c-5fbd-88b4-fd73c95166ac, identifier: BK52975
2026-03-30 07:45:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7f5fa40-a07c-5fbd-88b4-fd73c95166ac with identifier: BK52975
2026-03-30 07:45:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7f5fa40-a07c-5fbd-88b4-fd73c95166ac with identifier: BK52975
2026-03-30 07:45:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7f5fa40-a07c-5fbd-88b4-fd73c95166ac with identifier: BK52975 to the API
2026-03-30 07:45:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:43:01Z',
 'fuel_type': 'petrol',
 'id': 'b7f5fa40-a07c-5fbd-88b4-fd73c95166ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK52975',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 28415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-08-26',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo GS',
 'transmission': 'automatic',
 'trim': 'GS',
 'year': 2024}
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK52975%27 HTTP/1.1" 200 None
2026-03-30 07:46:00 [auto1.de] INFO: Saving data for BK52975: {'auction_closing_time': 1774885381.0, 'created_time': 1774550373.221276, 'last_price_update_time': 1774856760.165894}
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK52975') HTTP/1.1" 204 0
2026-03-30 07:46:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: BN48826
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: VH62706
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: NZ04570
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: DE77804
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE77804%27 HTTP/1.1" 200 None
2026-03-30 07:46:00 [auto1.de] INFO: Scrape type for DE77804: 0
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: FC29722
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: EB96923
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: RG76834
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG76834%27 HTTP/1.1" 200 None
2026-03-30 07:46:00 [auto1.de] INFO: Scrape type for RG76834: 0
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: XK03693
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: WL56832
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: MN63665
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN63665%27 HTTP/1.1" 200 None
2026-03-30 07:46:00 [auto1.de] INFO: Scrape type for MN63665: 2
2026-03-30 07:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 48a40625-99e4-5996-bf73-6aa5abbd009c with identifier: MN63665
2026-03-30 07:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 48a40625-99e4-5996-bf73-6aa5abbd009c with scrape type 2
2026-03-30 07:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 48a40625-99e4-5996-bf73-6aa5abbd009c with scrape type 2
2026-03-30 07:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 48a40625-99e4-5996-bf73-6aa5abbd009c, identifier: MN63665
2026-03-30 07:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 48a40625-99e4-5996-bf73-6aa5abbd009c with identifier: MN63665
2026-03-30 07:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 48a40625-99e4-5996-bf73-6aa5abbd009c with identifier: MN63665
2026-03-30 07:46:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 48a40625-99e4-5996-bf73-6aa5abbd009c with identifier: MN63665 to the API
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:21:47Z',
 'fuel_type': 'petrol',
 'id': '48a40625-99e4-5996-bf73-6aa5abbd009c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN63665',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 171720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-22',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2008}
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN63665%27 HTTP/1.1" 200 None
2026-03-30 07:46:00 [auto1.de] INFO: Saving data for MN63665: {'auction_closing_time': 1774884107.0, 'created_time': 1774638329.009326, 'last_price_update_time': 1774856760.816658}
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN63665') HTTP/1.1" 204 0
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: AG34789
2026-03-30 07:46:00 [auto1.de] INFO: Found listing with ID: KC01296
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC01296%27 HTTP/1.1" 200 None
2026-03-30 07:46:00 [auto1.de] INFO: Scrape type for KC01296: 2
2026-03-30 07:46:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 580fe904-cb17-5aa3-b76b-7ef52080d20c with identifier: KC01296
2026-03-30 07:46:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 580fe904-cb17-5aa3-b76b-7ef52080d20c with scrape type 2
2026-03-30 07:46:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 580fe904-cb17-5aa3-b76b-7ef52080d20c with scrape type 2
2026-03-30 07:46:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 580fe904-cb17-5aa3-b76b-7ef52080d20c, identifier: KC01296
2026-03-30 07:46:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 580fe904-cb17-5aa3-b76b-7ef52080d20c with identifier: KC01296
2026-03-30 07:46:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 580fe904-cb17-5aa3-b76b-7ef52080d20c with identifier: KC01296
2026-03-30 07:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 580fe904-cb17-5aa3-b76b-7ef52080d20c with identifier: KC01296 to the API
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:37:39Z',
 'fuel_type': 'diesel',
 'id': '580fe904-cb17-5aa3-b76b-7ef52080d20c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC01296',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 130218,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-07',
 'seller_name': None,
 'title': 'Audi Q7 4.2 V8 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2009}
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC01296%27 HTTP/1.1" 200 None
2026-03-30 07:46:01 [auto1.de] INFO: Saving data for KC01296: {'auction_closing_time': 1774885059.0, 'created_time': 1774552929.540645, 'last_price_update_time': 1774856761.320522}
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KC01296') HTTP/1.1" 204 0
2026-03-30 07:46:01 [auto1.de] INFO: Found listing with ID: WH84573
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH84573%27 HTTP/1.1" 200 None
2026-03-30 07:46:01 [auto1.de] INFO: Scrape type for WH84573: 2
2026-03-30 07:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7396db51-990a-57e8-8e7a-5c56954c2273 with identifier: WH84573
2026-03-30 07:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7396db51-990a-57e8-8e7a-5c56954c2273 with scrape type 2
2026-03-30 07:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7396db51-990a-57e8-8e7a-5c56954c2273 with scrape type 2
2026-03-30 07:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7396db51-990a-57e8-8e7a-5c56954c2273, identifier: WH84573
2026-03-30 07:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7396db51-990a-57e8-8e7a-5c56954c2273 with identifier: WH84573
2026-03-30 07:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7396db51-990a-57e8-8e7a-5c56954c2273 with identifier: WH84573
2026-03-30 07:46:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7396db51-990a-57e8-8e7a-5c56954c2273 with identifier: WH84573 to the API
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:52:35Z',
 'fuel_type': 'petrol',
 'id': '7396db51-990a-57e8-8e7a-5c56954c2273',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WH84573',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 248199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-09',
 'seller_name': None,
 'title': 'Audi A4 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH84573%27 HTTP/1.1" 200 None
2026-03-30 07:46:01 [auto1.de] INFO: Saving data for WH84573: {'auction_closing_time': 1774885955.0, 'created_time': 1774551120.107952, 'last_price_update_time': 1774856761.850045}
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WH84573') HTTP/1.1" 204 0
2026-03-30 07:46:01 [auto1.de] INFO: Found listing with ID: JL94841
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL94841%27 HTTP/1.1" 200 None
2026-03-30 07:46:01 [auto1.de] INFO: Scrape type for JL94841: 2
2026-03-30 07:46:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d31f065b-eb3f-552a-a33e-c042b64f3a13 with identifier: JL94841
2026-03-30 07:46:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d31f065b-eb3f-552a-a33e-c042b64f3a13 with scrape type 2
2026-03-30 07:46:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d31f065b-eb3f-552a-a33e-c042b64f3a13 with scrape type 2
2026-03-30 07:46:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d31f065b-eb3f-552a-a33e-c042b64f3a13, identifier: JL94841
2026-03-30 07:46:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d31f065b-eb3f-552a-a33e-c042b64f3a13 with identifier: JL94841
2026-03-30 07:46:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d31f065b-eb3f-552a-a33e-c042b64f3a13 with identifier: JL94841
2026-03-30 07:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d31f065b-eb3f-552a-a33e-c042b64f3a13 with identifier: JL94841 to the API
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:51Z',
 'fuel_type': 'petrol',
 'id': 'd31f065b-eb3f-552a-a33e-c042b64f3a13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL94841',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 46484,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.0 TSI United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2020}
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL94841%27 HTTP/1.1" 200 None
2026-03-30 07:46:02 [auto1.de] INFO: Saving data for JL94841: {'auction_closing_time': 1774885491.0, 'created_time': 1774640260.991067, 'last_price_update_time': 1774856762.278215}
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL94841') HTTP/1.1" 204 0
2026-03-30 07:46:02 [auto1.de] INFO: Found listing with ID: SA01659
2026-03-30 07:46:02 [auto1.de] INFO: Found listing with ID: MR61415
2026-03-30 07:46:02 [auto1.de] INFO: Found listing with ID: KP87344
2026-03-30 07:46:02 [auto1.de] INFO: Found listing with ID: MV77064
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV77064%27 HTTP/1.1" 200 None
2026-03-30 07:46:02 [auto1.de] INFO: Scrape type for MV77064: 0
2026-03-30 07:46:02 [auto1.de] INFO: Found listing with ID: UC78580
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78580%27 HTTP/1.1" 200 None
2026-03-30 07:46:02 [auto1.de] INFO: Scrape type for UC78580: 2
2026-03-30 07:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d29eb43d-0a02-5127-a761-683a961ef61c with identifier: UC78580
2026-03-30 07:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d29eb43d-0a02-5127-a761-683a961ef61c with scrape type 2
2026-03-30 07:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d29eb43d-0a02-5127-a761-683a961ef61c with scrape type 2
2026-03-30 07:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d29eb43d-0a02-5127-a761-683a961ef61c, identifier: UC78580
2026-03-30 07:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d29eb43d-0a02-5127-a761-683a961ef61c with identifier: UC78580
2026-03-30 07:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d29eb43d-0a02-5127-a761-683a961ef61c with identifier: UC78580
2026-03-30 07:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d29eb43d-0a02-5127-a761-683a961ef61c with identifier: UC78580 to the API
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:56:56Z',
 'fuel_type': 'petrol',
 'id': 'd29eb43d-0a02-5127-a761-683a961ef61c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC78580',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 169212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-26',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 SYNC Edition',
 'transmission': 'manual',
 'trim': 'SYNC Edition',
 'year': 2014}
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC78580%27 HTTP/1.1" 200 None
2026-03-30 07:46:02 [auto1.de] INFO: Saving data for UC78580: {'auction_closing_time': 1774886216.0, 'created_time': 1774639902.094842, 'last_price_update_time': 1774856762.735827}
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC78580') HTTP/1.1" 204 0
2026-03-30 07:46:02 [auto1.de] INFO: Found listing with ID: HZ18082
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ18082%27 HTTP/1.1" 200 None
2026-03-30 07:46:02 [auto1.de] INFO: Scrape type for HZ18082: 2
2026-03-30 07:46:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a7f2897-e6fa-5753-b63a-b09443025628 with identifier: HZ18082
2026-03-30 07:46:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a7f2897-e6fa-5753-b63a-b09443025628 with scrape type 2
2026-03-30 07:46:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a7f2897-e6fa-5753-b63a-b09443025628 with scrape type 2
2026-03-30 07:46:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4a7f2897-e6fa-5753-b63a-b09443025628, identifier: HZ18082
2026-03-30 07:46:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4a7f2897-e6fa-5753-b63a-b09443025628 with identifier: HZ18082
2026-03-30 07:46:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4a7f2897-e6fa-5753-b63a-b09443025628 with identifier: HZ18082
2026-03-30 07:46:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4a7f2897-e6fa-5753-b63a-b09443025628 with identifier: HZ18082 to the API
2026-03-30 07:46:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:22:12Z',
 'fuel_type': 'diesel',
 'id': '4a7f2897-e6fa-5753-b63a-b09443025628',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ18082',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'L 200',
 'odometer': 119898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-14',
 'seller_name': None,
 'title': 'Mitsubishi L 200 2.4 DI-D Plus Doppelkabine 4WD',
 'transmission': 'automatic',
 'trim': 'Plus Doppelkabine 4WD',
 'year': 2019}
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ18082%27 HTTP/1.1" 200 None
2026-03-30 07:46:03 [auto1.de] INFO: Saving data for HZ18082: {'auction_closing_time': 1774884132.0, 'created_time': 1774639728.492429, 'last_price_update_time': 1774856763.145333}
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ18082') HTTP/1.1" 204 0
2026-03-30 07:46:03 [auto1.de] INFO: Found listing with ID: MS57219
2026-03-30 07:46:03 [auto1.de] INFO: Found listing with ID: LK29782
2026-03-30 07:46:03 [auto1.de] INFO: Found listing with ID: MX99530
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX99530%27 HTTP/1.1" 200 None
2026-03-30 07:46:03 [auto1.de] INFO: Scrape type for MX99530: 2
2026-03-30 07:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9a4cb68-ef01-5f62-bcd3-f20521df8198 with identifier: MX99530
2026-03-30 07:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9a4cb68-ef01-5f62-bcd3-f20521df8198 with scrape type 2
2026-03-30 07:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9a4cb68-ef01-5f62-bcd3-f20521df8198 with scrape type 2
2026-03-30 07:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9a4cb68-ef01-5f62-bcd3-f20521df8198, identifier: MX99530
2026-03-30 07:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9a4cb68-ef01-5f62-bcd3-f20521df8198 with identifier: MX99530
2026-03-30 07:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9a4cb68-ef01-5f62-bcd3-f20521df8198 with identifier: MX99530
2026-03-30 07:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9a4cb68-ef01-5f62-bcd3-f20521df8198 with identifier: MX99530 to the API
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 227,
 'expiration_date': '2026-03-30T15:03:29Z',
 'fuel_type': 'petrol',
 'id': 'd9a4cb68-ef01-5f62-bcd3-f20521df8198',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX99530',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLE-Klasse',
 'odometer': 6497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-01',
 'seller_name': None,
 'title': 'Mercedes-Benz CLE-Klasse CLE 200 Mild-Hybrid AMG Line Advanced Plus',
 'transmission': 'automatic',
 'trim': 'AMG Line Advanced Plus',
 'year': 2023}
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX99530%27 HTTP/1.1" 200 None
2026-03-30 07:46:03 [auto1.de] INFO: Saving data for MX99530: {'auction_closing_time': 1774883009.0, 'created_time': 1774639694.890749, 'last_price_update_time': 1774856763.543596}
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX99530') HTTP/1.1" 204 0
2026-03-30 07:46:03 [auto1.de] INFO: Found listing with ID: KV22200
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV22200%27 HTTP/1.1" 200 None
2026-03-30 07:46:03 [auto1.de] INFO: Scrape type for KV22200: 0
2026-03-30 07:46:03 [auto1.de] INFO: Found listing with ID: HD39951
2026-03-30 07:46:03 [auto1.de] INFO: Found listing with ID: BB20328
2026-03-30 07:46:03 [auto1.de] INFO: Found listing with ID: JM51025
2026-03-30 07:46:03 [auto1.de] INFO: Found listing with ID: TN55927
2026-03-30 07:46:03 [auto1.de] INFO: Found listing with ID: YB52644
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB52644%27 HTTP/1.1" 200 None
2026-03-30 07:46:03 [auto1.de] INFO: Scrape type for YB52644: 2
2026-03-30 07:46:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 901b2438-d0d4-5189-86be-cf1bbe5acc44 with identifier: YB52644
2026-03-30 07:46:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 901b2438-d0d4-5189-86be-cf1bbe5acc44 with scrape type 2
2026-03-30 07:46:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 901b2438-d0d4-5189-86be-cf1bbe5acc44 with scrape type 2
2026-03-30 07:46:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 901b2438-d0d4-5189-86be-cf1bbe5acc44, identifier: YB52644
2026-03-30 07:46:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 901b2438-d0d4-5189-86be-cf1bbe5acc44 with identifier: YB52644
2026-03-30 07:46:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 901b2438-d0d4-5189-86be-cf1bbe5acc44 with identifier: YB52644
2026-03-30 07:46:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 901b2438-d0d4-5189-86be-cf1bbe5acc44 with identifier: YB52644 to the API
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:08:14Z',
 'fuel_type': 'hybrid',
 'id': '901b2438-d0d4-5189-86be-cf1bbe5acc44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB52644',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 30945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-17',
 'seller_name': None,
 'title': 'Audi Q3 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YB52644%27 HTTP/1.1" 200 None
2026-03-30 07:46:04 [auto1.de] INFO: Saving data for YB52644: {'auction_closing_time': 1774883294.0, 'created_time': 1774638876.773633, 'last_price_update_time': 1774856764.058185}
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YB52644') HTTP/1.1" 204 0
2026-03-30 07:46:04 [auto1.de] INFO: Found listing with ID: MV46979
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV46979%27 HTTP/1.1" 200 None
2026-03-30 07:46:04 [auto1.de] INFO: Scrape type for MV46979: 0
2026-03-30 07:46:04 [auto1.de] INFO: Found listing with ID: SH34786
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34786%27 HTTP/1.1" 200 None
2026-03-30 07:46:04 [auto1.de] INFO: Scrape type for SH34786: 2
2026-03-30 07:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with identifier: SH34786
2026-03-30 07:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with scrape type 2
2026-03-30 07:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with scrape type 2
2026-03-30 07:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed, identifier: SH34786
2026-03-30 07:46:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with identifier: SH34786
2026-03-30 07:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with identifier: SH34786
2026-03-30 07:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed with identifier: SH34786 to the API
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:29:18Z',
 'fuel_type': 'diesel',
 'id': 'a79db3e0-aa5f-5ec2-9b41-d469e4b2b0ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SH34786',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 194837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-26',
 'seller_name': None,
 'title': 'Ford Fiesta 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2017}
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH34786%27 HTTP/1.1" 200 None
2026-03-30 07:46:04 [auto1.de] INFO: Saving data for SH34786: {'auction_closing_time': 1774884558.0, 'created_time': 1774553051.766648, 'last_price_update_time': 1774856764.539883}
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SH34786') HTTP/1.1" 204 0
2026-03-30 07:46:04 [auto1.de] INFO: Found listing with ID: UG24808
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24808%27 HTTP/1.1" 200 None
2026-03-30 07:46:04 [auto1.de] INFO: Scrape type for UG24808: 2
2026-03-30 07:46:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1114338f-8d24-5966-a489-c11995fc1a88 with identifier: UG24808
2026-03-30 07:46:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1114338f-8d24-5966-a489-c11995fc1a88 with scrape type 2
2026-03-30 07:46:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1114338f-8d24-5966-a489-c11995fc1a88 with scrape type 2
2026-03-30 07:46:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1114338f-8d24-5966-a489-c11995fc1a88, identifier: UG24808
2026-03-30 07:46:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1114338f-8d24-5966-a489-c11995fc1a88 with identifier: UG24808
2026-03-30 07:46:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1114338f-8d24-5966-a489-c11995fc1a88 with identifier: UG24808
2026-03-30 07:46:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1114338f-8d24-5966-a489-c11995fc1a88 with identifier: UG24808 to the API
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:48:09Z',
 'fuel_type': 'petrol',
 'id': '1114338f-8d24-5966-a489-c11995fc1a88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG24808',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 54234,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-19',
 'seller_name': None,
 'title': 'Hyundai i20 1.0 TGDI Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2020}
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG24808%27 HTTP/1.1" 200 None
2026-03-30 07:46:05 [auto1.de] INFO: Saving data for UG24808: {'auction_closing_time': 1774885689.0, 'created_time': 1774550126.076672, 'last_price_update_time': 1774856765.015819}
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG24808') HTTP/1.1" 204 0
2026-03-30 07:46:05 [auto1.de] INFO: Found listing with ID: WA42384
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA42384%27 HTTP/1.1" 200 None
2026-03-30 07:46:05 [auto1.de] INFO: Scrape type for WA42384: 0
2026-03-30 07:46:05 [auto1.de] INFO: Found listing with ID: EV99140
2026-03-30 07:46:05 [auto1.de] INFO: Found listing with ID: EW54456
2026-03-30 07:46:05 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN48846%27 HTTP/1.1" 200 None
2026-03-30 07:46:05 [auto1.de] INFO: Scrape type for WN48846: 0
2026-03-30 07:46:05 [auto1.de] INFO: Channel: 24h | Page: 119 | totalHits: 8362 | hits on page: 40
2026-03-30 07:46:05 [auto1.de] INFO: Found listing with ID: WN48846
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN48846%27 HTTP/1.1" 200 None
2026-03-30 07:46:05 [auto1.de] INFO: Scrape type for WN48846: 0
2026-03-30 07:46:05 [auto1.de] INFO: Found listing with ID: BM78825
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM78825%27 HTTP/1.1" 200 None
2026-03-30 07:46:05 [auto1.de] INFO: Scrape type for BM78825: 2
2026-03-30 07:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a5cb0fc-5e54-5dd6-91a8-ed72ec667745 with identifier: BM78825
2026-03-30 07:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a5cb0fc-5e54-5dd6-91a8-ed72ec667745 with scrape type 2
2026-03-30 07:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a5cb0fc-5e54-5dd6-91a8-ed72ec667745 with scrape type 2
2026-03-30 07:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a5cb0fc-5e54-5dd6-91a8-ed72ec667745, identifier: BM78825
2026-03-30 07:46:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a5cb0fc-5e54-5dd6-91a8-ed72ec667745 with identifier: BM78825
2026-03-30 07:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a5cb0fc-5e54-5dd6-91a8-ed72ec667745 with identifier: BM78825
2026-03-30 07:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a5cb0fc-5e54-5dd6-91a8-ed72ec667745 with identifier: BM78825 to the API
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:00:46Z',
 'fuel_type': 'diesel',
 'id': '7a5cb0fc-5e54-5dd6-91a8-ed72ec667745',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM78825',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Hilux',
 'odometer': 149841,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-22',
 'seller_name': None,
 'title': 'Toyota Hilux 2.4 D-4D Single Cab Duty 4x2',
 'transmission': 'manual',
 'trim': 'Single Cab Duty 4x2',
 'year': 2021}
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM78825%27 HTTP/1.1" 200 None
2026-03-30 07:46:05 [auto1.de] INFO: Saving data for BM78825: {'auction_closing_time': 1774882846.0, 'created_time': 1774639485.873457, 'last_price_update_time': 1774856765.504707}
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM78825') HTTP/1.1" 204 0
2026-03-30 07:46:05 [auto1.de] INFO: Found listing with ID: WD28635
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD28635%27 HTTP/1.1" 200 None
2026-03-30 07:46:05 [auto1.de] INFO: Scrape type for WD28635: 2
2026-03-30 07:46:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a7eda54-7c31-5468-8ecc-acf6ea393a8d with identifier: WD28635
2026-03-30 07:46:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a7eda54-7c31-5468-8ecc-acf6ea393a8d with scrape type 2
2026-03-30 07:46:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a7eda54-7c31-5468-8ecc-acf6ea393a8d with scrape type 2
2026-03-30 07:46:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a7eda54-7c31-5468-8ecc-acf6ea393a8d, identifier: WD28635
2026-03-30 07:46:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a7eda54-7c31-5468-8ecc-acf6ea393a8d with identifier: WD28635
2026-03-30 07:46:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a7eda54-7c31-5468-8ecc-acf6ea393a8d with identifier: WD28635
2026-03-30 07:46:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a7eda54-7c31-5468-8ecc-acf6ea393a8d with identifier: WD28635 to the API
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:30:10Z',
 'fuel_type': 'petrol',
 'id': '2a7eda54-7c31-5468-8ecc-acf6ea393a8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD28635',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 93172,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Style',
 'year': 2016}
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD28635%27 HTTP/1.1" 200 None
2026-03-30 07:46:06 [auto1.de] INFO: Saving data for WD28635: {'auction_closing_time': 1774884610.0, 'created_time': 1774639530.509545, 'last_price_update_time': 1774856766.026508}
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WD28635') HTTP/1.1" 204 0
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: GR91976
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR91976%27 HTTP/1.1" 200 None
2026-03-30 07:46:06 [auto1.de] INFO: Scrape type for GR91976: 2
2026-03-30 07:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e043504-cb86-5c3e-8cde-bd489b356113 with identifier: GR91976
2026-03-30 07:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e043504-cb86-5c3e-8cde-bd489b356113 with scrape type 2
2026-03-30 07:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e043504-cb86-5c3e-8cde-bd489b356113 with scrape type 2
2026-03-30 07:46:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e043504-cb86-5c3e-8cde-bd489b356113, identifier: GR91976
2026-03-30 07:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e043504-cb86-5c3e-8cde-bd489b356113 with identifier: GR91976
2026-03-30 07:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e043504-cb86-5c3e-8cde-bd489b356113 with identifier: GR91976
2026-03-30 07:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e043504-cb86-5c3e-8cde-bd489b356113 with identifier: GR91976 to the API
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:07:20Z',
 'fuel_type': 'diesel',
 'id': '0e043504-cb86-5c3e-8cde-bd489b356113',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR91976',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 196320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 2.0 TDI Highline 4Motion',
 'transmission': 'manual',
 'trim': 'Highline 4Motion',
 'year': 2012}
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR91976%27 HTTP/1.1" 200 None
2026-03-30 07:46:06 [auto1.de] INFO: Saving data for GR91976: {'auction_closing_time': 1774883240.0, 'created_time': 1774552906.465086, 'last_price_update_time': 1774856766.44271}
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR91976') HTTP/1.1" 204 0
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: GK51404
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: EW11176
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: GM15631
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: VY52691
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: SG67731
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: PC09309
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: NN62521
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN62521%27 HTTP/1.1" 200 None
2026-03-30 07:46:06 [auto1.de] INFO: Scrape type for NN62521: 0
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: XK79004
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: LG80642
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: FM78984
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM78984%27 HTTP/1.1" 200 None
2026-03-30 07:46:06 [auto1.de] INFO: Scrape type for FM78984: 0
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: MN24694
2026-03-30 07:46:06 [auto1.de] INFO: Found listing with ID: TL40939
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL40939%27 HTTP/1.1" 200 None
2026-03-30 07:46:06 [auto1.de] INFO: Scrape type for TL40939: 2
2026-03-30 07:46:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7e3861b-f332-536f-8c5f-532f9b19d005 with identifier: TL40939
2026-03-30 07:46:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7e3861b-f332-536f-8c5f-532f9b19d005 with scrape type 2
2026-03-30 07:46:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7e3861b-f332-536f-8c5f-532f9b19d005 with scrape type 2
2026-03-30 07:46:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a7e3861b-f332-536f-8c5f-532f9b19d005, identifier: TL40939
2026-03-30 07:46:06 [scrapy.extensions.logstats] INFO: Crawled 315 pages (at 14 pages/min), scraped 785 items (at 104 items/min)
2026-03-30 07:46:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:46:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a7e3861b-f332-536f-8c5f-532f9b19d005 with identifier: TL40939
2026-03-30 07:46:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a7e3861b-f332-536f-8c5f-532f9b19d005 with identifier: TL40939
2026-03-30 07:46:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a7e3861b-f332-536f-8c5f-532f9b19d005 with identifier: TL40939 to the API
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:53:03Z',
 'fuel_type': 'petrol',
 'id': 'a7e3861b-f332-536f-8c5f-532f9b19d005',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TL40939',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 155416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-08',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 250 CGI CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'CGI BlueEfficiency Avantgarde',
 'year': 2011}
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL40939%27 HTTP/1.1" 200 None
2026-03-30 07:46:06 [auto1.de] INFO: Saving data for TL40939: {'auction_closing_time': 1774885983.0, 'created_time': 1774639534.713784, 'last_price_update_time': 1774856766.905229}
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TL40939') HTTP/1.1" 204 0
2026-03-30 07:46:07 [auto1.de] INFO: Found listing with ID: DA12198
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA12198%27 HTTP/1.1" 200 None
2026-03-30 07:46:07 [auto1.de] INFO: Scrape type for DA12198: 2
2026-03-30 07:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8799a3c5-4391-589b-b503-89aad1d4f97b with identifier: DA12198
2026-03-30 07:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8799a3c5-4391-589b-b503-89aad1d4f97b with scrape type 2
2026-03-30 07:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8799a3c5-4391-589b-b503-89aad1d4f97b with scrape type 2
2026-03-30 07:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8799a3c5-4391-589b-b503-89aad1d4f97b, identifier: DA12198
2026-03-30 07:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8799a3c5-4391-589b-b503-89aad1d4f97b with identifier: DA12198
2026-03-30 07:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8799a3c5-4391-589b-b503-89aad1d4f97b with identifier: DA12198
2026-03-30 07:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8799a3c5-4391-589b-b503-89aad1d4f97b with identifier: DA12198 to the API
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:21:18Z',
 'fuel_type': 'petrol',
 'id': '8799a3c5-4391-589b-b503-89aad1d4f97b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA12198',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 99351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-01',
 'seller_name': None,
 'title': 'Audi Q3 45 TFSI quattro Advanced',
 'transmission': 'automatic',
 'trim': 'quattro Advanced',
 'year': 2021}
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA12198%27 HTTP/1.1" 200 None
2026-03-30 07:46:07 [auto1.de] INFO: Saving data for DA12198: {'auction_closing_time': 1774884078.0, 'created_time': 1774550511.078449, 'last_price_update_time': 1774856767.395686}
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA12198') HTTP/1.1" 204 0
2026-03-30 07:46:07 [auto1.de] INFO: Found listing with ID: MC04391
2026-03-30 07:46:07 [auto1.de] INFO: Found listing with ID: BG03972
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG03972%27 HTTP/1.1" 200 None
2026-03-30 07:46:07 [auto1.de] INFO: Scrape type for BG03972: 2
2026-03-30 07:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d549aed-2a34-5edd-8c71-aa7922026b17 with identifier: BG03972
2026-03-30 07:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d549aed-2a34-5edd-8c71-aa7922026b17 with scrape type 2
2026-03-30 07:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d549aed-2a34-5edd-8c71-aa7922026b17 with scrape type 2
2026-03-30 07:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d549aed-2a34-5edd-8c71-aa7922026b17, identifier: BG03972
2026-03-30 07:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d549aed-2a34-5edd-8c71-aa7922026b17 with identifier: BG03972
2026-03-30 07:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d549aed-2a34-5edd-8c71-aa7922026b17 with identifier: BG03972
2026-03-30 07:46:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d549aed-2a34-5edd-8c71-aa7922026b17 with identifier: BG03972 to the API
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:08Z',
 'fuel_type': 'petrol',
 'id': '3d549aed-2a34-5edd-8c71-aa7922026b17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG03972',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 171241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-03',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG03972%27 HTTP/1.1" 200 None
2026-03-30 07:46:07 [auto1.de] INFO: Saving data for BG03972: {'auction_closing_time': 1774885568.0, 'created_time': 1774638541.196308, 'last_price_update_time': 1774856767.782949}
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BG03972') HTTP/1.1" 204 0
2026-03-30 07:46:07 [auto1.de] INFO: Found listing with ID: RW72462
2026-03-30 07:46:07 [auto1.de] INFO: Found listing with ID: HY48346
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48346%27 HTTP/1.1" 200 None
2026-03-30 07:46:07 [auto1.de] INFO: Scrape type for HY48346: 2
2026-03-30 07:46:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with identifier: HY48346
2026-03-30 07:46:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with scrape type 2
2026-03-30 07:46:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with scrape type 2
2026-03-30 07:46:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a11bc48-fb8a-5d65-996f-d1fe079ce862, identifier: HY48346
2026-03-30 07:46:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with identifier: HY48346
2026-03-30 07:46:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with identifier: HY48346
2026-03-30 07:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a11bc48-fb8a-5d65-996f-d1fe079ce862 with identifier: HY48346 to the API
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:50Z',
 'fuel_type': 'diesel',
 'id': '1a11bc48-fb8a-5d65-996f-d1fe079ce862',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY48346',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 271158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-31',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY48346%27 HTTP/1.1" 200 None
2026-03-30 07:46:08 [auto1.de] INFO: Saving data for HY48346: {'auction_closing_time': 1774886210.0, 'created_time': 1774552962.888026, 'last_price_update_time': 1774856768.254908}
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY48346') HTTP/1.1" 204 0
2026-03-30 07:46:08 [auto1.de] INFO: Found listing with ID: YL44466
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL44466%27 HTTP/1.1" 200 None
2026-03-30 07:46:08 [auto1.de] INFO: Scrape type for YL44466: 2
2026-03-30 07:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3ddbe9c-12e2-56af-b819-2ae2718752ef with identifier: YL44466
2026-03-30 07:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3ddbe9c-12e2-56af-b819-2ae2718752ef with scrape type 2
2026-03-30 07:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3ddbe9c-12e2-56af-b819-2ae2718752ef with scrape type 2
2026-03-30 07:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f3ddbe9c-12e2-56af-b819-2ae2718752ef, identifier: YL44466
2026-03-30 07:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f3ddbe9c-12e2-56af-b819-2ae2718752ef with identifier: YL44466
2026-03-30 07:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f3ddbe9c-12e2-56af-b819-2ae2718752ef with identifier: YL44466
2026-03-30 07:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f3ddbe9c-12e2-56af-b819-2ae2718752ef with identifier: YL44466 to the API
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:35Z',
 'fuel_type': 'diesel',
 'id': 'f3ddbe9c-12e2-56af-b819-2ae2718752ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL44466',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Tarraco',
 'odometer': 113273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-21',
 'seller_name': None,
 'title': 'Seat Tarraco 2.0 TDI Xcellence 4Drive',
 'transmission': 'automatic',
 'trim': 'Xcellence 4Drive',
 'year': 2020}
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL44466%27 HTTP/1.1" 200 None
2026-03-30 07:46:08 [auto1.de] INFO: Saving data for YL44466: {'auction_closing_time': 1774885715.0, 'created_time': 1774638742.244922, 'last_price_update_time': 1774856768.684017}
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL44466') HTTP/1.1" 204 0
2026-03-30 07:46:08 [auto1.de] INFO: Found listing with ID: KE01468
2026-03-30 07:46:08 [auto1.de] INFO: Found listing with ID: AW33862
2026-03-30 07:46:08 [auto1.de] INFO: Found listing with ID: PS82171
2026-03-30 07:46:08 [auto1.de] INFO: Found listing with ID: KF79768
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF79768%27 HTTP/1.1" 200 None
2026-03-30 07:46:08 [auto1.de] INFO: Scrape type for KF79768: 0
2026-03-30 07:46:08 [auto1.de] INFO: Found listing with ID: CX46071
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX46071%27 HTTP/1.1" 200 None
2026-03-30 07:46:08 [auto1.de] INFO: Scrape type for CX46071: 2
2026-03-30 07:46:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6925a86a-8f55-5bbb-beff-34d1f7ece30b with identifier: CX46071
2026-03-30 07:46:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6925a86a-8f55-5bbb-beff-34d1f7ece30b with scrape type 2
2026-03-30 07:46:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6925a86a-8f55-5bbb-beff-34d1f7ece30b with scrape type 2
2026-03-30 07:46:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6925a86a-8f55-5bbb-beff-34d1f7ece30b, identifier: CX46071
2026-03-30 07:46:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6925a86a-8f55-5bbb-beff-34d1f7ece30b with identifier: CX46071
2026-03-30 07:46:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6925a86a-8f55-5bbb-beff-34d1f7ece30b with identifier: CX46071
2026-03-30 07:46:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6925a86a-8f55-5bbb-beff-34d1f7ece30b with identifier: CX46071 to the API
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:59Z',
 'fuel_type': 'petrol',
 'id': '6925a86a-8f55-5bbb-beff-34d1f7ece30b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX46071',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 60158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-10',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX46071%27 HTTP/1.1" 200 None
2026-03-30 07:46:09 [auto1.de] INFO: Saving data for CX46071: {'auction_closing_time': 1774885919.0, 'created_time': 1774552773.781723, 'last_price_update_time': 1774856769.103817}
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX46071') HTTP/1.1" 204 0
2026-03-30 07:46:09 [auto1.de] INFO: Found listing with ID: YS99143
2026-03-30 07:46:09 [auto1.de] INFO: Found listing with ID: WB36208
2026-03-30 07:46:09 [auto1.de] INFO: Found listing with ID: PC54286
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC54286%27 HTTP/1.1" 200 None
2026-03-30 07:46:09 [auto1.de] INFO: Scrape type for PC54286: 0
2026-03-30 07:46:09 [auto1.de] INFO: Found listing with ID: WS03851
2026-03-30 07:46:09 [auto1.de] INFO: Found listing with ID: AA01467
2026-03-30 07:46:09 [auto1.de] INFO: Found listing with ID: LD03873
2026-03-30 07:46:09 [auto1.de] INFO: Found listing with ID: SZ50241
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ50241%27 HTTP/1.1" 200 None
2026-03-30 07:46:09 [auto1.de] INFO: Scrape type for SZ50241: 2
2026-03-30 07:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd89b4e-b205-536d-b25c-9a1722806857 with identifier: SZ50241
2026-03-30 07:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd89b4e-b205-536d-b25c-9a1722806857 with scrape type 2
2026-03-30 07:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd89b4e-b205-536d-b25c-9a1722806857 with scrape type 2
2026-03-30 07:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3fd89b4e-b205-536d-b25c-9a1722806857, identifier: SZ50241
2026-03-30 07:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3fd89b4e-b205-536d-b25c-9a1722806857 with identifier: SZ50241
2026-03-30 07:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3fd89b4e-b205-536d-b25c-9a1722806857 with identifier: SZ50241
2026-03-30 07:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3fd89b4e-b205-536d-b25c-9a1722806857 with identifier: SZ50241 to the API
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:02:24Z',
 'fuel_type': 'diesel',
 'id': '3fd89b4e-b205-536d-b25c-9a1722806857',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ50241',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 84033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-16',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ50241%27 HTTP/1.1" 200 None
2026-03-30 07:46:09 [auto1.de] INFO: Saving data for SZ50241: {'auction_closing_time': 1774882944.0, 'created_time': 1774002049.990893, 'last_price_update_time': 1774856769.703705}
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ50241') HTTP/1.1" 204 0
2026-03-30 07:46:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:46:09 [auto1.de] INFO: Found listing with ID: JB91178
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB91178%27 HTTP/1.1" 200 None
2026-03-30 07:46:09 [auto1.de] INFO: Scrape type for JB91178: 2
2026-03-30 07:46:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 004c02c5-a2b2-5d3a-8491-5476245a59a2 with identifier: JB91178
2026-03-30 07:46:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 004c02c5-a2b2-5d3a-8491-5476245a59a2 with scrape type 2
2026-03-30 07:46:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 004c02c5-a2b2-5d3a-8491-5476245a59a2 with scrape type 2
2026-03-30 07:46:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 004c02c5-a2b2-5d3a-8491-5476245a59a2, identifier: JB91178
2026-03-30 07:46:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 004c02c5-a2b2-5d3a-8491-5476245a59a2 with identifier: JB91178
2026-03-30 07:46:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 004c02c5-a2b2-5d3a-8491-5476245a59a2 with identifier: JB91178
2026-03-30 07:46:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 004c02c5-a2b2-5d3a-8491-5476245a59a2 with identifier: JB91178 to the API
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:01:56Z',
 'fuel_type': 'diesel',
 'id': '004c02c5-a2b2-5d3a-8491-5476245a59a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB91178',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 180523,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-17',
 'seller_name': None,
 'title': 'Audi A3 Limousine 1.6 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB91178%27 HTTP/1.1" 200 None
2026-03-30 07:46:10 [auto1.de] INFO: Saving data for JB91178: {'auction_closing_time': 1774882916.0, 'created_time': 1774639347.452663, 'last_price_update_time': 1774856770.115775}
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB91178') HTTP/1.1" 204 0
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: XT20233
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: TG47191
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG47191%27 HTTP/1.1" 200 None
2026-03-30 07:46:10 [auto1.de] INFO: Scrape type for TG47191: 0
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-30 07:46:10 [auto1.de] INFO: Scrape type for RW82332: 0
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-30 07:46:10 [auto1.de] INFO: Scrape type for RR13548: 0
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-30 07:46:10 [auto1.de] INFO: Channel: 24h | Page: 120 | totalHits: 8365 | hits on page: 40
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: RW82332
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW82332%27 HTTP/1.1" 200 None
2026-03-30 07:46:10 [auto1.de] INFO: Scrape type for RW82332: 0
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: RR13548
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR13548%27 HTTP/1.1" 200 None
2026-03-30 07:46:10 [auto1.de] INFO: Scrape type for RR13548: 0
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: TK34912
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: ZV10923
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV10923%27 HTTP/1.1" 200 None
2026-03-30 07:46:10 [auto1.de] INFO: Scrape type for ZV10923: 0
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: FJ71547
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: YN11150
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN11150%27 HTTP/1.1" 200 None
2026-03-30 07:46:10 [auto1.de] INFO: Scrape type for YN11150: 0
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: KF63031
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: LV55380
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55380%27 HTTP/1.1" 200 None
2026-03-30 07:46:10 [auto1.de] INFO: Scrape type for LV55380: 2
2026-03-30 07:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ebf8953-0047-5a6e-ba12-d74b94e9ac39 with identifier: LV55380
2026-03-30 07:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ebf8953-0047-5a6e-ba12-d74b94e9ac39 with scrape type 2
2026-03-30 07:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ebf8953-0047-5a6e-ba12-d74b94e9ac39 with scrape type 2
2026-03-30 07:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ebf8953-0047-5a6e-ba12-d74b94e9ac39, identifier: LV55380
2026-03-30 07:46:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ebf8953-0047-5a6e-ba12-d74b94e9ac39 with identifier: LV55380
2026-03-30 07:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ebf8953-0047-5a6e-ba12-d74b94e9ac39 with identifier: LV55380
2026-03-30 07:46:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ebf8953-0047-5a6e-ba12-d74b94e9ac39 with identifier: LV55380 to the API
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:41:58Z',
 'fuel_type': 'petrol',
 'id': '1ebf8953-0047-5a6e-ba12-d74b94e9ac39',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV55380',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 178499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-10',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 Kompressor T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55380%27 HTTP/1.1" 200 None
2026-03-30 07:46:10 [auto1.de] INFO: Saving data for LV55380: {'auction_closing_time': 1774885318.0, 'created_time': 1774639948.371277, 'last_price_update_time': 1774856770.759883}
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV55380') HTTP/1.1" 204 0
2026-03-30 07:46:10 [auto1.de] INFO: Found listing with ID: BS97689
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS97689%27 HTTP/1.1" 200 None
2026-03-30 07:46:10 [auto1.de] INFO: Scrape type for BS97689: 2
2026-03-30 07:46:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62ec313b-cc8a-52b6-addd-5f640dc1b627 with identifier: BS97689
2026-03-30 07:46:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62ec313b-cc8a-52b6-addd-5f640dc1b627 with scrape type 2
2026-03-30 07:46:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62ec313b-cc8a-52b6-addd-5f640dc1b627 with scrape type 2
2026-03-30 07:46:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62ec313b-cc8a-52b6-addd-5f640dc1b627, identifier: BS97689
2026-03-30 07:46:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62ec313b-cc8a-52b6-addd-5f640dc1b627 with identifier: BS97689
2026-03-30 07:46:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62ec313b-cc8a-52b6-addd-5f640dc1b627 with identifier: BS97689
2026-03-30 07:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62ec313b-cc8a-52b6-addd-5f640dc1b627 with identifier: BS97689 to the API
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:41:54Z',
 'fuel_type': 'petrol',
 'id': '62ec313b-cc8a-52b6-addd-5f640dc1b627',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS97689',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 34713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-16',
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2018}
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS97689%27 HTTP/1.1" 200 None
2026-03-30 07:46:11 [auto1.de] INFO: Saving data for BS97689: {'auction_closing_time': 1774885314.0, 'created_time': 1773382350.023387, 'last_price_update_time': 1774856771.279634}
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS97689') HTTP/1.1" 204 0
2026-03-30 07:46:11 [auto1.de] INFO: Found listing with ID: FZ03157
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ03157%27 HTTP/1.1" 200 None
2026-03-30 07:46:11 [auto1.de] INFO: Scrape type for FZ03157: 2
2026-03-30 07:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c68732c0-9e59-5627-8d54-63e07cf8ba22 with identifier: FZ03157
2026-03-30 07:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c68732c0-9e59-5627-8d54-63e07cf8ba22 with scrape type 2
2026-03-30 07:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c68732c0-9e59-5627-8d54-63e07cf8ba22 with scrape type 2
2026-03-30 07:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c68732c0-9e59-5627-8d54-63e07cf8ba22, identifier: FZ03157
2026-03-30 07:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c68732c0-9e59-5627-8d54-63e07cf8ba22 with identifier: FZ03157
2026-03-30 07:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c68732c0-9e59-5627-8d54-63e07cf8ba22 with identifier: FZ03157
2026-03-30 07:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c68732c0-9e59-5627-8d54-63e07cf8ba22 with identifier: FZ03157 to the API
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:06:08Z',
 'fuel_type': 'petrol',
 'id': 'c68732c0-9e59-5627-8d54-63e07cf8ba22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ03157',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 47119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-15',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2014}
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ03157%27 HTTP/1.1" 200 None
2026-03-30 07:46:11 [auto1.de] INFO: Saving data for FZ03157: {'auction_closing_time': 1774883168.0, 'created_time': 1774032267.181426, 'last_price_update_time': 1774856771.707889}
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FZ03157') HTTP/1.1" 204 0
2026-03-30 07:46:11 [auto1.de] INFO: Found listing with ID: HZ95747
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ95747%27 HTTP/1.1" 200 None
2026-03-30 07:46:11 [auto1.de] INFO: Scrape type for HZ95747: 2
2026-03-30 07:46:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d1076d0-9ae2-5c37-a2a2-2fcd59b4f51b with identifier: HZ95747
2026-03-30 07:46:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d1076d0-9ae2-5c37-a2a2-2fcd59b4f51b with scrape type 2
2026-03-30 07:46:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d1076d0-9ae2-5c37-a2a2-2fcd59b4f51b with scrape type 2
2026-03-30 07:46:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d1076d0-9ae2-5c37-a2a2-2fcd59b4f51b, identifier: HZ95747
2026-03-30 07:46:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d1076d0-9ae2-5c37-a2a2-2fcd59b4f51b with identifier: HZ95747
2026-03-30 07:46:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d1076d0-9ae2-5c37-a2a2-2fcd59b4f51b with identifier: HZ95747
2026-03-30 07:46:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d1076d0-9ae2-5c37-a2a2-2fcd59b4f51b with identifier: HZ95747 to the API
2026-03-30 07:46:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:43Z',
 'fuel_type': 'petrol',
 'id': '3d1076d0-9ae2-5c37-a2a2-2fcd59b4f51b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ95747',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 9550,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-10',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2023}
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ95747%27 HTTP/1.1" 200 None
2026-03-30 07:46:12 [auto1.de] INFO: Saving data for HZ95747: {'auction_closing_time': 1774885603.0, 'created_time': 1773946861.475358, 'last_price_update_time': 1774856772.132515}
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ95747') HTTP/1.1" 204 0
2026-03-30 07:46:12 [auto1.de] INFO: Found listing with ID: RJ73659
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ73659%27 HTTP/1.1" 200 None
2026-03-30 07:46:12 [auto1.de] INFO: Scrape type for RJ73659: 0
2026-03-30 07:46:12 [auto1.de] INFO: Found listing with ID: KF55313
2026-03-30 07:46:12 [auto1.de] INFO: Found listing with ID: EU22008
2026-03-30 07:46:12 [auto1.de] INFO: Found listing with ID: UW00779
2026-03-30 07:46:12 [auto1.de] INFO: Found listing with ID: HD43211
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD43211%27 HTTP/1.1" 200 None
2026-03-30 07:46:12 [auto1.de] INFO: Scrape type for HD43211: 0
2026-03-30 07:46:12 [auto1.de] INFO: Found listing with ID: KZ71563
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71563%27 HTTP/1.1" 200 None
2026-03-30 07:46:12 [auto1.de] INFO: Scrape type for KZ71563: 2
2026-03-30 07:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8bce661a-2b68-5fac-8189-71a1f003fde7 with identifier: KZ71563
2026-03-30 07:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8bce661a-2b68-5fac-8189-71a1f003fde7 with scrape type 2
2026-03-30 07:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8bce661a-2b68-5fac-8189-71a1f003fde7 with scrape type 2
2026-03-30 07:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8bce661a-2b68-5fac-8189-71a1f003fde7, identifier: KZ71563
2026-03-30 07:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8bce661a-2b68-5fac-8189-71a1f003fde7 with identifier: KZ71563
2026-03-30 07:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8bce661a-2b68-5fac-8189-71a1f003fde7 with identifier: KZ71563
2026-03-30 07:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8bce661a-2b68-5fac-8189-71a1f003fde7 with identifier: KZ71563 to the API
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:46:31Z',
 'fuel_type': 'diesel',
 'id': '8bce661a-2b68-5fac-8189-71a1f003fde7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ71563',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 122162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-02',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ71563%27 HTTP/1.1" 200 None
2026-03-30 07:46:12 [auto1.de] INFO: Saving data for KZ71563: {'auction_closing_time': 1774885591.0, 'created_time': 1773382165.132264, 'last_price_update_time': 1774856772.588786}
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KZ71563') HTTP/1.1" 204 0
2026-03-30 07:46:12 [auto1.de] INFO: Found listing with ID: BD76424
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD76424%27 HTTP/1.1" 200 None
2026-03-30 07:46:12 [auto1.de] INFO: Scrape type for BD76424: 0
2026-03-30 07:46:12 [auto1.de] INFO: Found listing with ID: SL45023
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL45023%27 HTTP/1.1" 200 None
2026-03-30 07:46:12 [auto1.de] INFO: Scrape type for SL45023: 2
2026-03-30 07:46:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f0e6a6f-e42c-51e4-8f13-696f9eed6804 with identifier: SL45023
2026-03-30 07:46:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f0e6a6f-e42c-51e4-8f13-696f9eed6804 with scrape type 2
2026-03-30 07:46:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f0e6a6f-e42c-51e4-8f13-696f9eed6804 with scrape type 2
2026-03-30 07:46:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f0e6a6f-e42c-51e4-8f13-696f9eed6804, identifier: SL45023
2026-03-30 07:46:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f0e6a6f-e42c-51e4-8f13-696f9eed6804 with identifier: SL45023
2026-03-30 07:46:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f0e6a6f-e42c-51e4-8f13-696f9eed6804 with identifier: SL45023
2026-03-30 07:46:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f0e6a6f-e42c-51e4-8f13-696f9eed6804 with identifier: SL45023 to the API
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:39:40Z',
 'fuel_type': 'petrol',
 'id': '7f0e6a6f-e42c-51e4-8f13-696f9eed6804',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL45023',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 78798,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-30',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL45023%27 HTTP/1.1" 200 None
2026-03-30 07:46:13 [auto1.de] INFO: Saving data for SL45023: {'auction_closing_time': 1774885180.0, 'created_time': 1774033776.948043, 'last_price_update_time': 1774856773.061764}
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SL45023') HTTP/1.1" 204 0
2026-03-30 07:46:13 [auto1.de] INFO: Found listing with ID: CE41516
2026-03-30 07:46:13 [auto1.de] INFO: Found listing with ID: LK80095
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK80095%27 HTTP/1.1" 200 None
2026-03-30 07:46:13 [auto1.de] INFO: Scrape type for LK80095: 2
2026-03-30 07:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d110aa1-5cdf-5bd5-9f7f-f6e9d7cfefc8 with identifier: LK80095
2026-03-30 07:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d110aa1-5cdf-5bd5-9f7f-f6e9d7cfefc8 with scrape type 2
2026-03-30 07:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d110aa1-5cdf-5bd5-9f7f-f6e9d7cfefc8 with scrape type 2
2026-03-30 07:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d110aa1-5cdf-5bd5-9f7f-f6e9d7cfefc8, identifier: LK80095
2026-03-30 07:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d110aa1-5cdf-5bd5-9f7f-f6e9d7cfefc8 with identifier: LK80095
2026-03-30 07:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d110aa1-5cdf-5bd5-9f7f-f6e9d7cfefc8 with identifier: LK80095
2026-03-30 07:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d110aa1-5cdf-5bd5-9f7f-f6e9d7cfefc8 with identifier: LK80095 to the API
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:26:32Z',
 'fuel_type': 'petrol',
 'id': '2d110aa1-5cdf-5bd5-9f7f-f6e9d7cfefc8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK80095',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 102596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2016}
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK80095%27 HTTP/1.1" 200 None
2026-03-30 07:46:13 [auto1.de] INFO: Saving data for LK80095: {'auction_closing_time': 1774884392.0, 'created_time': 1773917111.196755, 'last_price_update_time': 1774856773.689927}
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK80095') HTTP/1.1" 204 0
2026-03-30 07:46:13 [auto1.de] INFO: Found listing with ID: JT47484
2026-03-30 07:46:13 [auto1.de] INFO: Found listing with ID: YR75545
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75545%27 HTTP/1.1" 200 None
2026-03-30 07:46:13 [auto1.de] INFO: Scrape type for YR75545: 2
2026-03-30 07:46:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ee3c784-89f2-586e-9ac1-a109f407f367 with identifier: YR75545
2026-03-30 07:46:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ee3c784-89f2-586e-9ac1-a109f407f367 with scrape type 2
2026-03-30 07:46:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ee3c784-89f2-586e-9ac1-a109f407f367 with scrape type 2
2026-03-30 07:46:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ee3c784-89f2-586e-9ac1-a109f407f367, identifier: YR75545
2026-03-30 07:46:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:46:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ee3c784-89f2-586e-9ac1-a109f407f367 with identifier: YR75545
2026-03-30 07:46:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ee3c784-89f2-586e-9ac1-a109f407f367 with identifier: YR75545
2026-03-30 07:46:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ee3c784-89f2-586e-9ac1-a109f407f367 with identifier: YR75545 to the API
2026-03-30 07:46:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:57:42Z',
 'fuel_type': 'diesel',
 'id': '6ee3c784-89f2-586e-9ac1-a109f407f367',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR75545',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 133932,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 dCi Acenta 4x4',
 'transmission': 'manual',
 'trim': 'Acenta 4x4',
 'year': 2015}
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR75545%27 HTTP/1.1" 200 None
2026-03-30 07:46:14 [auto1.de] INFO: Saving data for YR75545: {'auction_closing_time': 1774886262.0, 'created_time': 1774638791.977952, 'last_price_update_time': 1774856774.143435}
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR75545') HTTP/1.1" 204 0
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: PW82194
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: CM30450
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM30450%27 HTTP/1.1" 200 None
2026-03-30 07:46:14 [auto1.de] INFO: Scrape type for CM30450: 0
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: HT39177
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: HA14963
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA14963%27 HTTP/1.1" 200 None
2026-03-30 07:46:14 [auto1.de] INFO: Scrape type for HA14963: 2
2026-03-30 07:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33aecad7-344f-520d-b2c6-d160220dad37 with identifier: HA14963
2026-03-30 07:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33aecad7-344f-520d-b2c6-d160220dad37 with scrape type 2
2026-03-30 07:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33aecad7-344f-520d-b2c6-d160220dad37 with scrape type 2
2026-03-30 07:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33aecad7-344f-520d-b2c6-d160220dad37, identifier: HA14963
2026-03-30 07:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33aecad7-344f-520d-b2c6-d160220dad37 with identifier: HA14963
2026-03-30 07:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33aecad7-344f-520d-b2c6-d160220dad37 with identifier: HA14963
2026-03-30 07:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33aecad7-344f-520d-b2c6-d160220dad37 with identifier: HA14963 to the API
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:50:29Z',
 'fuel_type': 'petrol',
 'id': '33aecad7-344f-520d-b2c6-d160220dad37',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA14963',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 82254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-21',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 SCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2020}
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA14963%27 HTTP/1.1" 200 None
2026-03-30 07:46:14 [auto1.de] INFO: Saving data for HA14963: {'auction_closing_time': 1774885829.0, 'created_time': 1774552681.494288, 'last_price_update_time': 1774856774.680953}
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA14963') HTTP/1.1" 204 0
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: GK41748
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: UB19206
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: UA25928
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA25928%27 HTTP/1.1" 200 None
2026-03-30 07:46:14 [auto1.de] INFO: Scrape type for UA25928: 0
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: XA88514
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: GT24864
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT24864%27 HTTP/1.1" 200 None
2026-03-30 07:46:14 [auto1.de] INFO: Scrape type for GT24864: 0
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: GX32204
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX32204%27 HTTP/1.1" 200 None
2026-03-30 07:46:14 [auto1.de] INFO: Scrape type for GX32204: 0
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: VE54720
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: YA52648
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: BP38143
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP38143%27 HTTP/1.1" 200 None
2026-03-30 07:46:14 [auto1.de] INFO: Scrape type for BP38143: 0
2026-03-30 07:46:14 [auto1.de] INFO: Found listing with ID: HB57575
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB57575%27 HTTP/1.1" 200 None
2026-03-30 07:46:14 [auto1.de] INFO: Scrape type for HB57575: 2
2026-03-30 07:46:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6db95980-fbde-50c9-8789-e7cdebd4bec7 with identifier: HB57575
2026-03-30 07:46:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6db95980-fbde-50c9-8789-e7cdebd4bec7 with scrape type 2
2026-03-30 07:46:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6db95980-fbde-50c9-8789-e7cdebd4bec7 with scrape type 2
2026-03-30 07:46:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6db95980-fbde-50c9-8789-e7cdebd4bec7, identifier: HB57575
2026-03-30 07:46:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6db95980-fbde-50c9-8789-e7cdebd4bec7 with identifier: HB57575
2026-03-30 07:46:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6db95980-fbde-50c9-8789-e7cdebd4bec7 with identifier: HB57575
2026-03-30 07:46:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6db95980-fbde-50c9-8789-e7cdebd4bec7 with identifier: HB57575 to the API
2026-03-30 07:46:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:24:18Z',
 'fuel_type': 'petrol',
 'id': '6db95980-fbde-50c9-8789-e7cdebd4bec7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB57575',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 163885,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 400 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2018}
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB57575%27 HTTP/1.1" 200 None
2026-03-30 07:46:15 [auto1.de] INFO: Saving data for HB57575: {'auction_closing_time': 1774884258.0, 'created_time': 1774552751.292162, 'last_price_update_time': 1774856775.262825}
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HB57575') HTTP/1.1" 204 0
2026-03-30 07:46:15 [auto1.de] INFO: Channel: 24h | Page: 121 | totalHits: 8366 | hits on page: 40
2026-03-30 07:46:15 [auto1.de] INFO: Found listing with ID: GG65874
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG65874%27 HTTP/1.1" 200 None
2026-03-30 07:46:15 [auto1.de] INFO: Scrape type for GG65874: 2
2026-03-30 07:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f5aad3a-cb37-55a8-adea-92d18b248b55 with identifier: GG65874
2026-03-30 07:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f5aad3a-cb37-55a8-adea-92d18b248b55 with scrape type 2
2026-03-30 07:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f5aad3a-cb37-55a8-adea-92d18b248b55 with scrape type 2
2026-03-30 07:46:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0f5aad3a-cb37-55a8-adea-92d18b248b55, identifier: GG65874
2026-03-30 07:46:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0f5aad3a-cb37-55a8-adea-92d18b248b55 with identifier: GG65874
2026-03-30 07:46:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0f5aad3a-cb37-55a8-adea-92d18b248b55 with identifier: GG65874
2026-03-30 07:46:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0f5aad3a-cb37-55a8-adea-92d18b248b55 with identifier: GG65874 to the API
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:47:30Z',
 'fuel_type': 'petrol',
 'id': '0f5aad3a-cb37-55a8-adea-92d18b248b55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG65874',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 120396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-16',
 'seller_name': None,
 'title': 'BMW Z4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG65874%27 HTTP/1.1" 200 None
2026-03-30 07:46:15 [auto1.de] INFO: Saving data for GG65874: {'auction_closing_time': 1774885650.0, 'created_time': 1774551197.940669, 'last_price_update_time': 1774856775.853257}
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GG65874') HTTP/1.1" 204 0
2026-03-30 07:46:15 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-30 07:46:15 [auto1.de] INFO: Found listing with ID: JU23189
2026-03-30 07:46:15 [auto1.de] INFO: Found listing with ID: TB15164
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB15164%27 HTTP/1.1" 200 None
2026-03-30 07:46:15 [auto1.de] INFO: Scrape type for TB15164: 0
2026-03-30 07:46:15 [auto1.de] INFO: Found listing with ID: ZA93244
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA93244%27 HTTP/1.1" 200 None
2026-03-30 07:46:15 [auto1.de] INFO: Scrape type for ZA93244: 0
2026-03-30 07:46:15 [auto1.de] INFO: Found listing with ID: WM92203
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM92203%27 HTTP/1.1" 200 None
2026-03-30 07:46:15 [auto1.de] INFO: Scrape type for WM92203: 2
2026-03-30 07:46:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba2c9389-8b6a-5fbe-8194-41916f8ca864 with identifier: WM92203
2026-03-30 07:46:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba2c9389-8b6a-5fbe-8194-41916f8ca864 with scrape type 2
2026-03-30 07:46:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba2c9389-8b6a-5fbe-8194-41916f8ca864 with scrape type 2
2026-03-30 07:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba2c9389-8b6a-5fbe-8194-41916f8ca864, identifier: WM92203
2026-03-30 07:46:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:16 [auto1.de] INFO: Found listing with ID: UF58190
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF58190%27 HTTP/1.1" 200 None
2026-03-30 07:46:16 [auto1.de] INFO: Scrape type for UF58190: 2
2026-03-30 07:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec5b876d-0c83-5e2e-b6b4-9cb39d6f4dab with identifier: UF58190
2026-03-30 07:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec5b876d-0c83-5e2e-b6b4-9cb39d6f4dab with scrape type 2
2026-03-30 07:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec5b876d-0c83-5e2e-b6b4-9cb39d6f4dab with scrape type 2
2026-03-30 07:46:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec5b876d-0c83-5e2e-b6b4-9cb39d6f4dab, identifier: UF58190
2026-03-30 07:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba2c9389-8b6a-5fbe-8194-41916f8ca864 with identifier: WM92203
2026-03-30 07:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba2c9389-8b6a-5fbe-8194-41916f8ca864 with identifier: WM92203
2026-03-30 07:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba2c9389-8b6a-5fbe-8194-41916f8ca864 with identifier: WM92203 to the API
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:59:50Z',
 'fuel_type': 'diesel',
 'id': 'ba2c9389-8b6a-5fbe-8194-41916f8ca864',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM92203',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 232556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-28',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM92203%27 HTTP/1.1" 200 None
2026-03-30 07:46:16 [auto1.de] INFO: Saving data for WM92203: {'auction_closing_time': 1774886390.0, 'created_time': 1774638692.421895, 'last_price_update_time': 1774856776.599385}
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WM92203') HTTP/1.1" 204 0
2026-03-30 07:46:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec5b876d-0c83-5e2e-b6b4-9cb39d6f4dab with identifier: UF58190
2026-03-30 07:46:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec5b876d-0c83-5e2e-b6b4-9cb39d6f4dab with identifier: UF58190
2026-03-30 07:46:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec5b876d-0c83-5e2e-b6b4-9cb39d6f4dab with identifier: UF58190 to the API
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:17:19Z',
 'fuel_type': 'diesel',
 'id': 'ec5b876d-0c83-5e2e-b6b4-9cb39d6f4dab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF58190',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 129127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-05',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2016}
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF58190%27 HTTP/1.1" 200 None
2026-03-30 07:46:16 [auto1.de] INFO: Saving data for UF58190: {'auction_closing_time': 1774883839.0, 'created_time': 1773341486.125683, 'last_price_update_time': 1774856776.933483}
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UF58190') HTTP/1.1" 204 0
2026-03-30 07:46:16 [auto1.de] INFO: Found listing with ID: AL15511
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL15511%27 HTTP/1.1" 200 None
2026-03-30 07:46:16 [auto1.de] INFO: Scrape type for AL15511: 2
2026-03-30 07:46:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e673b971-1cb2-594a-8be4-55a5dff16a52 with identifier: AL15511
2026-03-30 07:46:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e673b971-1cb2-594a-8be4-55a5dff16a52 with scrape type 2
2026-03-30 07:46:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e673b971-1cb2-594a-8be4-55a5dff16a52 with scrape type 2
2026-03-30 07:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e673b971-1cb2-594a-8be4-55a5dff16a52, identifier: AL15511
2026-03-30 07:46:17 [auto1.de] INFO: Found listing with ID: FP35448
2026-03-30 07:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e673b971-1cb2-594a-8be4-55a5dff16a52 with identifier: AL15511
2026-03-30 07:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e673b971-1cb2-594a-8be4-55a5dff16a52 with identifier: AL15511
2026-03-30 07:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e673b971-1cb2-594a-8be4-55a5dff16a52 with identifier: AL15511 to the API
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:03:16Z',
 'fuel_type': 'petrol',
 'id': 'e673b971-1cb2-594a-8be4-55a5dff16a52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL15511',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 74959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-29',
 'seller_name': None,
 'title': 'Nissan Juke 1.2 N-WAY',
 'transmission': 'manual',
 'trim': 'N-WAY',
 'year': 2017}
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL15511%27 HTTP/1.1" 200 None
2026-03-30 07:46:17 [auto1.de] INFO: Saving data for AL15511: {'auction_closing_time': 1774882996.0, 'created_time': 1773946045.192269, 'last_price_update_time': 1774856777.430801}
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL15511') HTTP/1.1" 204 0
2026-03-30 07:46:17 [auto1.de] INFO: Found listing with ID: RV42869
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV42869%27 HTTP/1.1" 200 None
2026-03-30 07:46:17 [auto1.de] INFO: Scrape type for RV42869: 2
2026-03-30 07:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 612f3bfb-454d-516e-9be7-b3f853964e12 with identifier: RV42869
2026-03-30 07:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 612f3bfb-454d-516e-9be7-b3f853964e12 with scrape type 2
2026-03-30 07:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 612f3bfb-454d-516e-9be7-b3f853964e12 with scrape type 2
2026-03-30 07:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 612f3bfb-454d-516e-9be7-b3f853964e12, identifier: RV42869
2026-03-30 07:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 612f3bfb-454d-516e-9be7-b3f853964e12 with identifier: RV42869
2026-03-30 07:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 612f3bfb-454d-516e-9be7-b3f853964e12 with identifier: RV42869
2026-03-30 07:46:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 612f3bfb-454d-516e-9be7-b3f853964e12 with identifier: RV42869 to the API
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:27:58Z',
 'fuel_type': 'petrol',
 'id': '612f3bfb-454d-516e-9be7-b3f853964e12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV42869',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 85378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-01',
 'seller_name': None,
 'title': 'Kia Venga 1.4 Basic',
 'transmission': 'manual',
 'trim': 'Basic',
 'year': 2017}
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV42869%27 HTTP/1.1" 200 None
2026-03-30 07:46:17 [auto1.de] INFO: Saving data for RV42869: {'auction_closing_time': 1774884478.0, 'created_time': 1774640083.378077, 'last_price_update_time': 1774856777.841429}
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV42869') HTTP/1.1" 204 0
2026-03-30 07:46:17 [auto1.de] INFO: Found listing with ID: CN06101
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN06101%27 HTTP/1.1" 200 None
2026-03-30 07:46:17 [auto1.de] INFO: Scrape type for CN06101: 2
2026-03-30 07:46:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with identifier: CN06101
2026-03-30 07:46:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with scrape type 2
2026-03-30 07:46:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with scrape type 2
2026-03-30 07:46:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23880b12-cb0a-5eb7-a05a-fd00bb3fd703, identifier: CN06101
2026-03-30 07:46:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with identifier: CN06101
2026-03-30 07:46:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with identifier: CN06101
2026-03-30 07:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23880b12-cb0a-5eb7-a05a-fd00bb3fd703 with identifier: CN06101 to the API
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:27:57Z',
 'fuel_type': 'diesel',
 'id': '23880b12-cb0a-5eb7-a05a-fd00bb3fd703',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN06101',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 98342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-20',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2015}
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN06101%27 HTTP/1.1" 200 None
2026-03-30 07:46:18 [auto1.de] INFO: Saving data for CN06101: {'auction_closing_time': 1774884477.0, 'created_time': 1774552929.887914, 'last_price_update_time': 1774856778.262476}
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN06101') HTTP/1.1" 204 0
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: NK87306
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK87306%27 HTTP/1.1" 200 None
2026-03-30 07:46:18 [auto1.de] INFO: Scrape type for NK87306: 0
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: PC18756
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: YT48598
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: PS82435
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS82435%27 HTTP/1.1" 200 None
2026-03-30 07:46:18 [auto1.de] INFO: Scrape type for PS82435: 0
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: DG36538
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG36538%27 HTTP/1.1" 200 None
2026-03-30 07:46:18 [auto1.de] INFO: Scrape type for DG36538: 2
2026-03-30 07:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with identifier: DG36538
2026-03-30 07:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with scrape type 2
2026-03-30 07:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with scrape type 2
2026-03-30 07:46:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8, identifier: DG36538
2026-03-30 07:46:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with identifier: DG36538
2026-03-30 07:46:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with identifier: DG36538
2026-03-30 07:46:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8 with identifier: DG36538 to the API
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:31:16Z',
 'fuel_type': 'diesel',
 'id': '82ad7f8a-b2d5-55fa-b2e6-70d5016db3a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG36538',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'X-Klasse',
 'odometer': 78601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-07',
 'seller_name': None,
 'title': 'Mercedes-Benz X-Klasse X 250 d 4Matic Doppelkabine Edition Power',
 'transmission': 'automatic',
 'trim': '4Matic Doppelkabine Edition Power',
 'year': 2017}
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG36538%27 HTTP/1.1" 200 None
2026-03-30 07:46:18 [auto1.de] INFO: Saving data for DG36538: {'auction_closing_time': 1774884676.0, 'created_time': 1773945727.376646, 'last_price_update_time': 1774856778.80788}
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG36538') HTTP/1.1" 204 0
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: KG20268
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG20268%27 HTTP/1.1" 200 None
2026-03-30 07:46:18 [auto1.de] INFO: Scrape type for KG20268: 0
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: FC76019
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: UZ90215
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ90215%27 HTTP/1.1" 200 None
2026-03-30 07:46:18 [auto1.de] INFO: Scrape type for UZ90215: 0
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: CK93777
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: ET07412
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: TX61544
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: XC17243
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: BL84965
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: MA73958
2026-03-30 07:46:18 [auto1.de] INFO: Found listing with ID: HU93536
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU93536%27 HTTP/1.1" 200 None
2026-03-30 07:46:18 [auto1.de] INFO: Scrape type for HU93536: 2
2026-03-30 07:46:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d454de6-0994-5e6a-888d-5748d3ad96ad with identifier: HU93536
2026-03-30 07:46:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d454de6-0994-5e6a-888d-5748d3ad96ad with scrape type 2
2026-03-30 07:46:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d454de6-0994-5e6a-888d-5748d3ad96ad with scrape type 2
2026-03-30 07:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d454de6-0994-5e6a-888d-5748d3ad96ad, identifier: HU93536
2026-03-30 07:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d454de6-0994-5e6a-888d-5748d3ad96ad with identifier: HU93536
2026-03-30 07:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d454de6-0994-5e6a-888d-5748d3ad96ad with identifier: HU93536
2026-03-30 07:46:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d454de6-0994-5e6a-888d-5748d3ad96ad with identifier: HU93536 to the API
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 84,
 'expiration_date': '2026-03-30T15:27:11Z',
 'fuel_type': 'petrol',
 'id': '9d454de6-0994-5e6a-888d-5748d3ad96ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU93536',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 20869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-06-06',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 Prime',
 'transmission': 'manual',
 'trim': 'Prime',
 'year': 2024}
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU93536%27 HTTP/1.1" 200 None
2026-03-30 07:46:19 [auto1.de] INFO: Saving data for HU93536: {'auction_closing_time': 1774884431.0, 'created_time': 1774552969.211319, 'last_price_update_time': 1774856779.273028}
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU93536') HTTP/1.1" 204 0
2026-03-30 07:46:19 [auto1.de] INFO: Found listing with ID: ZT89022
2026-03-30 07:46:19 [auto1.de] INFO: Found listing with ID: GF09029
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09029%27 HTTP/1.1" 200 None
2026-03-30 07:46:19 [auto1.de] INFO: Scrape type for GF09029: 2
2026-03-30 07:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c8b257e-29d7-57cc-9fb2-1922b73075cd with identifier: GF09029
2026-03-30 07:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c8b257e-29d7-57cc-9fb2-1922b73075cd with scrape type 2
2026-03-30 07:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c8b257e-29d7-57cc-9fb2-1922b73075cd with scrape type 2
2026-03-30 07:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c8b257e-29d7-57cc-9fb2-1922b73075cd, identifier: GF09029
2026-03-30 07:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c8b257e-29d7-57cc-9fb2-1922b73075cd with identifier: GF09029
2026-03-30 07:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c8b257e-29d7-57cc-9fb2-1922b73075cd with identifier: GF09029
2026-03-30 07:46:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c8b257e-29d7-57cc-9fb2-1922b73075cd with identifier: GF09029 to the API
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:45:17Z',
 'fuel_type': 'diesel',
 'id': '8c8b257e-29d7-57cc-9fb2-1922b73075cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF09029',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 182986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-14',
 'seller_name': None,
 'title': 'Mazda 6 2.2 Turbodiesel Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2016}
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF09029%27 HTTP/1.1" 200 None
2026-03-30 07:46:19 [auto1.de] INFO: Saving data for GF09029: {'auction_closing_time': 1774885517.0, 'created_time': 1774639488.43343, 'last_price_update_time': 1774856779.812666}
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GF09029') HTTP/1.1" 204 0
2026-03-30 07:46:19 [auto1.de] INFO: Found listing with ID: JC65588
2026-03-30 07:46:19 [auto1.de] INFO: Found listing with ID: AE03495
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE03495%27 HTTP/1.1" 200 None
2026-03-30 07:46:19 [auto1.de] INFO: Scrape type for AE03495: 0
2026-03-30 07:46:19 [auto1.de] INFO: Found listing with ID: ZH21180
2026-03-30 07:46:19 [auto1.de] INFO: Found listing with ID: PZ10151
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ10151%27 HTTP/1.1" 200 None
2026-03-30 07:46:19 [auto1.de] INFO: Scrape type for PZ10151: 2
2026-03-30 07:46:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a399f08-9648-5cda-9af2-470873ccf610 with identifier: PZ10151
2026-03-30 07:46:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a399f08-9648-5cda-9af2-470873ccf610 with scrape type 2
2026-03-30 07:46:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a399f08-9648-5cda-9af2-470873ccf610 with scrape type 2
2026-03-30 07:46:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a399f08-9648-5cda-9af2-470873ccf610, identifier: PZ10151
2026-03-30 07:46:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a399f08-9648-5cda-9af2-470873ccf610 with identifier: PZ10151
2026-03-30 07:46:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a399f08-9648-5cda-9af2-470873ccf610 with identifier: PZ10151
2026-03-30 07:46:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a399f08-9648-5cda-9af2-470873ccf610 with identifier: PZ10151 to the API
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:59:29Z',
 'fuel_type': 'petrol',
 'id': '0a399f08-9648-5cda-9af2-470873ccf610',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PZ10151',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Venga',
 'odometer': 76423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seller_name': None,
 'title': 'Kia Venga 1.6 Spirit',
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2012}
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ10151%27 HTTP/1.1" 200 None
2026-03-30 07:46:20 [auto1.de] INFO: Saving data for PZ10151: {'auction_closing_time': 1774886369.0, 'created_time': 1774639262.734386, 'last_price_update_time': 1774856780.233616}
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PZ10151') HTTP/1.1" 204 0
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: LT21646
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: DE69910
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: EC25925
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: BP24575
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP24575%27 HTTP/1.1" 200 None
2026-03-30 07:46:20 [auto1.de] INFO: Scrape type for BP24575: 0
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: MD20057
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22593%27 HTTP/1.1" 200 None
2026-03-30 07:46:20 [auto1.de] INFO: Scrape type for VY22593: 2
2026-03-30 07:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with identifier: VY22593
2026-03-30 07:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with scrape type 2
2026-03-30 07:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with scrape type 2
2026-03-30 07:46:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 708702a3-c4b3-5990-ba1f-c7e1ba6827a5, identifier: VY22593
2026-03-30 07:46:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with identifier: VY22593
2026-03-30 07:46:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with identifier: VY22593
2026-03-30 07:46:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 708702a3-c4b3-5990-ba1f-c7e1ba6827a5 with identifier: VY22593 to the API
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:50:23Z',
 'fuel_type': 'petrol',
 'id': '708702a3-c4b3-5990-ba1f-c7e1ba6827a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VY22593',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 104507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-15',
 'seller_name': None,
 'title': 'Dacia Duster 1.3 TCe Prestige',
 'transmission': 'manual',
 'trim': 'Prestige',
 'year': 2019}
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22593%27 HTTP/1.1" 200 None
2026-03-30 07:46:20 [auto1.de] INFO: Saving data for VY22593: {'auction_closing_time': 1774885823.0, 'created_time': 1774552729.226329, 'last_price_update_time': 1774856780.667676}
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VY22593') HTTP/1.1" 204 0
2026-03-30 07:46:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:46:20 [auto1.de] INFO: Channel: 24h | Page: 122 | totalHits: 8372 | hits on page: 40
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: FL94183
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: UW39505
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: EU24195
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: NT60185
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: NT27020
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: VY22593
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY22593%27 HTTP/1.1" 200 None
2026-03-30 07:46:20 [auto1.de] INFO: Scrape type for VY22593: 0
2026-03-30 07:46:20 [auto1.de] INFO: Found listing with ID: LG87332
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG87332%27 HTTP/1.1" 200 None
2026-03-30 07:46:20 [auto1.de] INFO: Scrape type for LG87332: 2
2026-03-30 07:46:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b3080bf-d70a-503e-88ed-39fd5b18bcb8 with identifier: LG87332
2026-03-30 07:46:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b3080bf-d70a-503e-88ed-39fd5b18bcb8 with scrape type 2
2026-03-30 07:46:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b3080bf-d70a-503e-88ed-39fd5b18bcb8 with scrape type 2
2026-03-30 07:46:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b3080bf-d70a-503e-88ed-39fd5b18bcb8, identifier: LG87332
2026-03-30 07:46:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b3080bf-d70a-503e-88ed-39fd5b18bcb8 with identifier: LG87332
2026-03-30 07:46:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b3080bf-d70a-503e-88ed-39fd5b18bcb8 with identifier: LG87332
2026-03-30 07:46:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b3080bf-d70a-503e-88ed-39fd5b18bcb8 with identifier: LG87332 to the API
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:12:53Z',
 'fuel_type': 'petrol',
 'id': '1b3080bf-d70a-503e-88ed-39fd5b18bcb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG87332',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 78453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-13',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG87332%27 HTTP/1.1" 200 None
2026-03-30 07:46:21 [auto1.de] INFO: Saving data for LG87332: {'auction_closing_time': 1774883573.0, 'created_time': 1774639732.738153, 'last_price_update_time': 1774856781.403834}
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG87332') HTTP/1.1" 204 0
2026-03-30 07:46:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: MS65923
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: SW77788
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW77788%27 HTTP/1.1" 200 None
2026-03-30 07:46:21 [auto1.de] INFO: Scrape type for SW77788: 0
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: RT01969
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: SX60280
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: TU96815
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: PE09652
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: LW42175
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: ZV29308
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: XT42199
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT42199%27 HTTP/1.1" 200 None
2026-03-30 07:46:21 [auto1.de] INFO: Scrape type for XT42199: 0
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: DE42625
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: RC01446
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: HF86895
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: PD67762
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: SA50642
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: JA64656
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA64656%27 HTTP/1.1" 200 None
2026-03-30 07:46:21 [auto1.de] INFO: Scrape type for JA64656: 0
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: RM72626
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM72626%27 HTTP/1.1" 200 None
2026-03-30 07:46:21 [auto1.de] INFO: Scrape type for RM72626: 0
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: HR57506
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: XS43563
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS43563%27 HTTP/1.1" 200 None
2026-03-30 07:46:21 [auto1.de] INFO: Scrape type for XS43563: 0
2026-03-30 07:46:21 [auto1.de] INFO: Found listing with ID: VB65040
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB65040%27 HTTP/1.1" 200 None
2026-03-30 07:46:21 [auto1.de] INFO: Scrape type for VB65040: 2
2026-03-30 07:46:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41f8791-0f40-54a8-b31c-d5d9eed6917a with identifier: VB65040
2026-03-30 07:46:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41f8791-0f40-54a8-b31c-d5d9eed6917a with scrape type 2
2026-03-30 07:46:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41f8791-0f40-54a8-b31c-d5d9eed6917a with scrape type 2
2026-03-30 07:46:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a41f8791-0f40-54a8-b31c-d5d9eed6917a, identifier: VB65040
2026-03-30 07:46:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a41f8791-0f40-54a8-b31c-d5d9eed6917a with identifier: VB65040
2026-03-30 07:46:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a41f8791-0f40-54a8-b31c-d5d9eed6917a with identifier: VB65040
2026-03-30 07:46:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a41f8791-0f40-54a8-b31c-d5d9eed6917a with identifier: VB65040 to the API
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:21:19Z',
 'fuel_type': 'petrol',
 'id': 'a41f8791-0f40-54a8-b31c-d5d9eed6917a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB65040',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 178273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-02',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2011}
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB65040%27 HTTP/1.1" 200 None
2026-03-30 07:46:21 [auto1.de] INFO: Saving data for VB65040: {'auction_closing_time': 1774884079.0, 'created_time': 1774638582.844238, 'last_price_update_time': 1774856781.90285}
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB65040') HTTP/1.1" 204 0
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: GM47642
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: TT29598
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: XM87462
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: UH95210
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH95210%27 HTTP/1.1" 200 None
2026-03-30 07:46:22 [auto1.de] INFO: Scrape type for UH95210: 0
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: DR69108
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR69108%27 HTTP/1.1" 200 None
2026-03-30 07:46:22 [auto1.de] INFO: Scrape type for DR69108: 2
2026-03-30 07:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6fa1336-9a31-551d-9153-3440f651a5cf with identifier: DR69108
2026-03-30 07:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6fa1336-9a31-551d-9153-3440f651a5cf with scrape type 2
2026-03-30 07:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6fa1336-9a31-551d-9153-3440f651a5cf with scrape type 2
2026-03-30 07:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6fa1336-9a31-551d-9153-3440f651a5cf, identifier: DR69108
2026-03-30 07:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6fa1336-9a31-551d-9153-3440f651a5cf with identifier: DR69108
2026-03-30 07:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6fa1336-9a31-551d-9153-3440f651a5cf with identifier: DR69108
2026-03-30 07:46:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6fa1336-9a31-551d-9153-3440f651a5cf with identifier: DR69108 to the API
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 431,
 'expiration_date': '2026-03-30T15:52:14Z',
 'fuel_type': 'petrol',
 'id': 'a6fa1336-9a31-551d-9153-3440f651a5cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR69108',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 113381,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-21',
 'seller_name': None,
 'title': 'BMW 4er M4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR69108%27 HTTP/1.1" 200 None
2026-03-30 07:46:22 [auto1.de] INFO: Saving data for DR69108: {'auction_closing_time': 1774885934.0, 'created_time': 1774640124.450769, 'last_price_update_time': 1774856782.429458}
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR69108') HTTP/1.1" 204 0
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: XA78994
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: GT81151
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT81151%27 HTTP/1.1" 200 None
2026-03-30 07:46:22 [auto1.de] INFO: Scrape type for GT81151: 0
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: GR47170
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: MJ48017
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ48017%27 HTTP/1.1" 200 None
2026-03-30 07:46:22 [auto1.de] INFO: Scrape type for MJ48017: 0
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: FE02336
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE02336%27 HTTP/1.1" 200 None
2026-03-30 07:46:22 [auto1.de] INFO: Scrape type for FE02336: 2
2026-03-30 07:46:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3eb4e22e-1f80-5bcf-b0bb-ee99c70be734 with identifier: FE02336
2026-03-30 07:46:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3eb4e22e-1f80-5bcf-b0bb-ee99c70be734 with scrape type 2
2026-03-30 07:46:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3eb4e22e-1f80-5bcf-b0bb-ee99c70be734 with scrape type 2
2026-03-30 07:46:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3eb4e22e-1f80-5bcf-b0bb-ee99c70be734, identifier: FE02336
2026-03-30 07:46:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3eb4e22e-1f80-5bcf-b0bb-ee99c70be734 with identifier: FE02336
2026-03-30 07:46:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3eb4e22e-1f80-5bcf-b0bb-ee99c70be734 with identifier: FE02336
2026-03-30 07:46:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3eb4e22e-1f80-5bcf-b0bb-ee99c70be734 with identifier: FE02336 to the API
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:23:25Z',
 'fuel_type': 'petrol',
 'id': '3eb4e22e-1f80-5bcf-b0bb-ee99c70be734',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE02336',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 143579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-27',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE02336%27 HTTP/1.1" 200 None
2026-03-30 07:46:22 [auto1.de] INFO: Saving data for FE02336: {'auction_closing_time': 1774884205.0, 'created_time': 1773917485.368649, 'last_price_update_time': 1774856782.869241}
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE02336') HTTP/1.1" 204 0
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: XJ41164
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-30 07:46:22 [auto1.de] INFO: Scrape type for MG94250: 0
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-30 07:46:22 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-30 07:46:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:46:24 [auto1.de] INFO: Channel: 24h | Page: 123 | totalHits: 8375 | hits on page: 40
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: MG94250
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG94250%27 HTTP/1.1" 200 None
2026-03-30 07:46:24 [auto1.de] INFO: Scrape type for MG94250: 0
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: BP25717
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: ZU26768
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: EV16310
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: WY50378
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: WE11389
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: CK35752
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: CH51511
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CH51511%27 HTTP/1.1" 200 None
2026-03-30 07:46:24 [auto1.de] INFO: Scrape type for CH51511: 0
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: FG55582
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG55582%27 HTTP/1.1" 200 None
2026-03-30 07:46:24 [auto1.de] INFO: Scrape type for FG55582: 0
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: YK99785
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK99785%27 HTTP/1.1" 200 None
2026-03-30 07:46:24 [auto1.de] INFO: Scrape type for YK99785: 0
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: DD29565
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: MW86631
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: PK93112
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: GE71981
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE71981%27 HTTP/1.1" 200 None
2026-03-30 07:46:24 [auto1.de] INFO: Scrape type for GE71981: 0
2026-03-30 07:46:24 [auto1.de] INFO: Found listing with ID: GR34047
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR34047%27 HTTP/1.1" 200 None
2026-03-30 07:46:24 [auto1.de] INFO: Scrape type for GR34047: 2
2026-03-30 07:46:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d156322-e285-59e0-b90c-daf97bceaba4 with identifier: GR34047
2026-03-30 07:46:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d156322-e285-59e0-b90c-daf97bceaba4 with scrape type 2
2026-03-30 07:46:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d156322-e285-59e0-b90c-daf97bceaba4 with scrape type 2
2026-03-30 07:46:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d156322-e285-59e0-b90c-daf97bceaba4, identifier: GR34047
2026-03-30 07:46:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d156322-e285-59e0-b90c-daf97bceaba4 with identifier: GR34047
2026-03-30 07:46:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d156322-e285-59e0-b90c-daf97bceaba4 with identifier: GR34047
2026-03-30 07:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d156322-e285-59e0-b90c-daf97bceaba4 with identifier: GR34047 to the API
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 212,
 'expiration_date': '2026-03-30T15:01:55Z',
 'fuel_type': 'diesel',
 'id': '6d156322-e285-59e0-b90c-daf97bceaba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR34047',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 132412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-20',
 'seller_name': None,
 'title': 'Ford Ranger 2.0 TDCi Doppelkabine 4x4 Raptor',
 'transmission': 'automatic',
 'trim': 'Doppelkabine 4x4 Raptor',
 'year': 2022}
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR34047%27 HTTP/1.1" 200 None
2026-03-30 07:46:25 [auto1.de] INFO: Saving data for GR34047: {'auction_closing_time': 1774882915.0, 'created_time': 1774637112.018445, 'last_price_update_time': 1774856785.247405}
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR34047') HTTP/1.1" 204 0
2026-03-30 07:46:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:25 [auto1.de] INFO: Found listing with ID: YT53234
2026-03-30 07:46:25 [auto1.de] INFO: Found listing with ID: PF97511
2026-03-30 07:46:25 [auto1.de] INFO: Found listing with ID: WS02654
2026-03-30 07:46:25 [auto1.de] INFO: Found listing with ID: KB32538
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB32538%27 HTTP/1.1" 200 None
2026-03-30 07:46:25 [auto1.de] INFO: Scrape type for KB32538: 0
2026-03-30 07:46:25 [auto1.de] INFO: Found listing with ID: FR65686
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR65686%27 HTTP/1.1" 200 None
2026-03-30 07:46:25 [auto1.de] INFO: Scrape type for FR65686: 2
2026-03-30 07:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a829c22-b622-5a1a-b2cc-fe4f55a07d2f with identifier: FR65686
2026-03-30 07:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a829c22-b622-5a1a-b2cc-fe4f55a07d2f with scrape type 2
2026-03-30 07:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a829c22-b622-5a1a-b2cc-fe4f55a07d2f with scrape type 2
2026-03-30 07:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a829c22-b622-5a1a-b2cc-fe4f55a07d2f, identifier: FR65686
2026-03-30 07:46:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a829c22-b622-5a1a-b2cc-fe4f55a07d2f with identifier: FR65686
2026-03-30 07:46:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a829c22-b622-5a1a-b2cc-fe4f55a07d2f with identifier: FR65686
2026-03-30 07:46:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a829c22-b622-5a1a-b2cc-fe4f55a07d2f with identifier: FR65686 to the API
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:11:45Z',
 'fuel_type': 'petrol',
 'id': '8a829c22-b622-5a1a-b2cc-fe4f55a07d2f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR65686',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 61248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seller_name': None,
 'title': 'Nissan Micra 0.9 Turbo N-WAY',
 'transmission': 'manual',
 'trim': 'N-WAY',
 'year': 2018}
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR65686%27 HTTP/1.1" 200 None
2026-03-30 07:46:25 [auto1.de] INFO: Saving data for FR65686: {'auction_closing_time': 1774883505.0, 'created_time': 1774639297.294228, 'last_price_update_time': 1774856785.793952}
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FR65686') HTTP/1.1" 204 0
2026-03-30 07:46:25 [auto1.de] INFO: Found listing with ID: SN13100
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN13100%27 HTTP/1.1" 200 None
2026-03-30 07:46:25 [auto1.de] INFO: Scrape type for SN13100: 0
2026-03-30 07:46:25 [auto1.de] INFO: Found listing with ID: RX17782
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX17782%27 HTTP/1.1" 200 None
2026-03-30 07:46:25 [auto1.de] INFO: Scrape type for RX17782: 2
2026-03-30 07:46:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with identifier: RX17782
2026-03-30 07:46:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with scrape type 2
2026-03-30 07:46:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with scrape type 2
2026-03-30 07:46:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0, identifier: RX17782
2026-03-30 07:46:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with identifier: RX17782
2026-03-30 07:46:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with identifier: RX17782
2026-03-30 07:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0 with identifier: RX17782 to the API
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 285,
 'expiration_date': '2026-03-30T15:44:53Z',
 'fuel_type': 'diesel',
 'id': '7c6a45d6-b8a7-5ae9-be6f-ae9ece9748d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX17782',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 143412,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-29',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 350 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX17782%27 HTTP/1.1" 200 None
2026-03-30 07:46:26 [auto1.de] INFO: Saving data for RX17782: {'auction_closing_time': 1774885493.0, 'created_time': 1774550961.069592, 'last_price_update_time': 1774856786.22785}
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX17782') HTTP/1.1" 204 0
2026-03-30 07:46:26 [auto1.de] INFO: Found listing with ID: DD70281
2026-03-30 07:46:26 [auto1.de] INFO: Found listing with ID: SV05588
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV05588%27 HTTP/1.1" 200 None
2026-03-30 07:46:26 [auto1.de] INFO: Scrape type for SV05588: 0
2026-03-30 07:46:26 [auto1.de] INFO: Found listing with ID: PE91450
2026-03-30 07:46:26 [auto1.de] INFO: Found listing with ID: VS10261
2026-03-30 07:46:26 [auto1.de] INFO: Found listing with ID: RE51747
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE51747%27 HTTP/1.1" 200 None
2026-03-30 07:46:26 [auto1.de] INFO: Scrape type for RE51747: 0
2026-03-30 07:46:26 [auto1.de] INFO: Found listing with ID: VR85495
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85495%27 HTTP/1.1" 200 None
2026-03-30 07:46:26 [auto1.de] INFO: Scrape type for VR85495: 2
2026-03-30 07:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4901c4d0-2305-5c39-8720-d394e1ddc772 with identifier: VR85495
2026-03-30 07:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4901c4d0-2305-5c39-8720-d394e1ddc772 with scrape type 2
2026-03-30 07:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4901c4d0-2305-5c39-8720-d394e1ddc772 with scrape type 2
2026-03-30 07:46:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4901c4d0-2305-5c39-8720-d394e1ddc772, identifier: VR85495
2026-03-30 07:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4901c4d0-2305-5c39-8720-d394e1ddc772 with identifier: VR85495
2026-03-30 07:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4901c4d0-2305-5c39-8720-d394e1ddc772 with identifier: VR85495
2026-03-30 07:46:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4901c4d0-2305-5c39-8720-d394e1ddc772 with identifier: VR85495 to the API
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:24:11Z',
 'fuel_type': 'petrol',
 'id': '4901c4d0-2305-5c39-8720-d394e1ddc772',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR85495',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Townstar',
 'odometer': 16768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-08-08',
 'seller_name': None,
 'title': 'Nissan Townstar 1.3 DIG-T L1 Acenta',
 'transmission': 'manual',
 'trim': 'L1 Acenta',
 'year': 2023}
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR85495%27 HTTP/1.1" 200 None
2026-03-30 07:46:26 [auto1.de] INFO: Saving data for VR85495: {'auction_closing_time': 1774884251.0, 'created_time': 1774550309.939281, 'last_price_update_time': 1774856786.67247}
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR85495') HTTP/1.1" 204 0
2026-03-30 07:46:26 [auto1.de] INFO: Found listing with ID: MW87907
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW87907%27 HTTP/1.1" 200 None
2026-03-30 07:46:26 [auto1.de] INFO: Scrape type for MW87907: 2
2026-03-30 07:46:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5bf7468-014a-52d1-86fa-8967340fd83f with identifier: MW87907
2026-03-30 07:46:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5bf7468-014a-52d1-86fa-8967340fd83f with scrape type 2
2026-03-30 07:46:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5bf7468-014a-52d1-86fa-8967340fd83f with scrape type 2
2026-03-30 07:46:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f5bf7468-014a-52d1-86fa-8967340fd83f, identifier: MW87907
2026-03-30 07:46:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f5bf7468-014a-52d1-86fa-8967340fd83f with identifier: MW87907
2026-03-30 07:46:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f5bf7468-014a-52d1-86fa-8967340fd83f with identifier: MW87907
2026-03-30 07:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f5bf7468-014a-52d1-86fa-8967340fd83f with identifier: MW87907 to the API
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:28:20Z',
 'fuel_type': 'petrol',
 'id': 'f5bf7468-014a-52d1-86fa-8967340fd83f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW87907',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 148769,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-21',
 'seller_name': None,
 'title': 'BMW 3er 335i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW87907%27 HTTP/1.1" 200 None
2026-03-30 07:46:27 [auto1.de] INFO: Saving data for MW87907: {'auction_closing_time': 1774884500.0, 'created_time': 1774640155.528716, 'last_price_update_time': 1774856787.199304}
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MW87907') HTTP/1.1" 204 0
2026-03-30 07:46:27 [auto1.de] INFO: Found listing with ID: XW64157
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW64157%27 HTTP/1.1" 200 None
2026-03-30 07:46:27 [auto1.de] INFO: Scrape type for XW64157: 2
2026-03-30 07:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2f300ec-51a8-59f2-b1b9-ffa369d30a61 with identifier: XW64157
2026-03-30 07:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2f300ec-51a8-59f2-b1b9-ffa369d30a61 with scrape type 2
2026-03-30 07:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2f300ec-51a8-59f2-b1b9-ffa369d30a61 with scrape type 2
2026-03-30 07:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2f300ec-51a8-59f2-b1b9-ffa369d30a61, identifier: XW64157
2026-03-30 07:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2f300ec-51a8-59f2-b1b9-ffa369d30a61 with identifier: XW64157
2026-03-30 07:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2f300ec-51a8-59f2-b1b9-ffa369d30a61 with identifier: XW64157
2026-03-30 07:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2f300ec-51a8-59f2-b1b9-ffa369d30a61 with identifier: XW64157 to the API
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:36:41Z',
 'fuel_type': 'diesel',
 'id': 'd2f300ec-51a8-59f2-b1b9-ffa369d30a61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW64157',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 212945,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-05',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 350 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2012}
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW64157%27 HTTP/1.1" 200 None
2026-03-30 07:46:27 [auto1.de] INFO: Saving data for XW64157: {'auction_closing_time': 1774885001.0, 'created_time': 1774639536.089482, 'last_price_update_time': 1774856787.62062}
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XW64157') HTTP/1.1" 204 0
2026-03-30 07:46:27 [auto1.de] INFO: Found listing with ID: RT05555
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05555%27 HTTP/1.1" 200 None
2026-03-30 07:46:27 [auto1.de] INFO: Scrape type for RT05555: 2
2026-03-30 07:46:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1480f006-e20f-5c29-abc2-ea5546801624 with identifier: RT05555
2026-03-30 07:46:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1480f006-e20f-5c29-abc2-ea5546801624 with scrape type 2
2026-03-30 07:46:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1480f006-e20f-5c29-abc2-ea5546801624 with scrape type 2
2026-03-30 07:46:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1480f006-e20f-5c29-abc2-ea5546801624, identifier: RT05555
2026-03-30 07:46:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1480f006-e20f-5c29-abc2-ea5546801624 with identifier: RT05555
2026-03-30 07:46:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1480f006-e20f-5c29-abc2-ea5546801624 with identifier: RT05555
2026-03-30 07:46:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1480f006-e20f-5c29-abc2-ea5546801624 with identifier: RT05555 to the API
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:46:31Z',
 'fuel_type': 'petrol',
 'id': '1480f006-e20f-5c29-abc2-ea5546801624',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT05555',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 151196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-21',
 'seller_name': None,
 'title': 'Seat Ibiza 1.4 Stylance / Style',
 'transmission': 'manual',
 'trim': 'Stylance / Style',
 'year': 2009}
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT05555%27 HTTP/1.1" 200 None
2026-03-30 07:46:28 [auto1.de] INFO: Saving data for RT05555: {'auction_closing_time': 1774885591.0, 'created_time': 1774640219.038767, 'last_price_update_time': 1774856788.044644}
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT05555') HTTP/1.1" 204 0
2026-03-30 07:46:28 [auto1.de] INFO: Found listing with ID: NG44703
2026-03-30 07:46:28 [auto1.de] INFO: Found listing with ID: MM04767
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM04767%27 HTTP/1.1" 200 None
2026-03-30 07:46:28 [auto1.de] INFO: Scrape type for MM04767: 0
2026-03-30 07:46:28 [auto1.de] INFO: Found listing with ID: TH77412
2026-03-30 07:46:28 [auto1.de] INFO: Found listing with ID: MS75707
2026-03-30 07:46:28 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC69827%27 HTTP/1.1" 200 None
2026-03-30 07:46:28 [auto1.de] INFO: Scrape type for HC69827: 2
2026-03-30 07:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0733f327-d1f2-5b36-b532-3d930090460e with identifier: HC69827
2026-03-30 07:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0733f327-d1f2-5b36-b532-3d930090460e with scrape type 2
2026-03-30 07:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0733f327-d1f2-5b36-b532-3d930090460e with scrape type 2
2026-03-30 07:46:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0733f327-d1f2-5b36-b532-3d930090460e, identifier: HC69827
2026-03-30 07:46:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0733f327-d1f2-5b36-b532-3d930090460e with identifier: HC69827
2026-03-30 07:46:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0733f327-d1f2-5b36-b532-3d930090460e with identifier: HC69827
2026-03-30 07:46:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0733f327-d1f2-5b36-b532-3d930090460e with identifier: HC69827 to the API
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:15:23Z',
 'fuel_type': 'petrol',
 'id': '0733f327-d1f2-5b36-b532-3d930090460e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC69827',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 106325,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-15',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Kizoku Intense',
 'transmission': 'manual',
 'trim': 'Kizoku Intense',
 'year': 2017}
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC69827%27 HTTP/1.1" 200 None
2026-03-30 07:46:28 [auto1.de] INFO: Saving data for HC69827: {'auction_closing_time': 1774883723.0, 'created_time': 1774550626.6276, 'last_price_update_time': 1774856788.486794}
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC69827') HTTP/1.1" 204 0
2026-03-30 07:46:28 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77748%27 HTTP/1.1" 200 None
2026-03-30 07:46:28 [auto1.de] INFO: Scrape type for JZ77748: 0
2026-03-30 07:46:28 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-30 07:46:28 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-30 07:46:28 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV79476%27 HTTP/1.1" 200 None
2026-03-30 07:46:28 [auto1.de] INFO: Scrape type for VV79476: 2
2026-03-30 07:46:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac04d2b7-6325-541f-a349-ba7842918c42 with identifier: VV79476
2026-03-30 07:46:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac04d2b7-6325-541f-a349-ba7842918c42 with scrape type 2
2026-03-30 07:46:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac04d2b7-6325-541f-a349-ba7842918c42 with scrape type 2
2026-03-30 07:46:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac04d2b7-6325-541f-a349-ba7842918c42, identifier: VV79476
2026-03-30 07:46:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac04d2b7-6325-541f-a349-ba7842918c42 with identifier: VV79476
2026-03-30 07:46:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac04d2b7-6325-541f-a349-ba7842918c42 with identifier: VV79476
2026-03-30 07:46:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac04d2b7-6325-541f-a349-ba7842918c42 with identifier: VV79476 to the API
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:35:59Z',
 'fuel_type': 'petrol',
 'id': 'ac04d2b7-6325-541f-a349-ba7842918c42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV79476',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 188529,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-29',
 'seller_name': None,
 'title': 'Ford Focus 2.5 ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2009}
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV79476%27 HTTP/1.1" 200 None
2026-03-30 07:46:28 [auto1.de] INFO: Saving data for VV79476: {'auction_closing_time': 1774884959.0, 'created_time': 1774553176.319161, 'last_price_update_time': 1774856788.908756}
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV79476') HTTP/1.1" 204 0
2026-03-30 07:46:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:46:32 [auto1.de] INFO: Channel: 24h | Page: 124 | totalHits: 8380 | hits on page: 40
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: HC69827
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC69827%27 HTTP/1.1" 200 None
2026-03-30 07:46:32 [auto1.de] INFO: Scrape type for HC69827: 0
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: JZ77748
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77748%27 HTTP/1.1" 200 None
2026-03-30 07:46:32 [auto1.de] INFO: Scrape type for JZ77748: 0
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: CH79941
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: SZ55877
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: VV79476
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV79476%27 HTTP/1.1" 200 None
2026-03-30 07:46:32 [auto1.de] INFO: Scrape type for VV79476: 0
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: XY47977
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY47977%27 HTTP/1.1" 200 None
2026-03-30 07:46:32 [auto1.de] INFO: Scrape type for XY47977: 0
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: TH50819
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50819%27 HTTP/1.1" 200 None
2026-03-30 07:46:32 [auto1.de] INFO: Scrape type for TH50819: 2
2026-03-30 07:46:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2188fb0c-8149-56b4-87da-90f7f6d1aafb with identifier: TH50819
2026-03-30 07:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2188fb0c-8149-56b4-87da-90f7f6d1aafb with scrape type 2
2026-03-30 07:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2188fb0c-8149-56b4-87da-90f7f6d1aafb with scrape type 2
2026-03-30 07:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2188fb0c-8149-56b4-87da-90f7f6d1aafb, identifier: TH50819
2026-03-30 07:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2188fb0c-8149-56b4-87da-90f7f6d1aafb with identifier: TH50819
2026-03-30 07:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2188fb0c-8149-56b4-87da-90f7f6d1aafb with identifier: TH50819
2026-03-30 07:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2188fb0c-8149-56b4-87da-90f7f6d1aafb with identifier: TH50819 to the API
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:50:46Z',
 'fuel_type': 'diesel',
 'id': '2188fb0c-8149-56b4-87da-90f7f6d1aafb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH50819',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 76893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-11',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 310 L1 Sport',
 'transmission': 'manual',
 'trim': '310 L1 Sport',
 'year': 2019}
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50819%27 HTTP/1.1" 200 None
2026-03-30 07:46:32 [auto1.de] INFO: Saving data for TH50819: {'auction_closing_time': 1774885846.0, 'created_time': 1773225838.075326, 'last_price_update_time': 1774856792.63098}
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TH50819') HTTP/1.1" 204 0
2026-03-30 07:46:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: ZZ62402
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: BX70846
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: SD59172
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: AK43100
2026-03-30 07:46:32 [auto1.de] INFO: Found listing with ID: HY86490
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY86490%27 HTTP/1.1" 200 None
2026-03-30 07:46:32 [auto1.de] INFO: Scrape type for HY86490: 2
2026-03-30 07:46:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84c4e657-5db5-5874-8fe2-08f64ebc3f63 with identifier: HY86490
2026-03-30 07:46:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 84c4e657-5db5-5874-8fe2-08f64ebc3f63 with scrape type 2
2026-03-30 07:46:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 84c4e657-5db5-5874-8fe2-08f64ebc3f63 with scrape type 2
2026-03-30 07:46:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 84c4e657-5db5-5874-8fe2-08f64ebc3f63, identifier: HY86490
2026-03-30 07:46:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 84c4e657-5db5-5874-8fe2-08f64ebc3f63 with identifier: HY86490
2026-03-30 07:46:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 84c4e657-5db5-5874-8fe2-08f64ebc3f63 with identifier: HY86490
2026-03-30 07:46:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 84c4e657-5db5-5874-8fe2-08f64ebc3f63 with identifier: HY86490 to the API
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:06:30Z',
 'fuel_type': 'petrol',
 'id': '84c4e657-5db5-5874-8fe2-08f64ebc3f63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY86490',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 67405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-21',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 35 TFSI Mild-Hybrid ACT',
 'transmission': 'automatic',
 'trim': 'ACT',
 'year': 2021}
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY86490%27 HTTP/1.1" 200 None
2026-03-30 07:46:33 [auto1.de] INFO: Saving data for HY86490: {'auction_closing_time': 1774883190.0, 'created_time': 1774550434.26695, 'last_price_update_time': 1774856793.067681}
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HY86490') HTTP/1.1" 204 0
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: MW31978
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: AG24612
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG24612%27 HTTP/1.1" 200 None
2026-03-30 07:46:33 [auto1.de] INFO: Scrape type for AG24612: 0
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: SR59541
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: GJ71722
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: WM31367
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: BK73701
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73701%27 HTTP/1.1" 200 None
2026-03-30 07:46:33 [auto1.de] INFO: Scrape type for BK73701: 2
2026-03-30 07:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with identifier: BK73701
2026-03-30 07:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with scrape type 2
2026-03-30 07:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with scrape type 2
2026-03-30 07:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62f4e23d-701a-580e-bd5d-3b5e990d0e8c, identifier: BK73701
2026-03-30 07:46:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with identifier: BK73701
2026-03-30 07:46:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with identifier: BK73701
2026-03-30 07:46:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62f4e23d-701a-580e-bd5d-3b5e990d0e8c with identifier: BK73701 to the API
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:23:11Z',
 'fuel_type': 'petrol',
 'id': '62f4e23d-701a-580e-bd5d-3b5e990d0e8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK73701',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 138716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-10',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2014}
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BK73701%27 HTTP/1.1" 200 None
2026-03-30 07:46:33 [auto1.de] INFO: Saving data for BK73701: {'auction_closing_time': 1774884191.0, 'created_time': 1774552889.652503, 'last_price_update_time': 1774856793.609776}
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BK73701') HTTP/1.1" 204 0
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: NY67891
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: HV44481
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: CR35436
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: HW53715
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: SU06279
2026-03-30 07:46:33 [auto1.de] INFO: Found listing with ID: TA42625
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA42625%27 HTTP/1.1" 200 None
2026-03-30 07:46:33 [auto1.de] INFO: Scrape type for TA42625: 2
2026-03-30 07:46:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5f0b6b0-21d7-5fc1-82c8-1d7431c0d7d8 with identifier: TA42625
2026-03-30 07:46:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5f0b6b0-21d7-5fc1-82c8-1d7431c0d7d8 with scrape type 2
2026-03-30 07:46:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5f0b6b0-21d7-5fc1-82c8-1d7431c0d7d8 with scrape type 2
2026-03-30 07:46:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b5f0b6b0-21d7-5fc1-82c8-1d7431c0d7d8, identifier: TA42625
2026-03-30 07:46:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b5f0b6b0-21d7-5fc1-82c8-1d7431c0d7d8 with identifier: TA42625
2026-03-30 07:46:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b5f0b6b0-21d7-5fc1-82c8-1d7431c0d7d8 with identifier: TA42625
2026-03-30 07:46:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b5f0b6b0-21d7-5fc1-82c8-1d7431c0d7d8 with identifier: TA42625 to the API
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:49:03Z',
 'fuel_type': 'petrol',
 'id': 'b5f0b6b0-21d7-5fc1-82c8-1d7431c0d7d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA42625',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 138811,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-04',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI Performance BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTI Performance BlueMotion',
 'year': 2017}
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA42625%27 HTTP/1.1" 200 None
2026-03-30 07:46:34 [auto1.de] INFO: Saving data for TA42625: {'auction_closing_time': 1774885743.0, 'created_time': 1774639132.435622, 'last_price_update_time': 1774856794.028785}
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA42625') HTTP/1.1" 204 0
2026-03-30 07:46:34 [auto1.de] INFO: Found listing with ID: JC63536
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JC63536%27 HTTP/1.1" 200 None
2026-03-30 07:46:34 [auto1.de] INFO: Scrape type for JC63536: 0
2026-03-30 07:46:34 [auto1.de] INFO: Found listing with ID: NV55096
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55096%27 HTTP/1.1" 200 None
2026-03-30 07:46:34 [auto1.de] INFO: Scrape type for NV55096: 2
2026-03-30 07:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 142cca33-44b9-574c-8a3a-fd728a819bef with identifier: NV55096
2026-03-30 07:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 142cca33-44b9-574c-8a3a-fd728a819bef with scrape type 2
2026-03-30 07:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 142cca33-44b9-574c-8a3a-fd728a819bef with scrape type 2
2026-03-30 07:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 142cca33-44b9-574c-8a3a-fd728a819bef, identifier: NV55096
2026-03-30 07:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 142cca33-44b9-574c-8a3a-fd728a819bef with identifier: NV55096
2026-03-30 07:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 142cca33-44b9-574c-8a3a-fd728a819bef with identifier: NV55096
2026-03-30 07:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 142cca33-44b9-574c-8a3a-fd728a819bef with identifier: NV55096 to the API
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:21:59Z',
 'fuel_type': 'petrol',
 'id': '142cca33-44b9-574c-8a3a-fd728a819bef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV55096',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 50298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-02',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2016}
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV55096%27 HTTP/1.1" 200 None
2026-03-30 07:46:34 [auto1.de] INFO: Saving data for NV55096: {'auction_closing_time': 1774884119.0, 'created_time': 1774552684.965515, 'last_price_update_time': 1774856794.572016}
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV55096') HTTP/1.1" 204 0
2026-03-30 07:46:34 [auto1.de] INFO: Found listing with ID: HR44152
2026-03-30 07:46:34 [auto1.de] INFO: Found listing with ID: CV89057
2026-03-30 07:46:34 [auto1.de] INFO: Found listing with ID: AJ13004
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ13004%27 HTTP/1.1" 200 None
2026-03-30 07:46:34 [auto1.de] INFO: Scrape type for AJ13004: 0
2026-03-30 07:46:34 [auto1.de] INFO: Found listing with ID: HY59950
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY59950%27 HTTP/1.1" 200 None
2026-03-30 07:46:34 [auto1.de] INFO: Scrape type for HY59950: 0
2026-03-30 07:46:34 [auto1.de] INFO: Found listing with ID: JE47018
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE47018%27 HTTP/1.1" 200 None
2026-03-30 07:46:34 [auto1.de] INFO: Scrape type for JE47018: 2
2026-03-30 07:46:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d6a1802-b49a-5a74-b475-8fe5d8942eec with identifier: JE47018
2026-03-30 07:46:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d6a1802-b49a-5a74-b475-8fe5d8942eec with scrape type 2
2026-03-30 07:46:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d6a1802-b49a-5a74-b475-8fe5d8942eec with scrape type 2
2026-03-30 07:46:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1d6a1802-b49a-5a74-b475-8fe5d8942eec, identifier: JE47018
2026-03-30 07:46:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1d6a1802-b49a-5a74-b475-8fe5d8942eec with identifier: JE47018
2026-03-30 07:46:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1d6a1802-b49a-5a74-b475-8fe5d8942eec with identifier: JE47018
2026-03-30 07:46:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1d6a1802-b49a-5a74-b475-8fe5d8942eec with identifier: JE47018 to the API
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:32:18Z',
 'fuel_type': 'diesel',
 'id': '1d6a1802-b49a-5a74-b475-8fe5d8942eec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE47018',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 301583,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-20',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2013}
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE47018%27 HTTP/1.1" 200 None
2026-03-30 07:46:35 [auto1.de] INFO: Saving data for JE47018: {'auction_closing_time': 1774884738.0, 'created_time': 1774639496.089984, 'last_price_update_time': 1774856795.028693}
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE47018') HTTP/1.1" 204 0
2026-03-30 07:46:35 [auto1.de] INFO: Found listing with ID: KU99299
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU99299%27 HTTP/1.1" 200 None
2026-03-30 07:46:35 [auto1.de] INFO: Scrape type for KU99299: 2
2026-03-30 07:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with identifier: KU99299
2026-03-30 07:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with scrape type 2
2026-03-30 07:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with scrape type 2
2026-03-30 07:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855, identifier: KU99299
2026-03-30 07:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with identifier: KU99299
2026-03-30 07:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with identifier: KU99299
2026-03-30 07:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c1be5e2-c1bc-56d5-b46f-7500f2fcb855 with identifier: KU99299 to the API
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:31:08Z',
 'fuel_type': 'petrol',
 'id': '9c1be5e2-c1bc-56d5-b46f-7500f2fcb855',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KU99299',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 128914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-04',
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 350 Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2005}
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU99299%27 HTTP/1.1" 200 None
2026-03-30 07:46:35 [auto1.de] INFO: Saving data for KU99299: {'auction_closing_time': 1774884668.0, 'created_time': 1774552747.337017, 'last_price_update_time': 1774856795.452703}
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KU99299') HTTP/1.1" 204 0
2026-03-30 07:46:35 [auto1.de] INFO: Found listing with ID: MW80784
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW80784%27 HTTP/1.1" 200 None
2026-03-30 07:46:35 [auto1.de] INFO: Scrape type for MW80784: 0
2026-03-30 07:46:35 [auto1.de] INFO: Found listing with ID: YS01662
2026-03-30 07:46:35 [auto1.de] INFO: Found listing with ID: TN35459
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN35459%27 HTTP/1.1" 200 None
2026-03-30 07:46:35 [auto1.de] INFO: Scrape type for TN35459: 0
2026-03-30 07:46:35 [auto1.de] INFO: Found listing with ID: EV46611
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV46611%27 HTTP/1.1" 200 None
2026-03-30 07:46:35 [auto1.de] INFO: Scrape type for EV46611: 2
2026-03-30 07:46:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cb7b9e8-df63-5e14-9658-6ff105a0521e with identifier: EV46611
2026-03-30 07:46:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cb7b9e8-df63-5e14-9658-6ff105a0521e with scrape type 2
2026-03-30 07:46:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cb7b9e8-df63-5e14-9658-6ff105a0521e with scrape type 2
2026-03-30 07:46:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cb7b9e8-df63-5e14-9658-6ff105a0521e, identifier: EV46611
2026-03-30 07:46:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cb7b9e8-df63-5e14-9658-6ff105a0521e with identifier: EV46611
2026-03-30 07:46:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cb7b9e8-df63-5e14-9658-6ff105a0521e with identifier: EV46611
2026-03-30 07:46:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cb7b9e8-df63-5e14-9658-6ff105a0521e with identifier: EV46611 to the API
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:19Z',
 'fuel_type': 'diesel',
 'id': '7cb7b9e8-df63-5e14-9658-6ff105a0521e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV46611',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 196222,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-18',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2016}
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV46611%27 HTTP/1.1" 200 None
2026-03-30 07:46:35 [auto1.de] INFO: Saving data for EV46611: {'auction_closing_time': 1774886239.0, 'created_time': 1774639693.120316, 'last_price_update_time': 1774856795.912513}
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EV46611') HTTP/1.1" 204 0
2026-03-30 07:46:36 [auto1.de] INFO: Found listing with ID: XF30370
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF30370%27 HTTP/1.1" 200 None
2026-03-30 07:46:36 [auto1.de] INFO: Scrape type for XF30370: 2
2026-03-30 07:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb1beb75-1855-59de-9a72-2fba70207d40 with identifier: XF30370
2026-03-30 07:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb1beb75-1855-59de-9a72-2fba70207d40 with scrape type 2
2026-03-30 07:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb1beb75-1855-59de-9a72-2fba70207d40 with scrape type 2
2026-03-30 07:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb1beb75-1855-59de-9a72-2fba70207d40, identifier: XF30370
2026-03-30 07:46:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb1beb75-1855-59de-9a72-2fba70207d40 with identifier: XF30370
2026-03-30 07:46:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb1beb75-1855-59de-9a72-2fba70207d40 with identifier: XF30370
2026-03-30 07:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb1beb75-1855-59de-9a72-2fba70207d40 with identifier: XF30370 to the API
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-30T15:45:50Z',
 'fuel_type': 'petrol',
 'id': 'eb1beb75-1855-59de-9a72-2fba70207d40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF30370',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 153257,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-08',
 'seller_name': None,
 'title': 'Porsche Cayenne S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF30370%27 HTTP/1.1" 200 None
2026-03-30 07:46:36 [auto1.de] INFO: Saving data for XF30370: {'auction_closing_time': 1774885550.0, 'created_time': 1774552705.540188, 'last_price_update_time': 1774856796.421537}
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF30370') HTTP/1.1" 204 0
2026-03-30 07:46:36 [auto1.de] INFO: Found listing with ID: PK45675
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK45675%27 HTTP/1.1" 200 None
2026-03-30 07:46:36 [auto1.de] INFO: Scrape type for PK45675: 0
2026-03-30 07:46:36 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM63646%27 HTTP/1.1" 200 None
2026-03-30 07:46:36 [auto1.de] INFO: Scrape type for SM63646: 2
2026-03-30 07:46:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 056b0094-e648-535d-b23c-39a9a6c817ce with identifier: SM63646
2026-03-30 07:46:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 056b0094-e648-535d-b23c-39a9a6c817ce with scrape type 2
2026-03-30 07:46:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 056b0094-e648-535d-b23c-39a9a6c817ce with scrape type 2
2026-03-30 07:46:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 056b0094-e648-535d-b23c-39a9a6c817ce, identifier: SM63646
2026-03-30 07:46:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 056b0094-e648-535d-b23c-39a9a6c817ce with identifier: SM63646
2026-03-30 07:46:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 056b0094-e648-535d-b23c-39a9a6c817ce with identifier: SM63646
2026-03-30 07:46:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 056b0094-e648-535d-b23c-39a9a6c817ce with identifier: SM63646 to the API
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:56:46Z',
 'fuel_type': 'diesel',
 'id': '056b0094-e648-535d-b23c-39a9a6c817ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM63646',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 140896,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-04',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM63646%27 HTTP/1.1" 200 None
2026-03-30 07:46:36 [auto1.de] INFO: Saving data for SM63646: {'auction_closing_time': 1774886206.0, 'created_time': 1773227120.955804, 'last_price_update_time': 1774856796.847634}
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM63646') HTTP/1.1" 204 0
2026-03-30 07:46:36 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-30 07:46:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:46:36 [auto1.de] INFO: Channel: 24h | Page: 125 | totalHits: 8382 | hits on page: 40
2026-03-30 07:46:36 [auto1.de] INFO: Found listing with ID: SM63646
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM63646%27 HTTP/1.1" 200 None
2026-03-30 07:46:36 [auto1.de] INFO: Scrape type for SM63646: 0
2026-03-30 07:46:36 [auto1.de] INFO: Found listing with ID: DL45560
2026-03-30 07:46:36 [auto1.de] INFO: Found listing with ID: AB14083
2026-03-30 07:46:36 [auto1.de] INFO: Found listing with ID: TT59921
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT59921%27 HTTP/1.1" 200 None
2026-03-30 07:46:37 [auto1.de] INFO: Scrape type for TT59921: 0
2026-03-30 07:46:37 [auto1.de] INFO: Found listing with ID: DC51823
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC51823%27 HTTP/1.1" 200 None
2026-03-30 07:46:37 [auto1.de] INFO: Scrape type for DC51823: 2
2026-03-30 07:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cc61533-b012-5736-af0f-2026dd92f34d with identifier: DC51823
2026-03-30 07:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cc61533-b012-5736-af0f-2026dd92f34d with scrape type 2
2026-03-30 07:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cc61533-b012-5736-af0f-2026dd92f34d with scrape type 2
2026-03-30 07:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9cc61533-b012-5736-af0f-2026dd92f34d, identifier: DC51823
2026-03-30 07:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9cc61533-b012-5736-af0f-2026dd92f34d with identifier: DC51823
2026-03-30 07:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9cc61533-b012-5736-af0f-2026dd92f34d with identifier: DC51823
2026-03-30 07:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9cc61533-b012-5736-af0f-2026dd92f34d with identifier: DC51823 to the API
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:54:39Z',
 'fuel_type': 'diesel',
 'id': '9cc61533-b012-5736-af0f-2026dd92f34d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC51823',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 194814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-11-29',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 280 CDI 4Matic Classic',
 'transmission': 'automatic',
 'trim': '4Matic Classic',
 'year': 2007}
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC51823%27 HTTP/1.1" 200 None
2026-03-30 07:46:37 [auto1.de] INFO: Saving data for DC51823: {'auction_closing_time': 1774886079.0, 'created_time': 1774550165.061905, 'last_price_update_time': 1774856797.422143}
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC51823') HTTP/1.1" 204 0
2026-03-30 07:46:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:37 [auto1.de] INFO: Found listing with ID: HA91024
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA91024%27 HTTP/1.1" 200 None
2026-03-30 07:46:37 [auto1.de] INFO: Scrape type for HA91024: 0
2026-03-30 07:46:37 [auto1.de] INFO: Found listing with ID: AA30425
2026-03-30 07:46:37 [auto1.de] INFO: Found listing with ID: GC28656
2026-03-30 07:46:37 [auto1.de] INFO: Found listing with ID: KC24735
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC24735%27 HTTP/1.1" 200 None
2026-03-30 07:46:37 [auto1.de] INFO: Scrape type for KC24735: 0
2026-03-30 07:46:37 [auto1.de] INFO: Found listing with ID: KT10840
2026-03-30 07:46:37 [auto1.de] INFO: Found listing with ID: JK17459
2026-03-30 07:46:37 [auto1.de] INFO: Found listing with ID: KX98394
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX98394%27 HTTP/1.1" 200 None
2026-03-30 07:46:37 [auto1.de] INFO: Scrape type for KX98394: 0
2026-03-30 07:46:37 [auto1.de] INFO: Found listing with ID: LX71576
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX71576%27 HTTP/1.1" 200 None
2026-03-30 07:46:37 [auto1.de] INFO: Scrape type for LX71576: 2
2026-03-30 07:46:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 293dd7c6-a744-58a2-8626-73ecc313287b with identifier: LX71576
2026-03-30 07:46:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 293dd7c6-a744-58a2-8626-73ecc313287b with scrape type 2
2026-03-30 07:46:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 293dd7c6-a744-58a2-8626-73ecc313287b with scrape type 2
2026-03-30 07:46:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 293dd7c6-a744-58a2-8626-73ecc313287b, identifier: LX71576
2026-03-30 07:46:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 293dd7c6-a744-58a2-8626-73ecc313287b with identifier: LX71576
2026-03-30 07:46:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 293dd7c6-a744-58a2-8626-73ecc313287b with identifier: LX71576
2026-03-30 07:46:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 293dd7c6-a744-58a2-8626-73ecc313287b with identifier: LX71576 to the API
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:19:22Z',
 'fuel_type': 'petrol',
 'id': '293dd7c6-a744-58a2-8626-73ecc313287b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX71576',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 120581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-08',
 'seller_name': None,
 'title': 'Ford Fiesta 1.4 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2009}
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX71576%27 HTTP/1.1" 200 None
2026-03-30 07:46:37 [auto1.de] INFO: Saving data for LX71576: {'auction_closing_time': 1774883962.0, 'created_time': 1774550920.995869, 'last_price_update_time': 1774856797.934746}
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX71576') HTTP/1.1" 204 0
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: BV81502
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: AK58988
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: HR13595
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: TE39343
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: ZN63350
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: PE88968
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PE88968%27 HTTP/1.1" 200 None
2026-03-30 07:46:38 [auto1.de] INFO: Scrape type for PE88968: 0
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: FC75041
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: PP85770
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: FG79588
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG79588%27 HTTP/1.1" 200 None
2026-03-30 07:46:38 [auto1.de] INFO: Scrape type for FG79588: 2
2026-03-30 07:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f43abd9-0db1-5c90-8f8c-3198cd09870f with identifier: FG79588
2026-03-30 07:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f43abd9-0db1-5c90-8f8c-3198cd09870f with scrape type 2
2026-03-30 07:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f43abd9-0db1-5c90-8f8c-3198cd09870f with scrape type 2
2026-03-30 07:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f43abd9-0db1-5c90-8f8c-3198cd09870f, identifier: FG79588
2026-03-30 07:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f43abd9-0db1-5c90-8f8c-3198cd09870f with identifier: FG79588
2026-03-30 07:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f43abd9-0db1-5c90-8f8c-3198cd09870f with identifier: FG79588
2026-03-30 07:46:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f43abd9-0db1-5c90-8f8c-3198cd09870f with identifier: FG79588 to the API
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:18:39Z',
 'fuel_type': 'diesel',
 'id': '4f43abd9-0db1-5c90-8f8c-3198cd09870f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FG79588',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 230685,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-23',
 'seller_name': None,
 'title': 'BMW 3er 330d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2013}
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG79588%27 HTTP/1.1" 200 None
2026-03-30 07:46:38 [auto1.de] INFO: Saving data for FG79588: {'auction_closing_time': 1774883919.0, 'created_time': 1774638806.023648, 'last_price_update_time': 1774856798.545312}
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FG79588') HTTP/1.1" 204 0
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: AA02117
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02117%27 HTTP/1.1" 200 None
2026-03-30 07:46:38 [auto1.de] INFO: Scrape type for AA02117: 2
2026-03-30 07:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae143b27-e226-51c8-be39-903618b36b63 with identifier: AA02117
2026-03-30 07:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae143b27-e226-51c8-be39-903618b36b63 with scrape type 2
2026-03-30 07:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae143b27-e226-51c8-be39-903618b36b63 with scrape type 2
2026-03-30 07:46:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ae143b27-e226-51c8-be39-903618b36b63, identifier: AA02117
2026-03-30 07:46:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ae143b27-e226-51c8-be39-903618b36b63 with identifier: AA02117
2026-03-30 07:46:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ae143b27-e226-51c8-be39-903618b36b63 with identifier: AA02117
2026-03-30 07:46:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ae143b27-e226-51c8-be39-903618b36b63 with identifier: AA02117 to the API
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:05:49Z',
 'fuel_type': 'petrol',
 'id': 'ae143b27-e226-51c8-be39-903618b36b63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA02117',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 219730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-11',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 400 4Matic Exclusive',
 'transmission': 'automatic',
 'trim': '4Matic Exclusive',
 'year': 2015}
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA02117%27 HTTP/1.1" 200 None
2026-03-30 07:46:38 [auto1.de] INFO: Saving data for AA02117: {'auction_closing_time': 1774883149.0, 'created_time': 1774551658.343198, 'last_price_update_time': 1774856798.94847}
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AA02117') HTTP/1.1" 204 0
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: ZE79625
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE79625%27 HTTP/1.1" 200 None
2026-03-30 07:46:38 [auto1.de] INFO: Scrape type for ZE79625: 0
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: VY07286
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: KP81674
2026-03-30 07:46:38 [auto1.de] INFO: Found listing with ID: FT31566
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT31566%27 HTTP/1.1" 200 None
2026-03-30 07:46:38 [auto1.de] INFO: Scrape type for FT31566: 2
2026-03-30 07:46:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with identifier: FT31566
2026-03-30 07:46:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with scrape type 2
2026-03-30 07:46:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with scrape type 2
2026-03-30 07:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c3dcf3e-dd90-5c47-bbe7-026b1941582b, identifier: FT31566
2026-03-30 07:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with identifier: FT31566
2026-03-30 07:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with identifier: FT31566
2026-03-30 07:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c3dcf3e-dd90-5c47-bbe7-026b1941582b with identifier: FT31566 to the API
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:11:13Z',
 'fuel_type': 'petrol',
 'id': '2c3dcf3e-dd90-5c47-bbe7-026b1941582b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT31566',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 167153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-02',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Edition 7',
 'transmission': 'manual',
 'trim': 'Edition 7',
 'year': 2014}
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT31566%27 HTTP/1.1" 200 None
2026-03-30 07:46:39 [auto1.de] INFO: Saving data for FT31566: {'auction_closing_time': 1774883473.0, 'created_time': 1774550714.589328, 'last_price_update_time': 1774856799.370074}
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT31566') HTTP/1.1" 204 0
2026-03-30 07:46:39 [auto1.de] INFO: Found listing with ID: HK24290
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK24290%27 HTTP/1.1" 200 None
2026-03-30 07:46:39 [auto1.de] INFO: Scrape type for HK24290: 0
2026-03-30 07:46:39 [auto1.de] INFO: Found listing with ID: AH71943
2026-03-30 07:46:39 [auto1.de] INFO: Found listing with ID: PK47596
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PK47596%27 HTTP/1.1" 200 None
2026-03-30 07:46:39 [auto1.de] INFO: Scrape type for PK47596: 0
2026-03-30 07:46:39 [auto1.de] INFO: Found listing with ID: JN51648
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN51648%27 HTTP/1.1" 200 None
2026-03-30 07:46:39 [auto1.de] INFO: Scrape type for JN51648: 0
2026-03-30 07:46:39 [auto1.de] INFO: Found listing with ID: TG58212
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG58212%27 HTTP/1.1" 200 None
2026-03-30 07:46:39 [auto1.de] INFO: Scrape type for TG58212: 2
2026-03-30 07:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e19c4edb-121e-518d-8242-3328753fe37b with identifier: TG58212
2026-03-30 07:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e19c4edb-121e-518d-8242-3328753fe37b with scrape type 2
2026-03-30 07:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e19c4edb-121e-518d-8242-3328753fe37b with scrape type 2
2026-03-30 07:46:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e19c4edb-121e-518d-8242-3328753fe37b, identifier: TG58212
2026-03-30 07:46:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e19c4edb-121e-518d-8242-3328753fe37b with identifier: TG58212
2026-03-30 07:46:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e19c4edb-121e-518d-8242-3328753fe37b with identifier: TG58212
2026-03-30 07:46:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e19c4edb-121e-518d-8242-3328753fe37b with identifier: TG58212 to the API
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:34:48Z',
 'fuel_type': 'petrol',
 'id': 'e19c4edb-121e-518d-8242-3328753fe37b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG58212',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 114267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-03',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Advance BlueMotion',
 'transmission': 'manual',
 'trim': 'Advance BlueMotion',
 'year': 2017}
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG58212%27 HTTP/1.1" 200 None
2026-03-30 07:46:39 [auto1.de] INFO: Saving data for TG58212: {'auction_closing_time': 1774884888.0, 'created_time': 1774638963.054467, 'last_price_update_time': 1774856799.904924}
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG58212') HTTP/1.1" 204 0
2026-03-30 07:46:39 [auto1.de] INFO: Found listing with ID: AN45666
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN45666%27 HTTP/1.1" 200 None
2026-03-30 07:46:39 [auto1.de] INFO: Scrape type for AN45666: 0
2026-03-30 07:46:39 [auto1.de] INFO: Found listing with ID: LW56593
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW56593%27 HTTP/1.1" 200 None
2026-03-30 07:46:39 [auto1.de] INFO: Scrape type for LW56593: 2
2026-03-30 07:46:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4163c1ed-9c35-568d-adac-e78b0e25dd22 with identifier: LW56593
2026-03-30 07:46:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4163c1ed-9c35-568d-adac-e78b0e25dd22 with scrape type 2
2026-03-30 07:46:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4163c1ed-9c35-568d-adac-e78b0e25dd22 with scrape type 2
2026-03-30 07:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4163c1ed-9c35-568d-adac-e78b0e25dd22, identifier: LW56593
2026-03-30 07:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4163c1ed-9c35-568d-adac-e78b0e25dd22 with identifier: LW56593
2026-03-30 07:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4163c1ed-9c35-568d-adac-e78b0e25dd22 with identifier: LW56593
2026-03-30 07:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4163c1ed-9c35-568d-adac-e78b0e25dd22 with identifier: LW56593 to the API
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:51:28Z',
 'fuel_type': 'diesel',
 'id': '4163c1ed-9c35-568d-adac-e78b0e25dd22',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW56593',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 128110,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-08',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW56593%27 HTTP/1.1" 200 None
2026-03-30 07:46:40 [auto1.de] INFO: Saving data for LW56593: {'auction_closing_time': 1774885888.0, 'created_time': 1774639839.685614, 'last_price_update_time': 1774856800.3461}
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LW56593') HTTP/1.1" 204 0
2026-03-30 07:46:40 [auto1.de] INFO: Found listing with ID: MG63340
2026-03-30 07:46:40 [auto1.de] INFO: Found listing with ID: KK98414
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK98414%27 HTTP/1.1" 200 None
2026-03-30 07:46:40 [auto1.de] INFO: Scrape type for KK98414: 2
2026-03-30 07:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2286ee2d-b8e0-56db-adf7-933575c02c06 with identifier: KK98414
2026-03-30 07:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2286ee2d-b8e0-56db-adf7-933575c02c06 with scrape type 2
2026-03-30 07:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2286ee2d-b8e0-56db-adf7-933575c02c06 with scrape type 2
2026-03-30 07:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2286ee2d-b8e0-56db-adf7-933575c02c06, identifier: KK98414
2026-03-30 07:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2286ee2d-b8e0-56db-adf7-933575c02c06 with identifier: KK98414
2026-03-30 07:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2286ee2d-b8e0-56db-adf7-933575c02c06 with identifier: KK98414
2026-03-30 07:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2286ee2d-b8e0-56db-adf7-933575c02c06 with identifier: KK98414 to the API
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 457,
 'expiration_date': '2026-03-30T15:01:28Z',
 'fuel_type': 'petrol',
 'id': '2286ee2d-b8e0-56db-adf7-933575c02c06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK98414',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLS-Klasse',
 'odometer': 78794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-08',
 'seller_name': None,
 'title': 'Mercedes-Benz CLS-Klasse CLS 53 AMG Mild-Hybrid 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK98414%27 HTTP/1.1" 200 None
2026-03-30 07:46:40 [auto1.de] INFO: Saving data for KK98414: {'auction_closing_time': 1774882888.0, 'created_time': 1773381878.207926, 'last_price_update_time': 1774856800.738975}
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KK98414') HTTP/1.1" 204 0
2026-03-30 07:46:40 [auto1.de] INFO: Found listing with ID: WL72774
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL72774%27 HTTP/1.1" 200 None
2026-03-30 07:46:40 [auto1.de] INFO: Scrape type for WL72774: 2
2026-03-30 07:46:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b696fca-8de9-5024-903d-285d23b09598 with identifier: WL72774
2026-03-30 07:46:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b696fca-8de9-5024-903d-285d23b09598 with scrape type 2
2026-03-30 07:46:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b696fca-8de9-5024-903d-285d23b09598 with scrape type 2
2026-03-30 07:46:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b696fca-8de9-5024-903d-285d23b09598, identifier: WL72774
2026-03-30 07:46:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:46:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b696fca-8de9-5024-903d-285d23b09598 with identifier: WL72774
2026-03-30 07:46:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b696fca-8de9-5024-903d-285d23b09598 with identifier: WL72774
2026-03-30 07:46:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b696fca-8de9-5024-903d-285d23b09598 with identifier: WL72774 to the API
2026-03-30 07:46:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:18Z',
 'fuel_type': 'petrol',
 'id': '4b696fca-8de9-5024-903d-285d23b09598',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL72774',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 193260,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT IQ.DRIVE',
 'transmission': 'automatic',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL72774%27 HTTP/1.1" 200 None
2026-03-30 07:46:41 [auto1.de] INFO: Saving data for WL72774: {'auction_closing_time': 1774885698.0, 'created_time': 1774639704.64017, 'last_price_update_time': 1774856801.192166}
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL72774') HTTP/1.1" 204 0
2026-03-30 07:46:41 [auto1.de] INFO: Found listing with ID: LS10539
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS10539%27 HTTP/1.1" 200 None
2026-03-30 07:46:41 [auto1.de] INFO: Scrape type for LS10539: 0
2026-03-30 07:46:41 [auto1.de] INFO: Found listing with ID: JN06918
2026-03-30 07:46:41 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-30 07:46:41 [auto1.de] INFO: Scrape type for MW91304: 0
2026-03-30 07:46:41 [auto1.de] INFO: Channel: 24h | Page: 126 | totalHits: 8383 | hits on page: 40
2026-03-30 07:46:41 [auto1.de] INFO: Found listing with ID: MW91304
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW91304%27 HTTP/1.1" 200 None
2026-03-30 07:46:41 [auto1.de] INFO: Scrape type for MW91304: 0
2026-03-30 07:46:41 [auto1.de] INFO: Found listing with ID: UY19816
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY19816%27 HTTP/1.1" 200 None
2026-03-30 07:46:41 [auto1.de] INFO: Scrape type for UY19816: 0
2026-03-30 07:46:41 [auto1.de] INFO: Found listing with ID: AR60138
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR60138%27 HTTP/1.1" 200 None
2026-03-30 07:46:41 [auto1.de] INFO: Scrape type for AR60138: 2
2026-03-30 07:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc2e9241-efe3-5c3b-aac9-6dd193077e01 with identifier: AR60138
2026-03-30 07:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc2e9241-efe3-5c3b-aac9-6dd193077e01 with scrape type 2
2026-03-30 07:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cc2e9241-efe3-5c3b-aac9-6dd193077e01 with scrape type 2
2026-03-30 07:46:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cc2e9241-efe3-5c3b-aac9-6dd193077e01, identifier: AR60138
2026-03-30 07:46:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cc2e9241-efe3-5c3b-aac9-6dd193077e01 with identifier: AR60138
2026-03-30 07:46:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cc2e9241-efe3-5c3b-aac9-6dd193077e01 with identifier: AR60138
2026-03-30 07:46:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cc2e9241-efe3-5c3b-aac9-6dd193077e01 with identifier: AR60138 to the API
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:40:27Z',
 'fuel_type': 'petrol',
 'id': 'cc2e9241-efe3-5c3b-aac9-6dd193077e01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR60138',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 83003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seller_name': None,
 'title': 'Renault Clio 1.2 YAHOO!',
 'transmission': 'manual',
 'trim': 'YAHOO!',
 'year': 2012}
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR60138%27 HTTP/1.1" 200 None
2026-03-30 07:46:41 [auto1.de] INFO: Saving data for AR60138: {'auction_closing_time': 1774885227.0, 'created_time': 1774553046.597611, 'last_price_update_time': 1774856801.693931}
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR60138') HTTP/1.1" 204 0
2026-03-30 07:46:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:41 [auto1.de] INFO: Found listing with ID: MX37955
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37955%27 HTTP/1.1" 200 None
2026-03-30 07:46:41 [auto1.de] INFO: Scrape type for MX37955: 2
2026-03-30 07:46:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1ba7db6-2f50-50ff-a364-94a95f35fdfd with identifier: MX37955
2026-03-30 07:46:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1ba7db6-2f50-50ff-a364-94a95f35fdfd with scrape type 2
2026-03-30 07:46:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1ba7db6-2f50-50ff-a364-94a95f35fdfd with scrape type 2
2026-03-30 07:46:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1ba7db6-2f50-50ff-a364-94a95f35fdfd, identifier: MX37955
2026-03-30 07:46:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1ba7db6-2f50-50ff-a364-94a95f35fdfd with identifier: MX37955
2026-03-30 07:46:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1ba7db6-2f50-50ff-a364-94a95f35fdfd with identifier: MX37955
2026-03-30 07:46:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1ba7db6-2f50-50ff-a364-94a95f35fdfd with identifier: MX37955 to the API
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:23:46Z',
 'fuel_type': 'petrol',
 'id': 'c1ba7db6-2f50-50ff-a364-94a95f35fdfd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX37955',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Roadster',
 'odometer': 122743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-19',
 'seller_name': None,
 'title': 'MINI Roadster Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX37955%27 HTTP/1.1" 200 None
2026-03-30 07:46:42 [auto1.de] INFO: Saving data for MX37955: {'auction_closing_time': 1774884226.0, 'created_time': 1774639052.077917, 'last_price_update_time': 1774856802.531508}
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX37955') HTTP/1.1" 204 0
2026-03-30 07:46:42 [auto1.de] INFO: Found listing with ID: UE11202
2026-03-30 07:46:42 [auto1.de] INFO: Found listing with ID: HU16718
2026-03-30 07:46:42 [auto1.de] INFO: Found listing with ID: AH29152
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH29152%27 HTTP/1.1" 200 None
2026-03-30 07:46:42 [auto1.de] INFO: Scrape type for AH29152: 0
2026-03-30 07:46:42 [auto1.de] INFO: Found listing with ID: LP86406
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP86406%27 HTTP/1.1" 200 None
2026-03-30 07:46:42 [auto1.de] INFO: Scrape type for LP86406: 2
2026-03-30 07:46:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with identifier: LP86406
2026-03-30 07:46:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with scrape type 2
2026-03-30 07:46:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with scrape type 2
2026-03-30 07:46:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d1899c9-a698-5122-b796-a8b6dd2ec5a5, identifier: LP86406
2026-03-30 07:46:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with identifier: LP86406
2026-03-30 07:46:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with identifier: LP86406
2026-03-30 07:46:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d1899c9-a698-5122-b796-a8b6dd2ec5a5 with identifier: LP86406 to the API
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:37:16Z',
 'fuel_type': 'petrol',
 'id': '7d1899c9-a698-5122-b796-a8b6dd2ec5a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP86406',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 65103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-14',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2019}
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LP86406%27 HTTP/1.1" 200 None
2026-03-30 07:46:42 [auto1.de] INFO: Saving data for LP86406: {'auction_closing_time': 1774885036.0, 'created_time': 1774553042.33066, 'last_price_update_time': 1774856802.96745}
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LP86406') HTTP/1.1" 204 0
2026-03-30 07:46:42 [auto1.de] INFO: Found listing with ID: VS89530
2026-03-30 07:46:42 [auto1.de] INFO: Found listing with ID: ZJ39351
2026-03-30 07:46:42 [auto1.de] INFO: Found listing with ID: HZ19691
2026-03-30 07:46:42 [auto1.de] INFO: Found listing with ID: RR18814
2026-03-30 07:46:42 [auto1.de] INFO: Found listing with ID: FJ71041
2026-03-30 07:46:42 [auto1.de] INFO: Found listing with ID: DT28740
2026-03-30 07:46:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT28740%27 HTTP/1.1" 200 None
2026-03-30 07:46:43 [auto1.de] INFO: Scrape type for DT28740: 2
2026-03-30 07:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b6f407a-4550-5cf2-aa4f-e09fab7b1b71 with identifier: DT28740
2026-03-30 07:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b6f407a-4550-5cf2-aa4f-e09fab7b1b71 with scrape type 2
2026-03-30 07:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b6f407a-4550-5cf2-aa4f-e09fab7b1b71 with scrape type 2
2026-03-30 07:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2b6f407a-4550-5cf2-aa4f-e09fab7b1b71, identifier: DT28740
2026-03-30 07:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2b6f407a-4550-5cf2-aa4f-e09fab7b1b71 with identifier: DT28740
2026-03-30 07:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2b6f407a-4550-5cf2-aa4f-e09fab7b1b71 with identifier: DT28740
2026-03-30 07:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2b6f407a-4550-5cf2-aa4f-e09fab7b1b71 with identifier: DT28740 to the API
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:11Z',
 'fuel_type': 'petrol',
 'id': '2b6f407a-4550-5cf2-aa4f-e09fab7b1b71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT28740',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 84171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-31',
 'seller_name': None,
 'title': 'Seat Arona 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2021}
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT28740%27 HTTP/1.1" 200 None
2026-03-30 07:46:43 [auto1.de] INFO: Saving data for DT28740: {'auction_closing_time': 1774885031.0, 'created_time': 1774639026.741245, 'last_price_update_time': 1774856803.40586}
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT28740') HTTP/1.1" 204 0
2026-03-30 07:46:43 [auto1.de] INFO: Found listing with ID: WY11895
2026-03-30 07:46:43 [auto1.de] INFO: Found listing with ID: MD93182
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD93182%27 HTTP/1.1" 200 None
2026-03-30 07:46:43 [auto1.de] INFO: Scrape type for MD93182: 2
2026-03-30 07:46:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4a3f794-87fa-5a84-9b2c-16ff035da7d4 with identifier: MD93182
2026-03-30 07:46:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4a3f794-87fa-5a84-9b2c-16ff035da7d4 with scrape type 2
2026-03-30 07:46:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4a3f794-87fa-5a84-9b2c-16ff035da7d4 with scrape type 2
2026-03-30 07:46:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4a3f794-87fa-5a84-9b2c-16ff035da7d4, identifier: MD93182
2026-03-30 07:46:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4a3f794-87fa-5a84-9b2c-16ff035da7d4 with identifier: MD93182
2026-03-30 07:46:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4a3f794-87fa-5a84-9b2c-16ff035da7d4 with identifier: MD93182
2026-03-30 07:46:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4a3f794-87fa-5a84-9b2c-16ff035da7d4 with identifier: MD93182 to the API
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:05:02Z',
 'fuel_type': 'petrol',
 'id': 'd4a3f794-87fa-5a84-9b2c-16ff035da7d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD93182',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 156627,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-26',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Salt & Pepper',
 'transmission': 'manual',
 'trim': 'Salt & Pepper',
 'year': 2012}
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD93182%27 HTTP/1.1" 200 None
2026-03-30 07:46:43 [auto1.de] INFO: Saving data for MD93182: {'auction_closing_time': 1774883102.0, 'created_time': 1774640235.055714, 'last_price_update_time': 1774856803.911368}
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD93182') HTTP/1.1" 204 0
2026-03-30 07:46:43 [auto1.de] INFO: Found listing with ID: LC91411
2026-03-30 07:46:43 [auto1.de] INFO: Found listing with ID: FZ44442
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ44442%27 HTTP/1.1" 200 None
2026-03-30 07:46:43 [auto1.de] INFO: Scrape type for FZ44442: 0
2026-03-30 07:46:43 [auto1.de] INFO: Found listing with ID: VE70317
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE70317%27 HTTP/1.1" 200 None
2026-03-30 07:46:43 [auto1.de] INFO: Scrape type for VE70317: 0
2026-03-30 07:46:43 [auto1.de] INFO: Found listing with ID: NY19608
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY19608%27 HTTP/1.1" 200 None
2026-03-30 07:46:43 [auto1.de] INFO: Scrape type for NY19608: 0
2026-03-30 07:46:43 [auto1.de] INFO: Found listing with ID: SR18060
2026-03-30 07:46:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR18060%27 HTTP/1.1" 200 None
2026-03-30 07:46:44 [auto1.de] INFO: Scrape type for SR18060: 0
2026-03-30 07:46:44 [auto1.de] INFO: Found listing with ID: VL50005
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL50005%27 HTTP/1.1" 200 None
2026-03-30 07:46:44 [auto1.de] INFO: Scrape type for VL50005: 0
2026-03-30 07:46:44 [auto1.de] INFO: Found listing with ID: AY55181
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY55181%27 HTTP/1.1" 200 None
2026-03-30 07:46:44 [auto1.de] INFO: Scrape type for AY55181: 2
2026-03-30 07:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a3d5e68-c866-5888-8aff-a7b8e9ffcce2 with identifier: AY55181
2026-03-30 07:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a3d5e68-c866-5888-8aff-a7b8e9ffcce2 with scrape type 2
2026-03-30 07:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a3d5e68-c866-5888-8aff-a7b8e9ffcce2 with scrape type 2
2026-03-30 07:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a3d5e68-c866-5888-8aff-a7b8e9ffcce2, identifier: AY55181
2026-03-30 07:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a3d5e68-c866-5888-8aff-a7b8e9ffcce2 with identifier: AY55181
2026-03-30 07:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a3d5e68-c866-5888-8aff-a7b8e9ffcce2 with identifier: AY55181
2026-03-30 07:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a3d5e68-c866-5888-8aff-a7b8e9ffcce2 with identifier: AY55181 to the API
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:53:42Z',
 'fuel_type': 'petrol',
 'id': '1a3d5e68-c866-5888-8aff-a7b8e9ffcce2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY55181',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'XV',
 'odometer': 40514,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-01',
 'seller_name': None,
 'title': 'Subaru XV 2.0 Exclusive+',
 'transmission': 'automatic',
 'trim': 'Exclusive+',
 'year': 2018}
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY55181%27 HTTP/1.1" 200 None
2026-03-30 07:46:44 [auto1.de] INFO: Saving data for AY55181: {'auction_closing_time': 1774886022.0, 'created_time': 1774035474.234461, 'last_price_update_time': 1774856804.413542}
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY55181') HTTP/1.1" 204 0
2026-03-30 07:46:44 [auto1.de] INFO: Found listing with ID: NA53807
2026-03-30 07:46:44 [auto1.de] INFO: Found listing with ID: UW78098
2026-03-30 07:46:44 [auto1.de] INFO: Found listing with ID: AE84214
2026-03-30 07:46:44 [auto1.de] INFO: Found listing with ID: XU28434
2026-03-30 07:46:44 [auto1.de] INFO: Found listing with ID: ZM65960
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65960%27 HTTP/1.1" 200 None
2026-03-30 07:46:44 [auto1.de] INFO: Scrape type for ZM65960: 2
2026-03-30 07:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b89a15-4d0c-530a-8004-226f9414d7de with identifier: ZM65960
2026-03-30 07:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b89a15-4d0c-530a-8004-226f9414d7de with scrape type 2
2026-03-30 07:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71b89a15-4d0c-530a-8004-226f9414d7de with scrape type 2
2026-03-30 07:46:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 71b89a15-4d0c-530a-8004-226f9414d7de, identifier: ZM65960
2026-03-30 07:46:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 71b89a15-4d0c-530a-8004-226f9414d7de with identifier: ZM65960
2026-03-30 07:46:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 71b89a15-4d0c-530a-8004-226f9414d7de with identifier: ZM65960
2026-03-30 07:46:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 71b89a15-4d0c-530a-8004-226f9414d7de with identifier: ZM65960 to the API
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:57:47Z',
 'fuel_type': 'petrol',
 'id': '71b89a15-4d0c-530a-8004-226f9414d7de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM65960',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 142011,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-02',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Trend 2WD',
 'transmission': 'automatic',
 'trim': 'Trend 2WD',
 'year': 2017}
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM65960%27 HTTP/1.1" 200 None
2026-03-30 07:46:44 [auto1.de] INFO: Saving data for ZM65960: {'auction_closing_time': 1774886267.0, 'created_time': 1773916631.939725, 'last_price_update_time': 1774856804.832779}
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM65960') HTTP/1.1" 204 0
2026-03-30 07:46:44 [auto1.de] INFO: Found listing with ID: KD94440
2026-03-30 07:46:44 [auto1.de] INFO: Found listing with ID: TL66452
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TL66452%27 HTTP/1.1" 200 None
2026-03-30 07:46:44 [auto1.de] INFO: Scrape type for TL66452: 0
2026-03-30 07:46:44 [auto1.de] INFO: Found listing with ID: XR62561
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR62561%27 HTTP/1.1" 200 None
2026-03-30 07:46:44 [auto1.de] INFO: Scrape type for XR62561: 2
2026-03-30 07:46:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a368ee1-4dbd-5598-87da-45d7847891a6 with identifier: XR62561
2026-03-30 07:46:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a368ee1-4dbd-5598-87da-45d7847891a6 with scrape type 2
2026-03-30 07:46:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a368ee1-4dbd-5598-87da-45d7847891a6 with scrape type 2
2026-03-30 07:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a368ee1-4dbd-5598-87da-45d7847891a6, identifier: XR62561
2026-03-30 07:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a368ee1-4dbd-5598-87da-45d7847891a6 with identifier: XR62561
2026-03-30 07:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a368ee1-4dbd-5598-87da-45d7847891a6 with identifier: XR62561
2026-03-30 07:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a368ee1-4dbd-5598-87da-45d7847891a6 with identifier: XR62561 to the API
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:10:13Z',
 'fuel_type': 'diesel',
 'id': '1a368ee1-4dbd-5598-87da-45d7847891a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR62561',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 261043,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-12-04',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2006}
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR62561%27 HTTP/1.1" 200 None
2026-03-30 07:46:45 [auto1.de] INFO: Saving data for XR62561: {'auction_closing_time': 1774883413.0, 'created_time': 1774639092.000883, 'last_price_update_time': 1774856805.379677}
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR62561') HTTP/1.1" 204 0
2026-03-30 07:46:45 [auto1.de] INFO: Found listing with ID: DX51383
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX51383%27 HTTP/1.1" 200 None
2026-03-30 07:46:45 [auto1.de] INFO: Scrape type for DX51383: 2
2026-03-30 07:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab1dabef-d9e1-5b40-9260-70bed80d76fb with identifier: DX51383
2026-03-30 07:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab1dabef-d9e1-5b40-9260-70bed80d76fb with scrape type 2
2026-03-30 07:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab1dabef-d9e1-5b40-9260-70bed80d76fb with scrape type 2
2026-03-30 07:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab1dabef-d9e1-5b40-9260-70bed80d76fb, identifier: DX51383
2026-03-30 07:46:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab1dabef-d9e1-5b40-9260-70bed80d76fb with identifier: DX51383
2026-03-30 07:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab1dabef-d9e1-5b40-9260-70bed80d76fb with identifier: DX51383
2026-03-30 07:46:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab1dabef-d9e1-5b40-9260-70bed80d76fb with identifier: DX51383 to the API
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:16:12Z',
 'fuel_type': 'diesel',
 'id': 'ab1dabef-d9e1-5b40-9260-70bed80d76fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX51383',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 135955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-10',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2018}
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX51383%27 HTTP/1.1" 200 None
2026-03-30 07:46:45 [auto1.de] INFO: Saving data for DX51383: {'auction_closing_time': 1774883772.0, 'created_time': 1774553022.334996, 'last_price_update_time': 1774856805.784537}
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX51383') HTTP/1.1" 204 0
2026-03-30 07:46:45 [auto1.de] INFO: Found listing with ID: KL26301
2026-03-30 07:46:45 [auto1.de] INFO: Found listing with ID: WK26503
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK26503%27 HTTP/1.1" 200 None
2026-03-30 07:46:45 [auto1.de] INFO: Scrape type for WK26503: 2
2026-03-30 07:46:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e292575c-13bd-5658-b67f-9197f3ef0e1d with identifier: WK26503
2026-03-30 07:46:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e292575c-13bd-5658-b67f-9197f3ef0e1d with scrape type 2
2026-03-30 07:46:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e292575c-13bd-5658-b67f-9197f3ef0e1d with scrape type 2
2026-03-30 07:46:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e292575c-13bd-5658-b67f-9197f3ef0e1d, identifier: WK26503
2026-03-30 07:46:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e292575c-13bd-5658-b67f-9197f3ef0e1d with identifier: WK26503
2026-03-30 07:46:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e292575c-13bd-5658-b67f-9197f3ef0e1d with identifier: WK26503
2026-03-30 07:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e292575c-13bd-5658-b67f-9197f3ef0e1d with identifier: WK26503 to the API
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 389,
 'expiration_date': '2026-03-30T15:52:17Z',
 'fuel_type': 'petrol',
 'id': 'e292575c-13bd-5658-b67f-9197f3ef0e1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK26503',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 99709,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 450 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2019}
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK26503%27 HTTP/1.1" 200 None
2026-03-30 07:46:46 [auto1.de] INFO: Saving data for WK26503: {'auction_closing_time': 1774885937.0, 'created_time': 1774550745.513676, 'last_price_update_time': 1774856806.428849}
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK26503') HTTP/1.1" 204 0
2026-03-30 07:46:46 [auto1.de] INFO: Found listing with ID: UK28152
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK28152%27 HTTP/1.1" 200 None
2026-03-30 07:46:46 [auto1.de] INFO: Scrape type for UK28152: 0
2026-03-30 07:46:46 [auto1.de] INFO: Found listing with ID: CV55682
2026-03-30 07:46:46 [auto1.de] INFO: Found listing with ID: MR72377
2026-03-30 07:46:46 [auto1.de] INFO: Found listing with ID: FF92976
2026-03-30 07:46:46 [auto1.de] INFO: Found listing with ID: BV74864
2026-03-30 07:46:46 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-30 07:46:46 [auto1.de] INFO: Channel: 24h | Page: 127 | totalHits: 8384 | hits on page: 40
2026-03-30 07:46:46 [auto1.de] INFO: Found listing with ID: RZ91984
2026-03-30 07:46:46 [auto1.de] INFO: Found listing with ID: SX94588
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX94588%27 HTTP/1.1" 200 None
2026-03-30 07:46:46 [auto1.de] INFO: Scrape type for SX94588: 2
2026-03-30 07:46:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bf6fa45-4ac2-548c-8b51-58e04b5049d7 with identifier: SX94588
2026-03-30 07:46:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5bf6fa45-4ac2-548c-8b51-58e04b5049d7 with scrape type 2
2026-03-30 07:46:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5bf6fa45-4ac2-548c-8b51-58e04b5049d7 with scrape type 2
2026-03-30 07:46:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5bf6fa45-4ac2-548c-8b51-58e04b5049d7, identifier: SX94588
2026-03-30 07:46:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5bf6fa45-4ac2-548c-8b51-58e04b5049d7 with identifier: SX94588
2026-03-30 07:46:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5bf6fa45-4ac2-548c-8b51-58e04b5049d7 with identifier: SX94588
2026-03-30 07:46:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5bf6fa45-4ac2-548c-8b51-58e04b5049d7 with identifier: SX94588 to the API
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:36:08Z',
 'fuel_type': 'petrol',
 'id': '5bf6fa45-4ac2-548c-8b51-58e04b5049d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX94588',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 128100,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-10',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Trend 2WD',
 'transmission': 'manual',
 'trim': 'Trend 2WD',
 'year': 2018}
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX94588%27 HTTP/1.1" 200 None
2026-03-30 07:46:46 [auto1.de] INFO: Saving data for SX94588: {'auction_closing_time': 1774884968.0, 'created_time': 1774639455.196186, 'last_price_update_time': 1774856806.93822}
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX94588') HTTP/1.1" 204 0
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: JU32018
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: DB64139
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB64139%27 HTTP/1.1" 200 None
2026-03-30 07:46:47 [auto1.de] INFO: Scrape type for DB64139: 2
2026-03-30 07:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1825811e-6106-5f7b-8ed1-5c6a52e19900 with identifier: DB64139
2026-03-30 07:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1825811e-6106-5f7b-8ed1-5c6a52e19900 with scrape type 2
2026-03-30 07:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1825811e-6106-5f7b-8ed1-5c6a52e19900 with scrape type 2
2026-03-30 07:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1825811e-6106-5f7b-8ed1-5c6a52e19900, identifier: DB64139
2026-03-30 07:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1825811e-6106-5f7b-8ed1-5c6a52e19900 with identifier: DB64139
2026-03-30 07:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1825811e-6106-5f7b-8ed1-5c6a52e19900 with identifier: DB64139
2026-03-30 07:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1825811e-6106-5f7b-8ed1-5c6a52e19900 with identifier: DB64139 to the API
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:05:48Z',
 'fuel_type': 'diesel',
 'id': '1825811e-6106-5f7b-8ed1-5c6a52e19900',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB64139',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 151277,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 d BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueTEC Avantgarde',
 'year': 2016}
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB64139%27 HTTP/1.1" 200 None
2026-03-30 07:46:47 [auto1.de] INFO: Saving data for DB64139: {'auction_closing_time': 1774883148.0, 'created_time': 1774639928.62658, 'last_price_update_time': 1774856807.458864}
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB64139') HTTP/1.1" 204 0
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: RU59623
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU59623%27 HTTP/1.1" 200 None
2026-03-30 07:46:47 [auto1.de] INFO: Scrape type for RU59623: 0
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: FJ91980
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: YJ68996
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ68996%27 HTTP/1.1" 200 None
2026-03-30 07:46:47 [auto1.de] INFO: Scrape type for YJ68996: 0
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: RS77004
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: HX66232
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX66232%27 HTTP/1.1" 200 None
2026-03-30 07:46:47 [auto1.de] INFO: Scrape type for HX66232: 0
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: TV33488
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: GS36326
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: BN30919
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: CW72943
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW72943%27 HTTP/1.1" 200 None
2026-03-30 07:46:47 [auto1.de] INFO: Scrape type for CW72943: 0
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: DF38507
2026-03-30 07:46:47 [auto1.de] INFO: Found listing with ID: HP10978
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP10978%27 HTTP/1.1" 200 None
2026-03-30 07:46:47 [auto1.de] INFO: Scrape type for HP10978: 2
2026-03-30 07:46:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52214a14-d6df-59d5-ae58-417ced2f7810 with identifier: HP10978
2026-03-30 07:46:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52214a14-d6df-59d5-ae58-417ced2f7810 with scrape type 2
2026-03-30 07:46:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52214a14-d6df-59d5-ae58-417ced2f7810 with scrape type 2
2026-03-30 07:46:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52214a14-d6df-59d5-ae58-417ced2f7810, identifier: HP10978
2026-03-30 07:46:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52214a14-d6df-59d5-ae58-417ced2f7810 with identifier: HP10978
2026-03-30 07:46:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52214a14-d6df-59d5-ae58-417ced2f7810 with identifier: HP10978
2026-03-30 07:46:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52214a14-d6df-59d5-ae58-417ced2f7810 with identifier: HP10978 to the API
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:23:44Z',
 'fuel_type': 'petrol',
 'id': '52214a14-d6df-59d5-ae58-417ced2f7810',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP10978',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 257607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-22',
 'seller_name': None,
 'title': 'Ford Mondeo 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP10978%27 HTTP/1.1" 200 None
2026-03-30 07:46:48 [auto1.de] INFO: Saving data for HP10978: {'auction_closing_time': 1774884224.0, 'created_time': 1774639618.21168, 'last_price_update_time': 1774856808.029982}
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HP10978') HTTP/1.1" 204 0
2026-03-30 07:46:48 [auto1.de] INFO: Found listing with ID: NX47984
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX47984%27 HTTP/1.1" 200 None
2026-03-30 07:46:48 [auto1.de] INFO: Scrape type for NX47984: 2
2026-03-30 07:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15fb07cd-d00d-5b9e-a01c-d021131b3682 with identifier: NX47984
2026-03-30 07:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15fb07cd-d00d-5b9e-a01c-d021131b3682 with scrape type 2
2026-03-30 07:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15fb07cd-d00d-5b9e-a01c-d021131b3682 with scrape type 2
2026-03-30 07:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15fb07cd-d00d-5b9e-a01c-d021131b3682, identifier: NX47984
2026-03-30 07:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15fb07cd-d00d-5b9e-a01c-d021131b3682 with identifier: NX47984
2026-03-30 07:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15fb07cd-d00d-5b9e-a01c-d021131b3682 with identifier: NX47984
2026-03-30 07:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15fb07cd-d00d-5b9e-a01c-d021131b3682 with identifier: NX47984 to the API
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:10:26Z',
 'fuel_type': 'diesel',
 'id': '15fb07cd-d00d-5b9e-a01c-d021131b3682',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX47984',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 226051,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2016}
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX47984%27 HTTP/1.1" 200 None
2026-03-30 07:46:48 [auto1.de] INFO: Saving data for NX47984: {'auction_closing_time': 1774883426.0, 'created_time': 1774553187.887162, 'last_price_update_time': 1774856808.652919}
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX47984') HTTP/1.1" 204 0
2026-03-30 07:46:48 [auto1.de] INFO: Found listing with ID: BR64184
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR64184%27 HTTP/1.1" 200 None
2026-03-30 07:46:48 [auto1.de] INFO: Scrape type for BR64184: 2
2026-03-30 07:46:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f092b9ce-ae69-5b7f-b561-e5b962839b52 with identifier: BR64184
2026-03-30 07:46:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f092b9ce-ae69-5b7f-b561-e5b962839b52 with scrape type 2
2026-03-30 07:46:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f092b9ce-ae69-5b7f-b561-e5b962839b52 with scrape type 2
2026-03-30 07:46:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f092b9ce-ae69-5b7f-b561-e5b962839b52, identifier: BR64184
2026-03-30 07:46:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f092b9ce-ae69-5b7f-b561-e5b962839b52 with identifier: BR64184
2026-03-30 07:46:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f092b9ce-ae69-5b7f-b561-e5b962839b52 with identifier: BR64184
2026-03-30 07:46:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f092b9ce-ae69-5b7f-b561-e5b962839b52 with identifier: BR64184 to the API
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:00:23Z',
 'fuel_type': 'diesel',
 'id': 'f092b9ce-ae69-5b7f-b561-e5b962839b52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR64184',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 170937,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-16',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2016}
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR64184%27 HTTP/1.1" 200 None
2026-03-30 07:46:49 [auto1.de] INFO: Saving data for BR64184: {'auction_closing_time': 1774882823.0, 'created_time': 1774639902.588857, 'last_price_update_time': 1774856809.059325}
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR64184') HTTP/1.1" 204 0
2026-03-30 07:46:49 [auto1.de] INFO: Found listing with ID: FD55088
2026-03-30 07:46:49 [auto1.de] INFO: Found listing with ID: GA25019
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA25019%27 HTTP/1.1" 200 None
2026-03-30 07:46:49 [auto1.de] INFO: Scrape type for GA25019: 2
2026-03-30 07:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba433791-6f64-5e5f-9852-6979b643052a with identifier: GA25019
2026-03-30 07:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba433791-6f64-5e5f-9852-6979b643052a with scrape type 2
2026-03-30 07:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba433791-6f64-5e5f-9852-6979b643052a with scrape type 2
2026-03-30 07:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba433791-6f64-5e5f-9852-6979b643052a, identifier: GA25019
2026-03-30 07:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba433791-6f64-5e5f-9852-6979b643052a with identifier: GA25019
2026-03-30 07:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba433791-6f64-5e5f-9852-6979b643052a with identifier: GA25019
2026-03-30 07:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba433791-6f64-5e5f-9852-6979b643052a with identifier: GA25019 to the API
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:08:32Z',
 'fuel_type': 'diesel',
 'id': 'ba433791-6f64-5e5f-9852-6979b643052a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA25019',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 104636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-28',
 'seller_name': None,
 'title': 'Fiat Ducato 2.3 JTD 130 L4',
 'transmission': 'manual',
 'trim': '130 L4',
 'year': 2013}
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA25019%27 HTTP/1.1" 200 None
2026-03-30 07:46:49 [auto1.de] INFO: Saving data for GA25019: {'auction_closing_time': 1774883312.0, 'created_time': 1774035190.672538, 'last_price_update_time': 1774856809.49036}
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GA25019') HTTP/1.1" 204 0
2026-03-30 07:46:49 [auto1.de] INFO: Found listing with ID: CW96119
2026-03-30 07:46:49 [auto1.de] INFO: Found listing with ID: SJ47682
2026-03-30 07:46:49 [auto1.de] INFO: Found listing with ID: CG28709
2026-03-30 07:46:49 [auto1.de] INFO: Found listing with ID: YH89346
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH89346%27 HTTP/1.1" 200 None
2026-03-30 07:46:49 [auto1.de] INFO: Scrape type for YH89346: 2
2026-03-30 07:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18928e1a-a418-5472-a5ec-a83505998b63 with identifier: YH89346
2026-03-30 07:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18928e1a-a418-5472-a5ec-a83505998b63 with scrape type 2
2026-03-30 07:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18928e1a-a418-5472-a5ec-a83505998b63 with scrape type 2
2026-03-30 07:46:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 18928e1a-a418-5472-a5ec-a83505998b63, identifier: YH89346
2026-03-30 07:46:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 18928e1a-a418-5472-a5ec-a83505998b63 with identifier: YH89346
2026-03-30 07:46:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 18928e1a-a418-5472-a5ec-a83505998b63 with identifier: YH89346
2026-03-30 07:46:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 18928e1a-a418-5472-a5ec-a83505998b63 with identifier: YH89346 to the API
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 333,
 'expiration_date': '2026-03-30T15:58:56Z',
 'fuel_type': 'petrol',
 'id': '18928e1a-a418-5472-a5ec-a83505998b63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH89346',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 69867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-26',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 400 T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2018}
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH89346%27 HTTP/1.1" 200 None
2026-03-30 07:46:49 [auto1.de] INFO: Saving data for YH89346: {'auction_closing_time': 1774886336.0, 'created_time': 1774639345.734066, 'last_price_update_time': 1774856809.915633}
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YH89346') HTTP/1.1" 204 0
2026-03-30 07:46:49 [auto1.de] INFO: Found listing with ID: XX76692
2026-03-30 07:46:49 [auto1.de] INFO: Found listing with ID: BN50743
2026-03-30 07:46:49 [auto1.de] INFO: Found listing with ID: ZD02189
2026-03-30 07:46:49 [auto1.de] INFO: Found listing with ID: JT24059
2026-03-30 07:46:49 [auto1.de] INFO: Found listing with ID: DV89701
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV89701%27 HTTP/1.1" 200 None
2026-03-30 07:46:49 [auto1.de] INFO: Scrape type for DV89701: 2
2026-03-30 07:46:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22c2877f-7fb0-5af8-954b-137f4469dde9 with identifier: DV89701
2026-03-30 07:46:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22c2877f-7fb0-5af8-954b-137f4469dde9 with scrape type 2
2026-03-30 07:46:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22c2877f-7fb0-5af8-954b-137f4469dde9 with scrape type 2
2026-03-30 07:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 22c2877f-7fb0-5af8-954b-137f4469dde9, identifier: DV89701
2026-03-30 07:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 22c2877f-7fb0-5af8-954b-137f4469dde9 with identifier: DV89701
2026-03-30 07:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 22c2877f-7fb0-5af8-954b-137f4469dde9 with identifier: DV89701
2026-03-30 07:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 22c2877f-7fb0-5af8-954b-137f4469dde9 with identifier: DV89701 to the API
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:49Z',
 'fuel_type': 'petrol',
 'id': '22c2877f-7fb0-5af8-954b-137f4469dde9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV89701',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 112683,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-24',
 'seller_name': None,
 'title': 'Seat Alhambra 1.4 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2018}
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV89701%27 HTTP/1.1" 200 None
2026-03-30 07:46:50 [auto1.de] INFO: Saving data for DV89701: {'auction_closing_time': 1774885069.0, 'created_time': 1774552860.706624, 'last_price_update_time': 1774856810.339943}
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV89701') HTTP/1.1" 204 0
2026-03-30 07:46:50 [auto1.de] INFO: Found listing with ID: JJ41202
2026-03-30 07:46:50 [auto1.de] INFO: Found listing with ID: CS13699
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS13699%27 HTTP/1.1" 200 None
2026-03-30 07:46:50 [auto1.de] INFO: Scrape type for CS13699: 2
2026-03-30 07:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 457fa1af-7c05-540b-bffd-754326c33e6f with identifier: CS13699
2026-03-30 07:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 457fa1af-7c05-540b-bffd-754326c33e6f with scrape type 2
2026-03-30 07:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 457fa1af-7c05-540b-bffd-754326c33e6f with scrape type 2
2026-03-30 07:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 457fa1af-7c05-540b-bffd-754326c33e6f, identifier: CS13699
2026-03-30 07:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 457fa1af-7c05-540b-bffd-754326c33e6f with identifier: CS13699
2026-03-30 07:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 457fa1af-7c05-540b-bffd-754326c33e6f with identifier: CS13699
2026-03-30 07:46:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 457fa1af-7c05-540b-bffd-754326c33e6f with identifier: CS13699 to the API
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:10:37Z',
 'fuel_type': 'diesel',
 'id': '457fa1af-7c05-540b-bffd-754326c33e6f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS13699',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Verso',
 'odometer': 148795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-18',
 'seller_name': None,
 'title': 'Toyota Verso 1.6 D-4D Edition-S',
 'transmission': 'manual',
 'trim': 'Edition-S',
 'year': 2016}
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS13699%27 HTTP/1.1" 200 None
2026-03-30 07:46:50 [auto1.de] INFO: Saving data for CS13699: {'auction_closing_time': 1774883437.0, 'created_time': 1774551720.343787, 'last_price_update_time': 1774856810.833008}
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS13699') HTTP/1.1" 204 0
2026-03-30 07:46:50 [auto1.de] INFO: Found listing with ID: WC13471
2026-03-30 07:46:50 [auto1.de] INFO: Found listing with ID: VH78915
2026-03-30 07:46:50 [auto1.de] INFO: Found listing with ID: AU29418
2026-03-30 07:46:50 [auto1.de] INFO: Found listing with ID: CJ06587
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ06587%27 HTTP/1.1" 200 None
2026-03-30 07:46:50 [auto1.de] INFO: Scrape type for CJ06587: 0
2026-03-30 07:46:50 [auto1.de] INFO: Found listing with ID: RP08748
2026-03-30 07:46:50 [auto1.de] INFO: Found listing with ID: SM94434
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94434%27 HTTP/1.1" 200 None
2026-03-30 07:46:50 [auto1.de] INFO: Scrape type for SM94434: 2
2026-03-30 07:46:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b76b8503-5aca-5ccc-a53b-4dacce421ba4 with identifier: SM94434
2026-03-30 07:46:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b76b8503-5aca-5ccc-a53b-4dacce421ba4 with scrape type 2
2026-03-30 07:46:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b76b8503-5aca-5ccc-a53b-4dacce421ba4 with scrape type 2
2026-03-30 07:46:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b76b8503-5aca-5ccc-a53b-4dacce421ba4, identifier: SM94434
2026-03-30 07:46:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b76b8503-5aca-5ccc-a53b-4dacce421ba4 with identifier: SM94434
2026-03-30 07:46:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b76b8503-5aca-5ccc-a53b-4dacce421ba4 with identifier: SM94434
2026-03-30 07:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b76b8503-5aca-5ccc-a53b-4dacce421ba4 with identifier: SM94434 to the API
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:08:41Z',
 'fuel_type': 'petrol',
 'id': 'b76b8503-5aca-5ccc-a53b-4dacce421ba4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM94434',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 126128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2013}
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM94434%27 HTTP/1.1" 200 None
2026-03-30 07:46:51 [auto1.de] INFO: Saving data for SM94434: {'auction_closing_time': 1774883321.0, 'created_time': 1774552973.481352, 'last_price_update_time': 1774856811.284202}
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SM94434') HTTP/1.1" 204 0
2026-03-30 07:46:51 [auto1.de] INFO: Found listing with ID: WJ35504
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35504%27 HTTP/1.1" 200 None
2026-03-30 07:46:51 [auto1.de] INFO: Scrape type for WJ35504: 2
2026-03-30 07:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c664b270-c93b-5ffa-9a17-6aa668d12b23 with identifier: WJ35504
2026-03-30 07:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c664b270-c93b-5ffa-9a17-6aa668d12b23 with scrape type 2
2026-03-30 07:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c664b270-c93b-5ffa-9a17-6aa668d12b23 with scrape type 2
2026-03-30 07:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c664b270-c93b-5ffa-9a17-6aa668d12b23, identifier: WJ35504
2026-03-30 07:46:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c664b270-c93b-5ffa-9a17-6aa668d12b23 with identifier: WJ35504
2026-03-30 07:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c664b270-c93b-5ffa-9a17-6aa668d12b23 with identifier: WJ35504
2026-03-30 07:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c664b270-c93b-5ffa-9a17-6aa668d12b23 with identifier: WJ35504 to the API
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:36:58Z',
 'fuel_type': 'petrol',
 'id': 'c664b270-c93b-5ffa-9a17-6aa668d12b23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ35504',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 270402,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-29',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 350 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2010}
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ35504%27 HTTP/1.1" 200 None
2026-03-30 07:46:51 [auto1.de] INFO: Saving data for WJ35504: {'auction_closing_time': 1774885018.0, 'created_time': 1774550158.074969, 'last_price_update_time': 1774856811.70263}
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ35504') HTTP/1.1" 204 0
2026-03-30 07:46:51 [auto1.de] INFO: Found listing with ID: ER72643
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER72643%27 HTTP/1.1" 200 None
2026-03-30 07:46:51 [auto1.de] INFO: Scrape type for ER72643: 2
2026-03-30 07:46:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6ef39b3-2f49-52ff-983e-e95358bc0161 with identifier: ER72643
2026-03-30 07:46:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6ef39b3-2f49-52ff-983e-e95358bc0161 with scrape type 2
2026-03-30 07:46:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6ef39b3-2f49-52ff-983e-e95358bc0161 with scrape type 2
2026-03-30 07:46:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6ef39b3-2f49-52ff-983e-e95358bc0161, identifier: ER72643
2026-03-30 07:46:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6ef39b3-2f49-52ff-983e-e95358bc0161 with identifier: ER72643
2026-03-30 07:46:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6ef39b3-2f49-52ff-983e-e95358bc0161 with identifier: ER72643
2026-03-30 07:46:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6ef39b3-2f49-52ff-983e-e95358bc0161 with identifier: ER72643 to the API
2026-03-30 07:46:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:42Z',
 'fuel_type': 'diesel',
 'id': 'c6ef39b3-2f49-52ff-983e-e95358bc0161',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER72643',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 125515,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-05',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Join 4Motion',
 'transmission': 'automatic',
 'trim': 'Join 4Motion',
 'year': 2018}
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER72643%27 HTTP/1.1" 200 None
2026-03-30 07:46:52 [auto1.de] INFO: Saving data for ER72643: {'auction_closing_time': 1774883082.0, 'created_time': 1774552712.126785, 'last_price_update_time': 1774856812.168157}
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER72643') HTTP/1.1" 204 0
2026-03-30 07:46:52 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-30 07:46:52 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL03732%27 HTTP/1.1" 200 None
2026-03-30 07:46:52 [auto1.de] INFO: Scrape type for CL03732: 0
2026-03-30 07:46:52 [auto1.de] INFO: Channel: 24h | Page: 128 | totalHits: 8386 | hits on page: 40
2026-03-30 07:46:52 [auto1.de] INFO: Found listing with ID: TK51417
2026-03-30 07:46:52 [auto1.de] INFO: Found listing with ID: CL03732
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL03732%27 HTTP/1.1" 200 None
2026-03-30 07:46:52 [auto1.de] INFO: Scrape type for CL03732: 0
2026-03-30 07:46:52 [auto1.de] INFO: Found listing with ID: AL51386
2026-03-30 07:46:52 [auto1.de] INFO: Found listing with ID: BR96483
2026-03-30 07:46:52 [auto1.de] INFO: Found listing with ID: WG78527
2026-03-30 07:46:52 [auto1.de] INFO: Found listing with ID: PX80115
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX80115%27 HTTP/1.1" 200 None
2026-03-30 07:46:52 [auto1.de] INFO: Scrape type for PX80115: 0
2026-03-30 07:46:52 [auto1.de] INFO: Found listing with ID: YW76305
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW76305%27 HTTP/1.1" 200 None
2026-03-30 07:46:52 [auto1.de] INFO: Scrape type for YW76305: 2
2026-03-30 07:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23e9a04a-06ff-5b59-b35a-d8283bdbc35f with identifier: YW76305
2026-03-30 07:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23e9a04a-06ff-5b59-b35a-d8283bdbc35f with scrape type 2
2026-03-30 07:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23e9a04a-06ff-5b59-b35a-d8283bdbc35f with scrape type 2
2026-03-30 07:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23e9a04a-06ff-5b59-b35a-d8283bdbc35f, identifier: YW76305
2026-03-30 07:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23e9a04a-06ff-5b59-b35a-d8283bdbc35f with identifier: YW76305
2026-03-30 07:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23e9a04a-06ff-5b59-b35a-d8283bdbc35f with identifier: YW76305
2026-03-30 07:46:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23e9a04a-06ff-5b59-b35a-d8283bdbc35f with identifier: YW76305 to the API
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:34:30Z',
 'fuel_type': 'petrol',
 'id': '23e9a04a-06ff-5b59-b35a-d8283bdbc35f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW76305',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 90390,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2015}
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW76305%27 HTTP/1.1" 200 None
2026-03-30 07:46:52 [auto1.de] INFO: Saving data for YW76305: {'auction_closing_time': 1774884870.0, 'created_time': 1774637165.958454, 'last_price_update_time': 1774856812.63158}
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW76305') HTTP/1.1" 204 0
2026-03-30 07:46:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:52 [auto1.de] INFO: Found listing with ID: FT78842
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT78842%27 HTTP/1.1" 200 None
2026-03-30 07:46:52 [auto1.de] INFO: Scrape type for FT78842: 2
2026-03-30 07:46:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf1ddc58-6ffd-54ce-ac70-385436d2ab44 with identifier: FT78842
2026-03-30 07:46:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf1ddc58-6ffd-54ce-ac70-385436d2ab44 with scrape type 2
2026-03-30 07:46:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf1ddc58-6ffd-54ce-ac70-385436d2ab44 with scrape type 2
2026-03-30 07:46:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf1ddc58-6ffd-54ce-ac70-385436d2ab44, identifier: FT78842
2026-03-30 07:46:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf1ddc58-6ffd-54ce-ac70-385436d2ab44 with identifier: FT78842
2026-03-30 07:46:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf1ddc58-6ffd-54ce-ac70-385436d2ab44 with identifier: FT78842
2026-03-30 07:46:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf1ddc58-6ffd-54ce-ac70-385436d2ab44 with identifier: FT78842 to the API
2026-03-30 07:46:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:12:35Z',
 'fuel_type': 'petrol',
 'id': 'cf1ddc58-6ffd-54ce-ac70-385436d2ab44',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT78842',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 146135,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-16',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 FSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2004}
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT78842%27 HTTP/1.1" 200 None
2026-03-30 07:46:53 [auto1.de] INFO: Saving data for FT78842: {'auction_closing_time': 1774883555.0, 'created_time': 1774639512.264979, 'last_price_update_time': 1774856813.14522}
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT78842') HTTP/1.1" 204 0
2026-03-30 07:46:53 [auto1.de] INFO: Found listing with ID: JD98482
2026-03-30 07:46:53 [auto1.de] INFO: Found listing with ID: XE32981
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE32981%27 HTTP/1.1" 200 None
2026-03-30 07:46:53 [auto1.de] INFO: Scrape type for XE32981: 2
2026-03-30 07:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d7c04a6-8053-51a8-9b23-67116aa1d93c with identifier: XE32981
2026-03-30 07:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d7c04a6-8053-51a8-9b23-67116aa1d93c with scrape type 2
2026-03-30 07:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d7c04a6-8053-51a8-9b23-67116aa1d93c with scrape type 2
2026-03-30 07:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7d7c04a6-8053-51a8-9b23-67116aa1d93c, identifier: XE32981
2026-03-30 07:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7d7c04a6-8053-51a8-9b23-67116aa1d93c with identifier: XE32981
2026-03-30 07:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7d7c04a6-8053-51a8-9b23-67116aa1d93c with identifier: XE32981
2026-03-30 07:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7d7c04a6-8053-51a8-9b23-67116aa1d93c with identifier: XE32981 to the API
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:55:20Z',
 'fuel_type': 'petrol',
 'id': '7d7c04a6-8053-51a8-9b23-67116aa1d93c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XE32981',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 177819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-26',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2009}
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE32981%27 HTTP/1.1" 200 None
2026-03-30 07:46:53 [auto1.de] INFO: Saving data for XE32981: {'auction_closing_time': 1774886120.0, 'created_time': 1774551110.859424, 'last_price_update_time': 1774856813.597502}
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XE32981') HTTP/1.1" 204 0
2026-03-30 07:46:53 [auto1.de] INFO: Found listing with ID: RJ10234
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ10234%27 HTTP/1.1" 200 None
2026-03-30 07:46:53 [auto1.de] INFO: Scrape type for RJ10234: 0
2026-03-30 07:46:53 [auto1.de] INFO: Found listing with ID: PU73268
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU73268%27 HTTP/1.1" 200 None
2026-03-30 07:46:53 [auto1.de] INFO: Scrape type for PU73268: 0
2026-03-30 07:46:53 [auto1.de] INFO: Found listing with ID: LL88784
2026-03-30 07:46:53 [auto1.de] INFO: Found listing with ID: GU49323
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU49323%27 HTTP/1.1" 200 None
2026-03-30 07:46:53 [auto1.de] INFO: Scrape type for GU49323: 2
2026-03-30 07:46:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0be999e-750e-516a-854a-70926891d5c8 with identifier: GU49323
2026-03-30 07:46:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0be999e-750e-516a-854a-70926891d5c8 with scrape type 2
2026-03-30 07:46:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0be999e-750e-516a-854a-70926891d5c8 with scrape type 2
2026-03-30 07:46:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0be999e-750e-516a-854a-70926891d5c8, identifier: GU49323
2026-03-30 07:46:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0be999e-750e-516a-854a-70926891d5c8 with identifier: GU49323
2026-03-30 07:46:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0be999e-750e-516a-854a-70926891d5c8 with identifier: GU49323
2026-03-30 07:46:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0be999e-750e-516a-854a-70926891d5c8 with identifier: GU49323 to the API
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:37:45Z',
 'fuel_type': 'petrol',
 'id': 'a0be999e-750e-516a-854a-70926891d5c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU49323',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 145833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-10',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2011}
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU49323%27 HTTP/1.1" 200 None
2026-03-30 07:46:54 [auto1.de] INFO: Saving data for GU49323: {'auction_closing_time': 1774885065.0, 'created_time': 1774639287.924048, 'last_price_update_time': 1774856814.111045}
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU49323') HTTP/1.1" 204 0
2026-03-30 07:46:54 [auto1.de] INFO: Found listing with ID: PR23937
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR23937%27 HTTP/1.1" 200 None
2026-03-30 07:46:54 [auto1.de] INFO: Scrape type for PR23937: 0
2026-03-30 07:46:54 [auto1.de] INFO: Found listing with ID: NW77024
2026-03-30 07:46:54 [auto1.de] INFO: Found listing with ID: VZ53815
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ53815%27 HTTP/1.1" 200 None
2026-03-30 07:46:54 [auto1.de] INFO: Scrape type for VZ53815: 0
2026-03-30 07:46:54 [auto1.de] INFO: Found listing with ID: FC74080
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC74080%27 HTTP/1.1" 200 None
2026-03-30 07:46:54 [auto1.de] INFO: Scrape type for FC74080: 2
2026-03-30 07:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with identifier: FC74080
2026-03-30 07:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with scrape type 2
2026-03-30 07:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with scrape type 2
2026-03-30 07:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fe4356c-5f0e-56a1-8f4b-ad48c798f983, identifier: FC74080
2026-03-30 07:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with identifier: FC74080
2026-03-30 07:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with identifier: FC74080
2026-03-30 07:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fe4356c-5f0e-56a1-8f4b-ad48c798f983 with identifier: FC74080 to the API
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:11:57Z',
 'fuel_type': 'petrol',
 'id': '1fe4356c-5f0e-56a1-8f4b-ad48c798f983',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC74080',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '1007',
 'odometer': 98249,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-31',
 'seller_name': None,
 'title': 'Peugeot 1007 1.4 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2006}
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC74080%27 HTTP/1.1" 200 None
2026-03-30 07:46:54 [auto1.de] INFO: Saving data for FC74080: {'auction_closing_time': 1774883517.0, 'created_time': 1774552655.359772, 'last_price_update_time': 1774856814.564279}
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FC74080') HTTP/1.1" 204 0
2026-03-30 07:46:54 [auto1.de] INFO: Found listing with ID: VE44500
2026-03-30 07:46:54 [auto1.de] INFO: Found listing with ID: VJ43142
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ43142%27 HTTP/1.1" 200 None
2026-03-30 07:46:54 [auto1.de] INFO: Scrape type for VJ43142: 0
2026-03-30 07:46:54 [auto1.de] INFO: Found listing with ID: NZ91667
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ91667%27 HTTP/1.1" 200 None
2026-03-30 07:46:54 [auto1.de] INFO: Scrape type for NZ91667: 2
2026-03-30 07:46:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0a4e376-dc6a-50f0-a20f-ba9a4bb4189a with identifier: NZ91667
2026-03-30 07:46:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0a4e376-dc6a-50f0-a20f-ba9a4bb4189a with scrape type 2
2026-03-30 07:46:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0a4e376-dc6a-50f0-a20f-ba9a4bb4189a with scrape type 2
2026-03-30 07:46:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f0a4e376-dc6a-50f0-a20f-ba9a4bb4189a, identifier: NZ91667
2026-03-30 07:46:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f0a4e376-dc6a-50f0-a20f-ba9a4bb4189a with identifier: NZ91667
2026-03-30 07:46:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f0a4e376-dc6a-50f0-a20f-ba9a4bb4189a with identifier: NZ91667
2026-03-30 07:46:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f0a4e376-dc6a-50f0-a20f-ba9a4bb4189a with identifier: NZ91667 to the API
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:54:41Z',
 'fuel_type': 'diesel',
 'id': 'f0a4e376-dc6a-50f0-a20f-ba9a4bb4189a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ91667',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 273503,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-13',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ91667%27 HTTP/1.1" 200 None
2026-03-30 07:46:55 [auto1.de] INFO: Saving data for NZ91667: {'auction_closing_time': 1774886081.0, 'created_time': 1774033960.713633, 'last_price_update_time': 1774856815.07762}
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ91667') HTTP/1.1" 204 0
2026-03-30 07:46:55 [auto1.de] INFO: Found listing with ID: HK68029
2026-03-30 07:46:55 [auto1.de] INFO: Found listing with ID: HH54065
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54065%27 HTTP/1.1" 200 None
2026-03-30 07:46:55 [auto1.de] INFO: Scrape type for HH54065: 2
2026-03-30 07:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5406f0ae-71f3-5ed1-b320-e63947afbdd6 with identifier: HH54065
2026-03-30 07:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5406f0ae-71f3-5ed1-b320-e63947afbdd6 with scrape type 2
2026-03-30 07:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5406f0ae-71f3-5ed1-b320-e63947afbdd6 with scrape type 2
2026-03-30 07:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5406f0ae-71f3-5ed1-b320-e63947afbdd6, identifier: HH54065
2026-03-30 07:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5406f0ae-71f3-5ed1-b320-e63947afbdd6 with identifier: HH54065
2026-03-30 07:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5406f0ae-71f3-5ed1-b320-e63947afbdd6 with identifier: HH54065
2026-03-30 07:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5406f0ae-71f3-5ed1-b320-e63947afbdd6 with identifier: HH54065 to the API
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:56:19Z',
 'fuel_type': 'petrol',
 'id': '5406f0ae-71f3-5ed1-b320-e63947afbdd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH54065',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 98558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-04',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH54065%27 HTTP/1.1" 200 None
2026-03-30 07:46:55 [auto1.de] INFO: Saving data for HH54065: {'auction_closing_time': 1774886179.0, 'created_time': 1774637167.530961, 'last_price_update_time': 1774856815.476178}
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH54065') HTTP/1.1" 204 0
2026-03-30 07:46:55 [auto1.de] INFO: Found listing with ID: NR72053
2026-03-30 07:46:55 [auto1.de] INFO: Found listing with ID: GZ30709
2026-03-30 07:46:55 [auto1.de] INFO: Found listing with ID: AY94594
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY94594%27 HTTP/1.1" 200 None
2026-03-30 07:46:55 [auto1.de] INFO: Scrape type for AY94594: 2
2026-03-30 07:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d85c99f3-2dbd-51f9-84f6-0853197a9a9e with identifier: AY94594
2026-03-30 07:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d85c99f3-2dbd-51f9-84f6-0853197a9a9e with scrape type 2
2026-03-30 07:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d85c99f3-2dbd-51f9-84f6-0853197a9a9e with scrape type 2
2026-03-30 07:46:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d85c99f3-2dbd-51f9-84f6-0853197a9a9e, identifier: AY94594
2026-03-30 07:46:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d85c99f3-2dbd-51f9-84f6-0853197a9a9e with identifier: AY94594
2026-03-30 07:46:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d85c99f3-2dbd-51f9-84f6-0853197a9a9e with identifier: AY94594
2026-03-30 07:46:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d85c99f3-2dbd-51f9-84f6-0853197a9a9e with identifier: AY94594 to the API
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:39:24Z',
 'fuel_type': 'petrol',
 'id': 'd85c99f3-2dbd-51f9-84f6-0853197a9a9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY94594',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Arona',
 'odometer': 73558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-16',
 'seller_name': None,
 'title': 'Seat Arona 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2020}
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY94594%27 HTTP/1.1" 200 None
2026-03-30 07:46:55 [auto1.de] INFO: Saving data for AY94594: {'auction_closing_time': 1774885164.0, 'created_time': 1774639930.445041, 'last_price_update_time': 1774856815.929567}
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY94594') HTTP/1.1" 204 0
2026-03-30 07:46:55 [auto1.de] INFO: Found listing with ID: WP61796
2026-03-30 07:46:55 [auto1.de] INFO: Found listing with ID: NC82982
2026-03-30 07:46:55 [auto1.de] INFO: Found listing with ID: VZ19342
2026-03-30 07:46:55 [auto1.de] INFO: Found listing with ID: GE56014
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE56014%27 HTTP/1.1" 200 None
2026-03-30 07:46:55 [auto1.de] INFO: Scrape type for GE56014: 2
2026-03-30 07:46:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: addebb37-03b3-5bd2-ad5b-1f0f25b8aac5 with identifier: GE56014
2026-03-30 07:46:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item addebb37-03b3-5bd2-ad5b-1f0f25b8aac5 with scrape type 2
2026-03-30 07:46:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item addebb37-03b3-5bd2-ad5b-1f0f25b8aac5 with scrape type 2
2026-03-30 07:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: addebb37-03b3-5bd2-ad5b-1f0f25b8aac5, identifier: GE56014
2026-03-30 07:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: addebb37-03b3-5bd2-ad5b-1f0f25b8aac5 with identifier: GE56014
2026-03-30 07:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: addebb37-03b3-5bd2-ad5b-1f0f25b8aac5 with identifier: GE56014
2026-03-30 07:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: addebb37-03b3-5bd2-ad5b-1f0f25b8aac5 with identifier: GE56014 to the API
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:15Z',
 'fuel_type': 'diesel',
 'id': 'addebb37-03b3-5bd2-ad5b-1f0f25b8aac5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE56014',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 196540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-12',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2019}
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE56014%27 HTTP/1.1" 200 None
2026-03-30 07:46:56 [auto1.de] INFO: Saving data for GE56014: {'auction_closing_time': 1774882935.0, 'created_time': 1774639738.678687, 'last_price_update_time': 1774856816.330531}
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE56014') HTTP/1.1" 204 0
2026-03-30 07:46:56 [auto1.de] INFO: Found listing with ID: PV97095
2026-03-30 07:46:56 [auto1.de] INFO: Found listing with ID: WB73740
2026-03-30 07:46:56 [auto1.de] INFO: Found listing with ID: KY92219
2026-03-30 07:46:56 [auto1.de] INFO: Found listing with ID: AU27688
2026-03-30 07:46:56 [auto1.de] INFO: Found listing with ID: GH57189
2026-03-30 07:46:56 [auto1.de] INFO: Found listing with ID: EN93789
2026-03-30 07:46:56 [auto1.de] INFO: Found listing with ID: VC01658
2026-03-30 07:46:56 [auto1.de] INFO: Found listing with ID: DW77915
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77915%27 HTTP/1.1" 200 None
2026-03-30 07:46:56 [auto1.de] INFO: Scrape type for DW77915: 2
2026-03-30 07:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90797859-764f-57ff-aa1d-d47f233f6db6 with identifier: DW77915
2026-03-30 07:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90797859-764f-57ff-aa1d-d47f233f6db6 with scrape type 2
2026-03-30 07:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90797859-764f-57ff-aa1d-d47f233f6db6 with scrape type 2
2026-03-30 07:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90797859-764f-57ff-aa1d-d47f233f6db6, identifier: DW77915
2026-03-30 07:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90797859-764f-57ff-aa1d-d47f233f6db6 with identifier: DW77915
2026-03-30 07:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90797859-764f-57ff-aa1d-d47f233f6db6 with identifier: DW77915
2026-03-30 07:46:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90797859-764f-57ff-aa1d-d47f233f6db6 with identifier: DW77915 to the API
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-30T15:38:16Z',
 'fuel_type': 'hybrid',
 'id': '90797859-764f-57ff-aa1d-d47f233f6db6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW77915',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 24670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-05',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Hybrid GT-Line',
 'transmission': 'automatic',
 'trim': 'GT-Line',
 'year': 2024}
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77915%27 HTTP/1.1" 200 None
2026-03-30 07:46:56 [auto1.de] INFO: Saving data for DW77915: {'auction_closing_time': 1774885096.0, 'created_time': 1774552129.314913, 'last_price_update_time': 1774856816.811703}
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW77915') HTTP/1.1" 204 0
2026-03-30 07:46:56 [auto1.de] INFO: Found listing with ID: AT78165
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT78165%27 HTTP/1.1" 200 None
2026-03-30 07:46:56 [auto1.de] INFO: Scrape type for AT78165: 2
2026-03-30 07:46:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aafff8dc-0862-5188-8d1d-eb334702cbf3 with identifier: AT78165
2026-03-30 07:46:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aafff8dc-0862-5188-8d1d-eb334702cbf3 with scrape type 2
2026-03-30 07:46:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aafff8dc-0862-5188-8d1d-eb334702cbf3 with scrape type 2
2026-03-30 07:46:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aafff8dc-0862-5188-8d1d-eb334702cbf3, identifier: AT78165
2026-03-30 07:46:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aafff8dc-0862-5188-8d1d-eb334702cbf3 with identifier: AT78165
2026-03-30 07:46:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aafff8dc-0862-5188-8d1d-eb334702cbf3 with identifier: AT78165
2026-03-30 07:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aafff8dc-0862-5188-8d1d-eb334702cbf3 with identifier: AT78165 to the API
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:14:47Z',
 'fuel_type': 'diesel',
 'id': 'aafff8dc-0862-5188-8d1d-eb334702cbf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT78165',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 143123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-01',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Trend & Fun BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2012}
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT78165%27 HTTP/1.1" 200 None
2026-03-30 07:46:57 [auto1.de] INFO: Saving data for AT78165: {'auction_closing_time': 1774883687.0, 'created_time': 1774552838.67817, 'last_price_update_time': 1774856817.267331}
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AT78165') HTTP/1.1" 204 0
2026-03-30 07:46:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:46:57 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-30 07:46:57 [auto1.de] INFO: Channel: 24h | Page: 129 | totalHits: 8387 | hits on page: 40
2026-03-30 07:46:57 [auto1.de] INFO: Found listing with ID: HK20534
2026-03-30 07:46:57 [auto1.de] INFO: Found listing with ID: RS80830
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS80830%27 HTTP/1.1" 200 None
2026-03-30 07:46:57 [auto1.de] INFO: Scrape type for RS80830: 2
2026-03-30 07:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81299a5d-3dc3-5e71-b198-f81aa546599a with identifier: RS80830
2026-03-30 07:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81299a5d-3dc3-5e71-b198-f81aa546599a with scrape type 2
2026-03-30 07:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81299a5d-3dc3-5e71-b198-f81aa546599a with scrape type 2
2026-03-30 07:46:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81299a5d-3dc3-5e71-b198-f81aa546599a, identifier: RS80830
2026-03-30 07:46:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81299a5d-3dc3-5e71-b198-f81aa546599a with identifier: RS80830
2026-03-30 07:46:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81299a5d-3dc3-5e71-b198-f81aa546599a with identifier: RS80830
2026-03-30 07:46:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81299a5d-3dc3-5e71-b198-f81aa546599a with identifier: RS80830 to the API
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:56:46Z',
 'fuel_type': 'petrol',
 'id': '81299a5d-3dc3-5e71-b198-f81aa546599a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS80830',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 41710,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-06',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 350 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2010}
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS80830%27 HTTP/1.1" 200 None
2026-03-30 07:46:57 [auto1.de] INFO: Saving data for RS80830: {'auction_closing_time': 1774886206.0, 'created_time': 1774636888.447434, 'last_price_update_time': 1774856817.784501}
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS80830') HTTP/1.1" 204 0
2026-03-30 07:46:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:46:57 [auto1.de] INFO: Found listing with ID: ZB00511
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB00511%27 HTTP/1.1" 200 None
2026-03-30 07:46:57 [auto1.de] INFO: Scrape type for ZB00511: 2
2026-03-30 07:46:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cccd0a50-a6e8-53ff-b4e9-8fa7b540c681 with identifier: ZB00511
2026-03-30 07:46:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cccd0a50-a6e8-53ff-b4e9-8fa7b540c681 with scrape type 2
2026-03-30 07:46:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cccd0a50-a6e8-53ff-b4e9-8fa7b540c681 with scrape type 2
2026-03-30 07:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cccd0a50-a6e8-53ff-b4e9-8fa7b540c681, identifier: ZB00511
2026-03-30 07:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cccd0a50-a6e8-53ff-b4e9-8fa7b540c681 with identifier: ZB00511
2026-03-30 07:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cccd0a50-a6e8-53ff-b4e9-8fa7b540c681 with identifier: ZB00511
2026-03-30 07:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cccd0a50-a6e8-53ff-b4e9-8fa7b540c681 with identifier: ZB00511 to the API
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:32:00Z',
 'fuel_type': 'diesel',
 'id': 'cccd0a50-a6e8-53ff-b4e9-8fa7b540c681',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB00511',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 114516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-08',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 200 d Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2020}
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB00511%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Saving data for ZB00511: {'auction_closing_time': 1774884720.0, 'created_time': 1773303755.189434, 'last_price_update_time': 1774856818.303501}
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZB00511') HTTP/1.1" 204 0
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: UA00536
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: LK12622
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK12622%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Scrape type for LK12622: 0
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: YA95886
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: ZR01639
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR01639%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Scrape type for ZR01639: 0
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: BB78660
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: TL72332
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: LC37503
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: PY52590
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: VN50855
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN50855%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Scrape type for VN50855: 0
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: WC31038
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: HR89143
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: WW16724
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: AB73354
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: JU52980
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU52980%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Scrape type for JU52980: 0
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: ZT78140
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: ZN20945
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: DW68578
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: CM78973
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM78973%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Scrape type for CM78973: 0
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: LK50983
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: HV45616
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV45616%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Scrape type for HV45616: 0
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: EX22671
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX22671%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Scrape type for EX22671: 0
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: PJ38214
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: MY70814
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: JT86021
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: TJ20795
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ20795%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Scrape type for TJ20795: 0
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: SE52893
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: PP25437
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP25437%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Scrape type for PP25437: 2
2026-03-30 07:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc3329d6-5c1b-5861-903f-9e4044847474 with identifier: PP25437
2026-03-30 07:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3329d6-5c1b-5861-903f-9e4044847474 with scrape type 2
2026-03-30 07:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc3329d6-5c1b-5861-903f-9e4044847474 with scrape type 2
2026-03-30 07:46:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc3329d6-5c1b-5861-903f-9e4044847474, identifier: PP25437
2026-03-30 07:46:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc3329d6-5c1b-5861-903f-9e4044847474 with identifier: PP25437
2026-03-30 07:46:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc3329d6-5c1b-5861-903f-9e4044847474 with identifier: PP25437
2026-03-30 07:46:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc3329d6-5c1b-5861-903f-9e4044847474 with identifier: PP25437 to the API
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:12:15Z',
 'fuel_type': 'petrol',
 'id': 'fc3329d6-5c1b-5861-903f-9e4044847474',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP25437',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 89071,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-31',
 'seller_name': None,
 'title': 'Ford B-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP25437%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Saving data for PP25437: {'auction_closing_time': 1774883535.0, 'created_time': 1774551209.625397, 'last_price_update_time': 1774856818.855481}
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP25437') HTTP/1.1" 204 0
2026-03-30 07:46:58 [auto1.de] INFO: Found listing with ID: TT40648
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT40648%27 HTTP/1.1" 200 None
2026-03-30 07:46:58 [auto1.de] INFO: Scrape type for TT40648: 2
2026-03-30 07:46:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9163067c-442a-5121-975c-052aa084495e with identifier: TT40648
2026-03-30 07:46:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9163067c-442a-5121-975c-052aa084495e with scrape type 2
2026-03-30 07:46:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9163067c-442a-5121-975c-052aa084495e with scrape type 2
2026-03-30 07:46:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9163067c-442a-5121-975c-052aa084495e, identifier: TT40648
2026-03-30 07:46:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9163067c-442a-5121-975c-052aa084495e with identifier: TT40648
2026-03-30 07:46:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9163067c-442a-5121-975c-052aa084495e with identifier: TT40648
2026-03-30 07:46:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9163067c-442a-5121-975c-052aa084495e with identifier: TT40648 to the API
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:46:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:45Z',
 'fuel_type': 'petrol',
 'id': '9163067c-442a-5121-975c-052aa084495e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT40648',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 71808,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-29',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT40648%27 HTTP/1.1" 200 None
2026-03-30 07:46:59 [auto1.de] INFO: Saving data for TT40648: {'auction_closing_time': 1774883685.0, 'created_time': 1773946209.517288, 'last_price_update_time': 1774856819.360496}
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT40648') HTTP/1.1" 204 0
2026-03-30 07:46:59 [auto1.de] INFO: Found listing with ID: XE19125
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE19125%27 HTTP/1.1" 200 None
2026-03-30 07:46:59 [auto1.de] INFO: Scrape type for XE19125: 0
2026-03-30 07:46:59 [auto1.de] INFO: Found listing with ID: GN10929
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN10929%27 HTTP/1.1" 200 None
2026-03-30 07:46:59 [auto1.de] INFO: Scrape type for GN10929: 0
2026-03-30 07:46:59 [auto1.de] INFO: Found listing with ID: YE66083
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE66083%27 HTTP/1.1" 200 None
2026-03-30 07:46:59 [auto1.de] INFO: Scrape type for YE66083: 0
2026-03-30 07:46:59 [auto1.de] INFO: Found listing with ID: TX48260
2026-03-30 07:46:59 [auto1.de] INFO: Found listing with ID: BD92301
2026-03-30 07:46:59 [auto1.de] INFO: Found listing with ID: GW69862
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW69862%27 HTTP/1.1" 200 None
2026-03-30 07:46:59 [auto1.de] INFO: Scrape type for GW69862: 0
2026-03-30 07:46:59 [auto1.de] INFO: Found listing with ID: AK08323
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK08323%27 HTTP/1.1" 200 None
2026-03-30 07:46:59 [auto1.de] INFO: Scrape type for AK08323: 0
2026-03-30 07:46:59 [auto1.de] INFO: Found listing with ID: TL90122
2026-03-30 07:46:59 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:46:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-30 07:46:59 [auto1.de] INFO: Scrape type for AK47916: 0
2026-03-30 07:47:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:00 [auto1.de] INFO: Channel: 24h | Page: 130 | totalHits: 8388 | hits on page: 40
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: AK47916
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK47916%27 HTTP/1.1" 200 None
2026-03-30 07:47:00 [auto1.de] INFO: Scrape type for AK47916: 0
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: NE74286
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE74286%27 HTTP/1.1" 200 None
2026-03-30 07:47:00 [auto1.de] INFO: Scrape type for NE74286: 0
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: ZG14470
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: AW78451
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW78451%27 HTTP/1.1" 200 None
2026-03-30 07:47:00 [auto1.de] INFO: Scrape type for AW78451: 0
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: KZ61437
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: JW24568
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JW24568%27 HTTP/1.1" 200 None
2026-03-30 07:47:00 [auto1.de] INFO: Scrape type for JW24568: 0
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: WZ19127
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: RB25738
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB25738%27 HTTP/1.1" 200 None
2026-03-30 07:47:00 [auto1.de] INFO: Scrape type for RB25738: 0
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: ZR21062
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR21062%27 HTTP/1.1" 200 None
2026-03-30 07:47:00 [auto1.de] INFO: Scrape type for ZR21062: 0
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: ZC43990
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC43990%27 HTTP/1.1" 200 None
2026-03-30 07:47:00 [auto1.de] INFO: Scrape type for ZC43990: 0
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: PH16330
2026-03-30 07:47:00 [auto1.de] INFO: Found listing with ID: WV70498
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV70498%27 HTTP/1.1" 200 None
2026-03-30 07:47:00 [auto1.de] INFO: Scrape type for WV70498: 2
2026-03-30 07:47:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c00f763-3e42-53d7-ac02-ec77f06e3fc6 with identifier: WV70498
2026-03-30 07:47:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c00f763-3e42-53d7-ac02-ec77f06e3fc6 with scrape type 2
2026-03-30 07:47:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c00f763-3e42-53d7-ac02-ec77f06e3fc6 with scrape type 2
2026-03-30 07:47:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c00f763-3e42-53d7-ac02-ec77f06e3fc6, identifier: WV70498
2026-03-30 07:47:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c00f763-3e42-53d7-ac02-ec77f06e3fc6 with identifier: WV70498
2026-03-30 07:47:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c00f763-3e42-53d7-ac02-ec77f06e3fc6 with identifier: WV70498
2026-03-30 07:47:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c00f763-3e42-53d7-ac02-ec77f06e3fc6 with identifier: WV70498 to the API
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:12:16Z',
 'fuel_type': 'petrol',
 'id': '0c00f763-3e42-53d7-ac02-ec77f06e3fc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV70498',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Antara',
 'odometer': 153995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-14',
 'seller_name': None,
 'title': 'Opel Antara 2.4 Edition 4x4',
 'transmission': 'manual',
 'trim': 'Edition 4x4',
 'year': 2008}
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV70498%27 HTTP/1.1" 200 None
2026-03-30 07:47:01 [auto1.de] INFO: Saving data for WV70498: {'auction_closing_time': 1774883536.0, 'created_time': 1774639534.349549, 'last_price_update_time': 1774856821.039418}
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV70498') HTTP/1.1" 204 0
2026-03-30 07:47:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:01 [auto1.de] INFO: Found listing with ID: ZH23061
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH23061%27 HTTP/1.1" 200 None
2026-03-30 07:47:01 [auto1.de] INFO: Scrape type for ZH23061: 0
2026-03-30 07:47:01 [auto1.de] INFO: Found listing with ID: KM72305
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM72305%27 HTTP/1.1" 200 None
2026-03-30 07:47:01 [auto1.de] INFO: Scrape type for KM72305: 2
2026-03-30 07:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87b7d876-4948-5cbb-b2ea-8e968a99fc6e with identifier: KM72305
2026-03-30 07:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87b7d876-4948-5cbb-b2ea-8e968a99fc6e with scrape type 2
2026-03-30 07:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87b7d876-4948-5cbb-b2ea-8e968a99fc6e with scrape type 2
2026-03-30 07:47:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 87b7d876-4948-5cbb-b2ea-8e968a99fc6e, identifier: KM72305
2026-03-30 07:47:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 87b7d876-4948-5cbb-b2ea-8e968a99fc6e with identifier: KM72305
2026-03-30 07:47:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 87b7d876-4948-5cbb-b2ea-8e968a99fc6e with identifier: KM72305
2026-03-30 07:47:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 87b7d876-4948-5cbb-b2ea-8e968a99fc6e with identifier: KM72305 to the API
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:30:40Z',
 'fuel_type': 'diesel',
 'id': '87b7d876-4948-5cbb-b2ea-8e968a99fc6e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM72305',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 180990,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-28',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 CDI AMG Sport',
 'transmission': 'automatic',
 'trim': 'AMG Sport',
 'year': 2015}
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM72305%27 HTTP/1.1" 200 None
2026-03-30 07:47:01 [auto1.de] INFO: Saving data for KM72305: {'auction_closing_time': 1774884640.0, 'created_time': 1773306238.20393, 'last_price_update_time': 1774856821.94712}
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM72305') HTTP/1.1" 204 0
2026-03-30 07:47:01 [auto1.de] INFO: Found listing with ID: AV62833
2026-03-30 07:47:01 [auto1.de] INFO: Found listing with ID: RZ33260
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ33260%27 HTTP/1.1" 200 None
2026-03-30 07:47:01 [auto1.de] INFO: Scrape type for RZ33260: 2
2026-03-30 07:47:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d4608ea-572b-502e-a404-dafa950ae6bd with identifier: RZ33260
2026-03-30 07:47:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d4608ea-572b-502e-a404-dafa950ae6bd with scrape type 2
2026-03-30 07:47:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d4608ea-572b-502e-a404-dafa950ae6bd with scrape type 2
2026-03-30 07:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d4608ea-572b-502e-a404-dafa950ae6bd, identifier: RZ33260
2026-03-30 07:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d4608ea-572b-502e-a404-dafa950ae6bd with identifier: RZ33260
2026-03-30 07:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d4608ea-572b-502e-a404-dafa950ae6bd with identifier: RZ33260
2026-03-30 07:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d4608ea-572b-502e-a404-dafa950ae6bd with identifier: RZ33260 to the API
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 510,
 'expiration_date': '2026-03-30T15:40:26Z',
 'fuel_type': 'petrol',
 'id': '9d4608ea-572b-502e-a404-dafa950ae6bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ33260',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 95205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-01',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 63 AMG S T',
 'transmission': 'automatic',
 'trim': 'S T',
 'year': 2017}
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ33260%27 HTTP/1.1" 200 None
2026-03-30 07:47:02 [auto1.de] INFO: Saving data for RZ33260: {'auction_closing_time': 1774885226.0, 'created_time': 1774350983.538234, 'last_price_update_time': 1774856822.351201}
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ33260') HTTP/1.1" 204 0
2026-03-30 07:47:02 [auto1.de] INFO: Found listing with ID: CT44889
2026-03-30 07:47:02 [auto1.de] INFO: Found listing with ID: KL19137
2026-03-30 07:47:02 [auto1.de] INFO: Found listing with ID: PA63751
2026-03-30 07:47:02 [auto1.de] INFO: Found listing with ID: FX17488
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX17488%27 HTTP/1.1" 200 None
2026-03-30 07:47:02 [auto1.de] INFO: Scrape type for FX17488: 0
2026-03-30 07:47:02 [auto1.de] INFO: Found listing with ID: LC63229
2026-03-30 07:47:02 [auto1.de] INFO: Found listing with ID: PU94869
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU94869%27 HTTP/1.1" 200 None
2026-03-30 07:47:02 [auto1.de] INFO: Scrape type for PU94869: 0
2026-03-30 07:47:02 [auto1.de] INFO: Found listing with ID: DW05211
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW05211%27 HTTP/1.1" 200 None
2026-03-30 07:47:02 [auto1.de] INFO: Scrape type for DW05211: 0
2026-03-30 07:47:02 [auto1.de] INFO: Found listing with ID: AM41961
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM41961%27 HTTP/1.1" 200 None
2026-03-30 07:47:02 [auto1.de] INFO: Scrape type for AM41961: 2
2026-03-30 07:47:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d77f711-a9c9-50bf-b232-f00ec59b6150 with identifier: AM41961
2026-03-30 07:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d77f711-a9c9-50bf-b232-f00ec59b6150 with scrape type 2
2026-03-30 07:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2d77f711-a9c9-50bf-b232-f00ec59b6150 with scrape type 2
2026-03-30 07:47:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2d77f711-a9c9-50bf-b232-f00ec59b6150, identifier: AM41961
2026-03-30 07:47:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2d77f711-a9c9-50bf-b232-f00ec59b6150 with identifier: AM41961
2026-03-30 07:47:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2d77f711-a9c9-50bf-b232-f00ec59b6150 with identifier: AM41961
2026-03-30 07:47:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2d77f711-a9c9-50bf-b232-f00ec59b6150 with identifier: AM41961 to the API
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:26:59Z',
 'fuel_type': 'petrol',
 'id': '2d77f711-a9c9-50bf-b232-f00ec59b6150',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM41961',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 113843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-24',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM41961%27 HTTP/1.1" 200 None
2026-03-30 07:47:02 [auto1.de] INFO: Saving data for AM41961: {'auction_closing_time': 1774884419.0, 'created_time': 1774350520.882263, 'last_price_update_time': 1774856822.852067}
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM41961') HTTP/1.1" 204 0
2026-03-30 07:47:02 [auto1.de] INFO: Found listing with ID: AA98436
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA98436%27 HTTP/1.1" 200 None
2026-03-30 07:47:02 [auto1.de] INFO: Scrape type for AA98436: 0
2026-03-30 07:47:02 [auto1.de] INFO: Found listing with ID: TW05581
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05581%27 HTTP/1.1" 200 None
2026-03-30 07:47:02 [auto1.de] INFO: Scrape type for TW05581: 2
2026-03-30 07:47:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88fbd653-d026-507d-ab80-e1b146ab26eb with identifier: TW05581
2026-03-30 07:47:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88fbd653-d026-507d-ab80-e1b146ab26eb with scrape type 2
2026-03-30 07:47:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88fbd653-d026-507d-ab80-e1b146ab26eb with scrape type 2
2026-03-30 07:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 88fbd653-d026-507d-ab80-e1b146ab26eb, identifier: TW05581
2026-03-30 07:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 88fbd653-d026-507d-ab80-e1b146ab26eb with identifier: TW05581
2026-03-30 07:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 88fbd653-d026-507d-ab80-e1b146ab26eb with identifier: TW05581
2026-03-30 07:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 88fbd653-d026-507d-ab80-e1b146ab26eb with identifier: TW05581 to the API
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 449,
 'expiration_date': '2026-03-30T15:28:39Z',
 'fuel_type': 'petrol',
 'id': '88fbd653-d026-507d-ab80-e1b146ab26eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW05581',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 6396,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-18',
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2022}
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW05581%27 HTTP/1.1" 200 None
2026-03-30 07:47:03 [auto1.de] INFO: Saving data for TW05581: {'auction_closing_time': 1774884519.0, 'created_time': 1774552899.094239, 'last_price_update_time': 1774856823.381074}
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TW05581') HTTP/1.1" 204 0
2026-03-30 07:47:03 [auto1.de] INFO: Found listing with ID: WC63339
2026-03-30 07:47:03 [auto1.de] INFO: Found listing with ID: WG01413
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG01413%27 HTTP/1.1" 200 None
2026-03-30 07:47:03 [auto1.de] INFO: Scrape type for WG01413: 0
2026-03-30 07:47:03 [auto1.de] INFO: Found listing with ID: SN72199
2026-03-30 07:47:03 [auto1.de] INFO: Found listing with ID: RS45157
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS45157%27 HTTP/1.1" 200 None
2026-03-30 07:47:03 [auto1.de] INFO: Scrape type for RS45157: 2
2026-03-30 07:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with identifier: RS45157
2026-03-30 07:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with scrape type 2
2026-03-30 07:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with scrape type 2
2026-03-30 07:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b, identifier: RS45157
2026-03-30 07:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with identifier: RS45157
2026-03-30 07:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with identifier: RS45157
2026-03-30 07:47:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b with identifier: RS45157 to the API
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:54:15Z',
 'fuel_type': 'diesel',
 'id': 'cdbdc509-1c01-5a6a-bf89-98dcdc80cb9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS45157',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 146747,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-04',
 'seller_name': None,
 'title': 'Jaguar XF 3.0 D Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2018}
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS45157%27 HTTP/1.1" 200 None
2026-03-30 07:47:03 [auto1.de] INFO: Saving data for RS45157: {'auction_closing_time': 1774886055.0, 'created_time': 1773403202.361555, 'last_price_update_time': 1774856823.829202}
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RS45157') HTTP/1.1" 204 0
2026-03-30 07:47:03 [auto1.de] INFO: Found listing with ID: UP84428
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP84428%27 HTTP/1.1" 200 None
2026-03-30 07:47:03 [auto1.de] INFO: Scrape type for UP84428: 0
2026-03-30 07:47:03 [auto1.de] INFO: Found listing with ID: YJ03455
2026-03-30 07:47:03 [auto1.de] INFO: Found listing with ID: VL43028
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL43028%27 HTTP/1.1" 200 None
2026-03-30 07:47:03 [auto1.de] INFO: Scrape type for VL43028: 2
2026-03-30 07:47:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab97f533-ed7f-5a91-852d-6c626575c349 with identifier: VL43028
2026-03-30 07:47:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab97f533-ed7f-5a91-852d-6c626575c349 with scrape type 2
2026-03-30 07:47:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab97f533-ed7f-5a91-852d-6c626575c349 with scrape type 2
2026-03-30 07:47:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab97f533-ed7f-5a91-852d-6c626575c349, identifier: VL43028
2026-03-30 07:47:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab97f533-ed7f-5a91-852d-6c626575c349 with identifier: VL43028
2026-03-30 07:47:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab97f533-ed7f-5a91-852d-6c626575c349 with identifier: VL43028
2026-03-30 07:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab97f533-ed7f-5a91-852d-6c626575c349 with identifier: VL43028 to the API
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:09:11Z',
 'fuel_type': 'petrol',
 'id': 'ab97f533-ed7f-5a91-852d-6c626575c349',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL43028',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 138775,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-05',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2011}
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL43028%27 HTTP/1.1" 200 None
2026-03-30 07:47:04 [auto1.de] INFO: Saving data for VL43028: {'auction_closing_time': 1774883351.0, 'created_time': 1774636913.013366, 'last_price_update_time': 1774856824.292966}
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL43028') HTTP/1.1" 204 0
2026-03-30 07:47:04 [auto1.de] INFO: Found listing with ID: XU86679
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU86679%27 HTTP/1.1" 200 None
2026-03-30 07:47:04 [auto1.de] INFO: Scrape type for XU86679: 0
2026-03-30 07:47:04 [auto1.de] INFO: Found listing with ID: PZ40966
2026-03-30 07:47:04 [auto1.de] INFO: Found listing with ID: YY60165
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY60165%27 HTTP/1.1" 200 None
2026-03-30 07:47:04 [auto1.de] INFO: Scrape type for YY60165: 2
2026-03-30 07:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55892416-31bc-5f96-9fd3-387349d93948 with identifier: YY60165
2026-03-30 07:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55892416-31bc-5f96-9fd3-387349d93948 with scrape type 2
2026-03-30 07:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55892416-31bc-5f96-9fd3-387349d93948 with scrape type 2
2026-03-30 07:47:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55892416-31bc-5f96-9fd3-387349d93948, identifier: YY60165
2026-03-30 07:47:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55892416-31bc-5f96-9fd3-387349d93948 with identifier: YY60165
2026-03-30 07:47:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55892416-31bc-5f96-9fd3-387349d93948 with identifier: YY60165
2026-03-30 07:47:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55892416-31bc-5f96-9fd3-387349d93948 with identifier: YY60165 to the API
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:16Z',
 'fuel_type': 'diesel',
 'id': '55892416-31bc-5f96-9fd3-387349d93948',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YY60165',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 94413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2021}
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY60165%27 HTTP/1.1" 200 None
2026-03-30 07:47:04 [auto1.de] INFO: Saving data for YY60165: {'auction_closing_time': 1774882936.0, 'created_time': 1774552705.193563, 'last_price_update_time': 1774856824.742635}
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YY60165') HTTP/1.1" 204 0
2026-03-30 07:47:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:04 [auto1.de] INFO: Found listing with ID: MX17219
2026-03-30 07:47:04 [auto1.de] INFO: Found listing with ID: EJ74150
2026-03-30 07:47:04 [auto1.de] INFO: Found listing with ID: MV46012
2026-03-30 07:47:04 [auto1.de] INFO: Found listing with ID: VJ29661
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ29661%27 HTTP/1.1" 200 None
2026-03-30 07:47:04 [auto1.de] INFO: Scrape type for VJ29661: 0
2026-03-30 07:47:04 [auto1.de] INFO: Channel: 24h | Page: 131 | totalHits: 8388 | hits on page: 40
2026-03-30 07:47:04 [auto1.de] INFO: Found listing with ID: EL67777
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL67777%27 HTTP/1.1" 200 None
2026-03-30 07:47:04 [auto1.de] INFO: Scrape type for EL67777: 2
2026-03-30 07:47:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 742cf8ac-7faa-52da-b142-86b8cb0a3cae with identifier: EL67777
2026-03-30 07:47:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 742cf8ac-7faa-52da-b142-86b8cb0a3cae with scrape type 2
2026-03-30 07:47:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 742cf8ac-7faa-52da-b142-86b8cb0a3cae with scrape type 2
2026-03-30 07:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 742cf8ac-7faa-52da-b142-86b8cb0a3cae, identifier: EL67777
2026-03-30 07:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 742cf8ac-7faa-52da-b142-86b8cb0a3cae with identifier: EL67777
2026-03-30 07:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 742cf8ac-7faa-52da-b142-86b8cb0a3cae with identifier: EL67777
2026-03-30 07:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 742cf8ac-7faa-52da-b142-86b8cb0a3cae with identifier: EL67777 to the API
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:01:41Z',
 'fuel_type': 'petrol',
 'id': '742cf8ac-7faa-52da-b142-86b8cb0a3cae',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL67777',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 77400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-30',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Move up! BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Move  BlueMotion Tech',
 'year': 2015}
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL67777%27 HTTP/1.1" 200 None
2026-03-30 07:47:05 [auto1.de] INFO: Saving data for EL67777: {'auction_closing_time': 1774882901.0, 'created_time': 1773946930.17414, 'last_price_update_time': 1774856825.375738}
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL67777') HTTP/1.1" 204 0
2026-03-30 07:47:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:05 [auto1.de] INFO: Found listing with ID: UX48590
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX48590%27 HTTP/1.1" 200 None
2026-03-30 07:47:05 [auto1.de] INFO: Scrape type for UX48590: 0
2026-03-30 07:47:05 [auto1.de] INFO: Found listing with ID: HL95475
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL95475%27 HTTP/1.1" 200 None
2026-03-30 07:47:05 [auto1.de] INFO: Scrape type for HL95475: 2
2026-03-30 07:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cbf5dd7-c55e-598a-a76c-f77057f0b01c with identifier: HL95475
2026-03-30 07:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cbf5dd7-c55e-598a-a76c-f77057f0b01c with scrape type 2
2026-03-30 07:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cbf5dd7-c55e-598a-a76c-f77057f0b01c with scrape type 2
2026-03-30 07:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7cbf5dd7-c55e-598a-a76c-f77057f0b01c, identifier: HL95475
2026-03-30 07:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7cbf5dd7-c55e-598a-a76c-f77057f0b01c with identifier: HL95475
2026-03-30 07:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7cbf5dd7-c55e-598a-a76c-f77057f0b01c with identifier: HL95475
2026-03-30 07:47:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7cbf5dd7-c55e-598a-a76c-f77057f0b01c with identifier: HL95475 to the API
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:50:34Z',
 'fuel_type': 'petrol',
 'id': '7cbf5dd7-c55e-598a-a76c-f77057f0b01c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL95475',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 81738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-18',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.6 Ti-VCT Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL95475%27 HTTP/1.1" 200 None
2026-03-30 07:47:05 [auto1.de] INFO: Saving data for HL95475: {'auction_closing_time': 1774885834.0, 'created_time': 1773946508.93902, 'last_price_update_time': 1774856825.81686}
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL95475') HTTP/1.1" 204 0
2026-03-30 07:47:05 [auto1.de] INFO: Found listing with ID: FF11378
2026-03-30 07:47:05 [auto1.de] INFO: Found listing with ID: LN92590
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN92590%27 HTTP/1.1" 200 None
2026-03-30 07:47:05 [auto1.de] INFO: Scrape type for LN92590: 0
2026-03-30 07:47:05 [auto1.de] INFO: Found listing with ID: HZ32658
2026-03-30 07:47:05 [auto1.de] INFO: Found listing with ID: KD58874
2026-03-30 07:47:05 [auto1.de] INFO: Found listing with ID: SN47860
2026-03-30 07:47:05 [auto1.de] INFO: Found listing with ID: SG53147
2026-03-30 07:47:05 [auto1.de] INFO: Found listing with ID: RB75427
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB75427%27 HTTP/1.1" 200 None
2026-03-30 07:47:05 [auto1.de] INFO: Scrape type for RB75427: 2
2026-03-30 07:47:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc25f304-2853-5afa-9481-d44b846e7736 with identifier: RB75427
2026-03-30 07:47:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc25f304-2853-5afa-9481-d44b846e7736 with scrape type 2
2026-03-30 07:47:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc25f304-2853-5afa-9481-d44b846e7736 with scrape type 2
2026-03-30 07:47:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc25f304-2853-5afa-9481-d44b846e7736, identifier: RB75427
2026-03-30 07:47:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc25f304-2853-5afa-9481-d44b846e7736 with identifier: RB75427
2026-03-30 07:47:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc25f304-2853-5afa-9481-d44b846e7736 with identifier: RB75427
2026-03-30 07:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc25f304-2853-5afa-9481-d44b846e7736 with identifier: RB75427 to the API
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:23:35Z',
 'fuel_type': 'petrol',
 'id': 'fc25f304-2853-5afa-9481-d44b846e7736',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB75427',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 36704,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-27',
 'seller_name': None,
 'title': 'Volvo XC40 2.0 B3 Mild-Hybrid Core 2WD',
 'transmission': 'automatic',
 'trim': 'Core 2WD',
 'year': 2023}
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB75427%27 HTTP/1.1" 200 None
2026-03-30 07:47:06 [auto1.de] INFO: Saving data for RB75427: {'auction_closing_time': 1774884215.0, 'created_time': 1774550979.620126, 'last_price_update_time': 1774856826.267365}
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB75427') HTTP/1.1" 204 0
2026-03-30 07:47:06 [auto1.de] INFO: Found listing with ID: WF56073
2026-03-30 07:47:06 [auto1.de] INFO: Found listing with ID: WF31302
2026-03-30 07:47:06 [auto1.de] INFO: Found listing with ID: NG52240
2026-03-30 07:47:06 [auto1.de] INFO: Found listing with ID: HJ09616
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ09616%27 HTTP/1.1" 200 None
2026-03-30 07:47:06 [auto1.de] INFO: Scrape type for HJ09616: 2
2026-03-30 07:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9685417a-9707-58cd-a6c6-3e81d32fec5b with identifier: HJ09616
2026-03-30 07:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9685417a-9707-58cd-a6c6-3e81d32fec5b with scrape type 2
2026-03-30 07:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9685417a-9707-58cd-a6c6-3e81d32fec5b with scrape type 2
2026-03-30 07:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9685417a-9707-58cd-a6c6-3e81d32fec5b, identifier: HJ09616
2026-03-30 07:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9685417a-9707-58cd-a6c6-3e81d32fec5b with identifier: HJ09616
2026-03-30 07:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9685417a-9707-58cd-a6c6-3e81d32fec5b with identifier: HJ09616
2026-03-30 07:47:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9685417a-9707-58cd-a6c6-3e81d32fec5b with identifier: HJ09616 to the API
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:35:28Z',
 'fuel_type': 'diesel',
 'id': '9685417a-9707-58cd-a6c6-3e81d32fec5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ09616',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 34366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-05',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2023}
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ09616%27 HTTP/1.1" 200 None
2026-03-30 07:47:06 [auto1.de] INFO: Saving data for HJ09616: {'auction_closing_time': 1774884928.0, 'created_time': 1772542335.742356, 'last_price_update_time': 1774856826.767414}
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ09616') HTTP/1.1" 204 0
2026-03-30 07:47:06 [auto1.de] INFO: Found listing with ID: VW19119
2026-03-30 07:47:06 [auto1.de] INFO: Found listing with ID: UR24224
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR24224%27 HTTP/1.1" 200 None
2026-03-30 07:47:06 [auto1.de] INFO: Scrape type for UR24224: 2
2026-03-30 07:47:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca3ffd02-9c72-5856-9334-78cc92edd64d with identifier: UR24224
2026-03-30 07:47:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca3ffd02-9c72-5856-9334-78cc92edd64d with scrape type 2
2026-03-30 07:47:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca3ffd02-9c72-5856-9334-78cc92edd64d with scrape type 2
2026-03-30 07:47:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ca3ffd02-9c72-5856-9334-78cc92edd64d, identifier: UR24224
2026-03-30 07:47:06 [scrapy.extensions.logstats] INFO: Crawled 327 pages (at 12 pages/min), scraped 895 items (at 110 items/min)
2026-03-30 07:47:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:47:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ca3ffd02-9c72-5856-9334-78cc92edd64d with identifier: UR24224
2026-03-30 07:47:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ca3ffd02-9c72-5856-9334-78cc92edd64d with identifier: UR24224
2026-03-30 07:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ca3ffd02-9c72-5856-9334-78cc92edd64d with identifier: UR24224 to the API
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:16Z',
 'fuel_type': 'petrol',
 'id': 'ca3ffd02-9c72-5856-9334-78cc92edd64d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR24224',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 77036,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-07',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Dynamic Start/Stop',
 'transmission': 'automatic',
 'trim': 'Dynamic Start/Stop',
 'year': 2018}
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR24224%27 HTTP/1.1" 200 None
2026-03-30 07:47:07 [auto1.de] INFO: Saving data for UR24224: {'auction_closing_time': 1774885816.0, 'created_time': 1774639266.858774, 'last_price_update_time': 1774856827.262003}
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UR24224') HTTP/1.1" 204 0
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: SG45396
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG45396%27 HTTP/1.1" 200 None
2026-03-30 07:47:07 [auto1.de] INFO: Scrape type for SG45396: 0
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: YB86869
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: GP68218
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: TP00598
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: LD63476
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: XB50161
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: SV23538
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV23538%27 HTTP/1.1" 200 None
2026-03-30 07:47:07 [auto1.de] INFO: Scrape type for SV23538: 2
2026-03-30 07:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a260994-1221-5049-84dd-c183eb88833e with identifier: SV23538
2026-03-30 07:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a260994-1221-5049-84dd-c183eb88833e with scrape type 2
2026-03-30 07:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a260994-1221-5049-84dd-c183eb88833e with scrape type 2
2026-03-30 07:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2a260994-1221-5049-84dd-c183eb88833e, identifier: SV23538
2026-03-30 07:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2a260994-1221-5049-84dd-c183eb88833e with identifier: SV23538
2026-03-30 07:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2a260994-1221-5049-84dd-c183eb88833e with identifier: SV23538
2026-03-30 07:47:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2a260994-1221-5049-84dd-c183eb88833e with identifier: SV23538 to the API
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:36:03Z',
 'fuel_type': 'diesel',
 'id': '2a260994-1221-5049-84dd-c183eb88833e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV23538',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 359865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-29',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV23538%27 HTTP/1.1" 200 None
2026-03-30 07:47:07 [auto1.de] INFO: Saving data for SV23538: {'auction_closing_time': 1774884963.0, 'created_time': 1774553090.271447, 'last_price_update_time': 1774856827.685791}
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV23538') HTTP/1.1" 204 0
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: HL19525
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: WY73016
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: EJ80862
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: NF34057
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: ZV33449
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: XJ62576
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: MD44435
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: FJ78766
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: AE64290
2026-03-30 07:47:07 [auto1.de] INFO: Found listing with ID: XH15947
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH15947%27 HTTP/1.1" 200 None
2026-03-30 07:47:07 [auto1.de] INFO: Scrape type for XH15947: 2
2026-03-30 07:47:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f57b086c-6eb5-5f59-b454-f87ef085272b with identifier: XH15947
2026-03-30 07:47:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f57b086c-6eb5-5f59-b454-f87ef085272b with scrape type 2
2026-03-30 07:47:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f57b086c-6eb5-5f59-b454-f87ef085272b with scrape type 2
2026-03-30 07:47:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f57b086c-6eb5-5f59-b454-f87ef085272b, identifier: XH15947
2026-03-30 07:47:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f57b086c-6eb5-5f59-b454-f87ef085272b with identifier: XH15947
2026-03-30 07:47:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f57b086c-6eb5-5f59-b454-f87ef085272b with identifier: XH15947
2026-03-30 07:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f57b086c-6eb5-5f59-b454-f87ef085272b with identifier: XH15947 to the API
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:06:59Z',
 'fuel_type': 'petrol',
 'id': 'f57b086c-6eb5-5f59-b454-f87ef085272b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XH15947',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 166786,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-25',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2005}
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH15947%27 HTTP/1.1" 200 None
2026-03-30 07:47:08 [auto1.de] INFO: Saving data for XH15947: {'auction_closing_time': 1774883219.0, 'created_time': 1774552660.213232, 'last_price_update_time': 1774856828.263887}
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XH15947') HTTP/1.1" 204 0
2026-03-30 07:47:08 [auto1.de] INFO: Found listing with ID: BS22515
2026-03-30 07:47:08 [auto1.de] INFO: Found listing with ID: DE54360
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE54360%27 HTTP/1.1" 200 None
2026-03-30 07:47:08 [auto1.de] INFO: Scrape type for DE54360: 2
2026-03-30 07:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6058083a-4357-56d4-918c-384c56dbe5a7 with identifier: DE54360
2026-03-30 07:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6058083a-4357-56d4-918c-384c56dbe5a7 with scrape type 2
2026-03-30 07:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6058083a-4357-56d4-918c-384c56dbe5a7 with scrape type 2
2026-03-30 07:47:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6058083a-4357-56d4-918c-384c56dbe5a7, identifier: DE54360
2026-03-30 07:47:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6058083a-4357-56d4-918c-384c56dbe5a7 with identifier: DE54360
2026-03-30 07:47:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6058083a-4357-56d4-918c-384c56dbe5a7 with identifier: DE54360
2026-03-30 07:47:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6058083a-4357-56d4-918c-384c56dbe5a7 with identifier: DE54360 to the API
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:17:35Z',
 'fuel_type': 'diesel',
 'id': '6058083a-4357-56d4-918c-384c56dbe5a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE54360',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 141075,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-15',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2015}
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE54360%27 HTTP/1.1" 200 None
2026-03-30 07:47:08 [auto1.de] INFO: Saving data for DE54360: {'auction_closing_time': 1774883855.0, 'created_time': 1774552146.76545, 'last_price_update_time': 1774856828.778121}
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DE54360') HTTP/1.1" 204 0
2026-03-30 07:47:08 [auto1.de] INFO: Found listing with ID: LK47364
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK47364%27 HTTP/1.1" 200 None
2026-03-30 07:47:08 [auto1.de] INFO: Scrape type for LK47364: 0
2026-03-30 07:47:08 [auto1.de] INFO: Found listing with ID: GK43362
2026-03-30 07:47:08 [auto1.de] INFO: Found listing with ID: HA43424
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43424%27 HTTP/1.1" 200 None
2026-03-30 07:47:08 [auto1.de] INFO: Scrape type for HA43424: 2
2026-03-30 07:47:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee70710e-153f-5450-a720-ce63c4004b6a with identifier: HA43424
2026-03-30 07:47:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee70710e-153f-5450-a720-ce63c4004b6a with scrape type 2
2026-03-30 07:47:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee70710e-153f-5450-a720-ce63c4004b6a with scrape type 2
2026-03-30 07:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee70710e-153f-5450-a720-ce63c4004b6a, identifier: HA43424
2026-03-30 07:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee70710e-153f-5450-a720-ce63c4004b6a with identifier: HA43424
2026-03-30 07:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee70710e-153f-5450-a720-ce63c4004b6a with identifier: HA43424
2026-03-30 07:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee70710e-153f-5450-a720-ce63c4004b6a with identifier: HA43424 to the API
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:39:49Z',
 'fuel_type': 'petrol',
 'id': 'ee70710e-153f-5450-a720-ce63c4004b6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA43424',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 47556,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-05',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 BlueEfficiency Urban',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Urban',
 'year': 2017}
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA43424%27 HTTP/1.1" 200 None
2026-03-30 07:47:09 [auto1.de] INFO: Saving data for HA43424: {'auction_closing_time': 1774885189.0, 'created_time': 1774638716.731198, 'last_price_update_time': 1774856829.528777}
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HA43424') HTTP/1.1" 204 0
2026-03-30 07:47:09 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-30 07:47:09 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-30 07:47:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:09 [auto1.de] INFO: Channel: 24h | Page: 132 | totalHits: 8390 | hits on page: 40
2026-03-30 07:47:09 [auto1.de] INFO: Found listing with ID: NL88078
2026-03-30 07:47:09 [auto1.de] INFO: Found listing with ID: WS02487
2026-03-30 07:47:09 [auto1.de] INFO: Found listing with ID: ZC46474
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC46474%27 HTTP/1.1" 200 None
2026-03-30 07:47:09 [auto1.de] INFO: Scrape type for ZC46474: 0
2026-03-30 07:47:09 [auto1.de] INFO: Found listing with ID: CE85756
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE85756%27 HTTP/1.1" 200 None
2026-03-30 07:47:09 [auto1.de] INFO: Scrape type for CE85756: 0
2026-03-30 07:47:09 [auto1.de] INFO: Found listing with ID: EZ85797
2026-03-30 07:47:09 [auto1.de] INFO: Found listing with ID: TP63810
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP63810%27 HTTP/1.1" 200 None
2026-03-30 07:47:09 [auto1.de] INFO: Scrape type for TP63810: 0
2026-03-30 07:47:09 [auto1.de] INFO: Found listing with ID: ET35150
2026-03-30 07:47:09 [auto1.de] INFO: Found listing with ID: AK86210
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK86210%27 HTTP/1.1" 200 None
2026-03-30 07:47:09 [auto1.de] INFO: Scrape type for AK86210: 2
2026-03-30 07:47:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6eed928-9871-5978-81b4-4396c247641d with identifier: AK86210
2026-03-30 07:47:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6eed928-9871-5978-81b4-4396c247641d with scrape type 2
2026-03-30 07:47:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6eed928-9871-5978-81b4-4396c247641d with scrape type 2
2026-03-30 07:47:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6eed928-9871-5978-81b4-4396c247641d, identifier: AK86210
2026-03-30 07:47:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6eed928-9871-5978-81b4-4396c247641d with identifier: AK86210
2026-03-30 07:47:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6eed928-9871-5978-81b4-4396c247641d with identifier: AK86210
2026-03-30 07:47:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6eed928-9871-5978-81b4-4396c247641d with identifier: AK86210 to the API
2026-03-30 07:47:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:43:12Z',
 'fuel_type': 'diesel',
 'id': 'c6eed928-9871-5978-81b4-4396c247641d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK86210',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 187297,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-28',
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK86210%27 HTTP/1.1" 200 None
2026-03-30 07:47:10 [auto1.de] INFO: Saving data for AK86210: {'auction_closing_time': 1774885392.0, 'created_time': 1774639742.389798, 'last_price_update_time': 1774856830.138006}
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AK86210') HTTP/1.1" 204 0
2026-03-30 07:47:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:10 [auto1.de] INFO: Found listing with ID: CW19006
2026-03-30 07:47:10 [auto1.de] INFO: Found listing with ID: SA55190
2026-03-30 07:47:10 [auto1.de] INFO: Found listing with ID: WZ35506
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ35506%27 HTTP/1.1" 200 None
2026-03-30 07:47:10 [auto1.de] INFO: Scrape type for WZ35506: 0
2026-03-30 07:47:10 [auto1.de] INFO: Found listing with ID: XJ24379
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ24379%27 HTTP/1.1" 200 None
2026-03-30 07:47:10 [auto1.de] INFO: Scrape type for XJ24379: 0
2026-03-30 07:47:10 [auto1.de] INFO: Found listing with ID: NV33173
2026-03-30 07:47:10 [auto1.de] INFO: Found listing with ID: GD49252
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD49252%27 HTTP/1.1" 200 None
2026-03-30 07:47:10 [auto1.de] INFO: Scrape type for GD49252: 0
2026-03-30 07:47:10 [auto1.de] INFO: Found listing with ID: XV42513
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV42513%27 HTTP/1.1" 200 None
2026-03-30 07:47:10 [auto1.de] INFO: Scrape type for XV42513: 0
2026-03-30 07:47:10 [auto1.de] INFO: Found listing with ID: JA72326
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA72326%27 HTTP/1.1" 200 None
2026-03-30 07:47:10 [auto1.de] INFO: Scrape type for JA72326: 2
2026-03-30 07:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce400519-d84f-5502-8a34-9e14df2ed35f with identifier: JA72326
2026-03-30 07:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce400519-d84f-5502-8a34-9e14df2ed35f with scrape type 2
2026-03-30 07:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce400519-d84f-5502-8a34-9e14df2ed35f with scrape type 2
2026-03-30 07:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce400519-d84f-5502-8a34-9e14df2ed35f, identifier: JA72326
2026-03-30 07:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce400519-d84f-5502-8a34-9e14df2ed35f with identifier: JA72326
2026-03-30 07:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce400519-d84f-5502-8a34-9e14df2ed35f with identifier: JA72326
2026-03-30 07:47:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce400519-d84f-5502-8a34-9e14df2ed35f with identifier: JA72326 to the API
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 306,
 'expiration_date': '2026-03-30T15:00:28Z',
 'fuel_type': 'petrol',
 'id': 'ce400519-d84f-5502-8a34-9e14df2ed35f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA72326',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 138284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-25',
 'seller_name': None,
 'title': 'BMW 5er ActiveHybrid5',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA72326%27 HTTP/1.1" 200 None
2026-03-30 07:47:10 [auto1.de] INFO: Saving data for JA72326: {'auction_closing_time': 1774882828.0, 'created_time': 1774636963.155437, 'last_price_update_time': 1774856830.779215}
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JA72326') HTTP/1.1" 204 0
2026-03-30 07:47:10 [auto1.de] INFO: Found listing with ID: BX05285
2026-03-30 07:47:10 [auto1.de] INFO: Found listing with ID: NV88353
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV88353%27 HTTP/1.1" 200 None
2026-03-30 07:47:10 [auto1.de] INFO: Scrape type for NV88353: 2
2026-03-30 07:47:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe025ad6-d883-5f99-9a19-a5e55898e754 with identifier: NV88353
2026-03-30 07:47:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe025ad6-d883-5f99-9a19-a5e55898e754 with scrape type 2
2026-03-30 07:47:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe025ad6-d883-5f99-9a19-a5e55898e754 with scrape type 2
2026-03-30 07:47:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe025ad6-d883-5f99-9a19-a5e55898e754, identifier: NV88353
2026-03-30 07:47:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe025ad6-d883-5f99-9a19-a5e55898e754 with identifier: NV88353
2026-03-30 07:47:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe025ad6-d883-5f99-9a19-a5e55898e754 with identifier: NV88353
2026-03-30 07:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe025ad6-d883-5f99-9a19-a5e55898e754 with identifier: NV88353 to the API
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:01:48Z',
 'fuel_type': 'diesel',
 'id': 'fe025ad6-d883-5f99-9a19-a5e55898e754',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV88353',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 263771,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-20',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Edition 25',
 'transmission': 'automatic',
 'trim': 'Edition 25',
 'year': 2013}
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV88353%27 HTTP/1.1" 200 None
2026-03-30 07:47:11 [auto1.de] INFO: Saving data for NV88353: {'auction_closing_time': 1774882908.0, 'created_time': 1774638992.170798, 'last_price_update_time': 1774856831.207349}
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV88353') HTTP/1.1" 204 0
2026-03-30 07:47:11 [auto1.de] INFO: Found listing with ID: CL87720
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL87720%27 HTTP/1.1" 200 None
2026-03-30 07:47:11 [auto1.de] INFO: Scrape type for CL87720: 0
2026-03-30 07:47:11 [auto1.de] INFO: Found listing with ID: WN39495
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39495%27 HTTP/1.1" 200 None
2026-03-30 07:47:11 [auto1.de] INFO: Scrape type for WN39495: 2
2026-03-30 07:47:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6548684-ee1e-5298-9585-e66aa6784471 with identifier: WN39495
2026-03-30 07:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6548684-ee1e-5298-9585-e66aa6784471 with scrape type 2
2026-03-30 07:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6548684-ee1e-5298-9585-e66aa6784471 with scrape type 2
2026-03-30 07:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6548684-ee1e-5298-9585-e66aa6784471, identifier: WN39495
2026-03-30 07:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6548684-ee1e-5298-9585-e66aa6784471 with identifier: WN39495
2026-03-30 07:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6548684-ee1e-5298-9585-e66aa6784471 with identifier: WN39495
2026-03-30 07:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6548684-ee1e-5298-9585-e66aa6784471 with identifier: WN39495 to the API
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:36:08Z',
 'fuel_type': 'diesel',
 'id': 'd6548684-ee1e-5298-9585-e66aa6784471',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN39495',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 149917,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-23',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi EcoBlue Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2019}
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN39495%27 HTTP/1.1" 200 None
2026-03-30 07:47:11 [auto1.de] INFO: Saving data for WN39495: {'auction_closing_time': 1774884968.0, 'created_time': 1774639191.860977, 'last_price_update_time': 1774856831.636813}
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN39495') HTTP/1.1" 204 0
2026-03-30 07:47:11 [auto1.de] INFO: Found listing with ID: KU16473
2026-03-30 07:47:11 [auto1.de] INFO: Found listing with ID: HC04240
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04240%27 HTTP/1.1" 200 None
2026-03-30 07:47:11 [auto1.de] INFO: Scrape type for HC04240: 2
2026-03-30 07:47:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35f8b009-ae01-5381-8a08-fac082b47fa7 with identifier: HC04240
2026-03-30 07:47:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35f8b009-ae01-5381-8a08-fac082b47fa7 with scrape type 2
2026-03-30 07:47:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35f8b009-ae01-5381-8a08-fac082b47fa7 with scrape type 2
2026-03-30 07:47:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35f8b009-ae01-5381-8a08-fac082b47fa7, identifier: HC04240
2026-03-30 07:47:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35f8b009-ae01-5381-8a08-fac082b47fa7 with identifier: HC04240
2026-03-30 07:47:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35f8b009-ae01-5381-8a08-fac082b47fa7 with identifier: HC04240
2026-03-30 07:47:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35f8b009-ae01-5381-8a08-fac082b47fa7 with identifier: HC04240 to the API
2026-03-30 07:47:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:11:48Z',
 'fuel_type': 'petrol',
 'id': '35f8b009-ae01-5381-8a08-fac082b47fa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC04240',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 125306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-25',
 'seller_name': None,
 'title': 'Renault Twingo 1.0 SCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC04240%27 HTTP/1.1" 200 None
2026-03-30 07:47:12 [auto1.de] INFO: Saving data for HC04240: {'auction_closing_time': 1774883508.0, 'created_time': 1774552827.28951, 'last_price_update_time': 1774856832.170723}
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HC04240') HTTP/1.1" 204 0
2026-03-30 07:47:12 [auto1.de] INFO: Found listing with ID: EZ94089
2026-03-30 07:47:12 [auto1.de] INFO: Found listing with ID: PF96299
2026-03-30 07:47:12 [auto1.de] INFO: Found listing with ID: CV81199
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV81199%27 HTTP/1.1" 200 None
2026-03-30 07:47:12 [auto1.de] INFO: Scrape type for CV81199: 0
2026-03-30 07:47:12 [auto1.de] INFO: Found listing with ID: CK46360
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK46360%27 HTTP/1.1" 200 None
2026-03-30 07:47:12 [auto1.de] INFO: Scrape type for CK46360: 2
2026-03-30 07:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4884d039-a05f-5a9c-83c1-447324d49935 with identifier: CK46360
2026-03-30 07:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4884d039-a05f-5a9c-83c1-447324d49935 with scrape type 2
2026-03-30 07:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4884d039-a05f-5a9c-83c1-447324d49935 with scrape type 2
2026-03-30 07:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4884d039-a05f-5a9c-83c1-447324d49935, identifier: CK46360
2026-03-30 07:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4884d039-a05f-5a9c-83c1-447324d49935 with identifier: CK46360
2026-03-30 07:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4884d039-a05f-5a9c-83c1-447324d49935 with identifier: CK46360
2026-03-30 07:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4884d039-a05f-5a9c-83c1-447324d49935 with identifier: CK46360 to the API
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:17Z',
 'fuel_type': 'diesel',
 'id': '4884d039-a05f-5a9c-83c1-447324d49935',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK46360',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 86867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-13',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR Black Matt Edition',
 'transmission': 'automatic',
 'trim': 'FR Black Matt Edition',
 'year': 2020}
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK46360%27 HTTP/1.1" 200 None
2026-03-30 07:47:12 [auto1.de] INFO: Saving data for CK46360: {'auction_closing_time': 1774884437.0, 'created_time': 1774638538.012434, 'last_price_update_time': 1774856832.647262}
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CK46360') HTTP/1.1" 204 0
2026-03-30 07:47:12 [auto1.de] INFO: Found listing with ID: XF94363
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF94363%27 HTTP/1.1" 200 None
2026-03-30 07:47:12 [auto1.de] INFO: Scrape type for XF94363: 2
2026-03-30 07:47:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with identifier: XF94363
2026-03-30 07:47:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with scrape type 2
2026-03-30 07:47:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with scrape type 2
2026-03-30 07:47:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d991e2d-eede-5ad3-a60b-28b0f5bc5161, identifier: XF94363
2026-03-30 07:47:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with identifier: XF94363
2026-03-30 07:47:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with identifier: XF94363
2026-03-30 07:47:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d991e2d-eede-5ad3-a60b-28b0f5bc5161 with identifier: XF94363 to the API
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 265,
 'expiration_date': '2026-03-30T15:18:41Z',
 'fuel_type': 'diesel',
 'id': '6d991e2d-eede-5ad3-a60b-28b0f5bc5161',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF94363',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 200489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 350 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2014}
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF94363%27 HTTP/1.1" 200 None
2026-03-30 07:47:13 [auto1.de] INFO: Saving data for XF94363: {'auction_closing_time': 1774883921.0, 'created_time': 1774638995.253087, 'last_price_update_time': 1774856833.04966}
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF94363') HTTP/1.1" 204 0
2026-03-30 07:47:13 [auto1.de] INFO: Found listing with ID: SD16829
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD16829%27 HTTP/1.1" 200 None
2026-03-30 07:47:13 [auto1.de] INFO: Scrape type for SD16829: 0
2026-03-30 07:47:13 [auto1.de] INFO: Found listing with ID: CS93004
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS93004%27 HTTP/1.1" 200 None
2026-03-30 07:47:13 [auto1.de] INFO: Scrape type for CS93004: 2
2026-03-30 07:47:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8148879-fde0-5d7c-8be4-dc345a13130a with identifier: CS93004
2026-03-30 07:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8148879-fde0-5d7c-8be4-dc345a13130a with scrape type 2
2026-03-30 07:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8148879-fde0-5d7c-8be4-dc345a13130a with scrape type 2
2026-03-30 07:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a8148879-fde0-5d7c-8be4-dc345a13130a, identifier: CS93004
2026-03-30 07:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a8148879-fde0-5d7c-8be4-dc345a13130a with identifier: CS93004
2026-03-30 07:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a8148879-fde0-5d7c-8be4-dc345a13130a with identifier: CS93004
2026-03-30 07:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a8148879-fde0-5d7c-8be4-dc345a13130a with identifier: CS93004 to the API
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:51Z',
 'fuel_type': 'diesel',
 'id': 'a8148879-fde0-5d7c-8be4-dc345a13130a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS93004',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Transporter',
 'odometer': 41003,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-04',
 'seller_name': None,
 'title': 'Volkswagen T6 Transporter 2.0 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2019}
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS93004%27 HTTP/1.1" 200 None
2026-03-30 07:47:13 [auto1.de] INFO: Saving data for CS93004: {'auction_closing_time': 1774884351.0, 'created_time': 1774553209.487423, 'last_price_update_time': 1774856833.502476}
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS93004') HTTP/1.1" 204 0
2026-03-30 07:47:13 [auto1.de] INFO: Found listing with ID: KF41308
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF41308%27 HTTP/1.1" 200 None
2026-03-30 07:47:13 [auto1.de] INFO: Scrape type for KF41308: 0
2026-03-30 07:47:13 [auto1.de] INFO: Found listing with ID: JX40120
2026-03-30 07:47:13 [auto1.de] INFO: Found listing with ID: FD22353
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD22353%27 HTTP/1.1" 200 None
2026-03-30 07:47:13 [auto1.de] INFO: Scrape type for FD22353: 0
2026-03-30 07:47:13 [auto1.de] INFO: Found listing with ID: JX81073
2026-03-30 07:47:13 [auto1.de] INFO: Found listing with ID: VN30485
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN30485%27 HTTP/1.1" 200 None
2026-03-30 07:47:13 [auto1.de] INFO: Scrape type for VN30485: 2
2026-03-30 07:47:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 045ae795-0484-552a-aaa6-f01a2d2591a4 with identifier: VN30485
2026-03-30 07:47:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 045ae795-0484-552a-aaa6-f01a2d2591a4 with scrape type 2
2026-03-30 07:47:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 045ae795-0484-552a-aaa6-f01a2d2591a4 with scrape type 2
2026-03-30 07:47:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 045ae795-0484-552a-aaa6-f01a2d2591a4, identifier: VN30485
2026-03-30 07:47:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 045ae795-0484-552a-aaa6-f01a2d2591a4 with identifier: VN30485
2026-03-30 07:47:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 045ae795-0484-552a-aaa6-f01a2d2591a4 with identifier: VN30485
2026-03-30 07:47:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 045ae795-0484-552a-aaa6-f01a2d2591a4 with identifier: VN30485 to the API
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:17:11Z',
 'fuel_type': 'diesel',
 'id': '045ae795-0484-552a-aaa6-f01a2d2591a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN30485',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Tourneo Custom',
 'odometer': 90295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-25',
 'seller_name': None,
 'title': 'Ford Tourneo Custom 2.0 TDCi 320 L1 Tourneo Titanium X',
 'transmission': 'manual',
 'trim': '320 L1 Tourneo Titanium X',
 'year': 2020}
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN30485%27 HTTP/1.1" 200 None
2026-03-30 07:47:13 [auto1.de] INFO: Saving data for VN30485: {'auction_closing_time': 1774883831.0, 'created_time': 1774639846.50652, 'last_price_update_time': 1774856833.953309}
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN30485') HTTP/1.1" 204 0
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: PL78300
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: KD34962
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: LK64393
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK64393%27 HTTP/1.1" 200 None
2026-03-30 07:47:14 [auto1.de] INFO: Scrape type for LK64393: 2
2026-03-30 07:47:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4286fcf8-c49c-5651-b060-484b5ae04ecd with identifier: LK64393
2026-03-30 07:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4286fcf8-c49c-5651-b060-484b5ae04ecd with scrape type 2
2026-03-30 07:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4286fcf8-c49c-5651-b060-484b5ae04ecd with scrape type 2
2026-03-30 07:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4286fcf8-c49c-5651-b060-484b5ae04ecd, identifier: LK64393
2026-03-30 07:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4286fcf8-c49c-5651-b060-484b5ae04ecd with identifier: LK64393
2026-03-30 07:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4286fcf8-c49c-5651-b060-484b5ae04ecd with identifier: LK64393
2026-03-30 07:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4286fcf8-c49c-5651-b060-484b5ae04ecd with identifier: LK64393 to the API
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:56:10Z',
 'fuel_type': 'diesel',
 'id': '4286fcf8-c49c-5651-b060-484b5ae04ecd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LK64393',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon',
 'odometer': 33230,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-07',
 'seller_name': None,
 'title': 'Volkswagen Arteon 2.0 TDI R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2018}
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK64393%27 HTTP/1.1" 200 None
2026-03-30 07:47:14 [auto1.de] INFO: Saving data for LK64393: {'auction_closing_time': 1774886170.0, 'created_time': 1774638530.604216, 'last_price_update_time': 1774856834.509058}
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LK64393') HTTP/1.1" 204 0
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE98596%27 HTTP/1.1" 200 None
2026-03-30 07:47:14 [auto1.de] INFO: Scrape type for WE98596: 0
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-30 07:47:14 [auto1.de] INFO: Scrape type for SD36670: 0
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-30 07:47:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:14 [auto1.de] INFO: Channel: 24h | Page: 133 | totalHits: 8393 | hits on page: 40
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: WE98596
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE98596%27 HTTP/1.1" 200 None
2026-03-30 07:47:14 [auto1.de] INFO: Scrape type for WE98596: 0
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: SD36670
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD36670%27 HTTP/1.1" 200 None
2026-03-30 07:47:14 [auto1.de] INFO: Scrape type for SD36670: 0
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: ES44709
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: AJ62547
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ62547%27 HTTP/1.1" 200 None
2026-03-30 07:47:14 [auto1.de] INFO: Scrape type for AJ62547: 0
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: GM59339
2026-03-30 07:47:14 [auto1.de] INFO: Found listing with ID: GU66110
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU66110%27 HTTP/1.1" 200 None
2026-03-30 07:47:14 [auto1.de] INFO: Scrape type for GU66110: 2
2026-03-30 07:47:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21e6de5e-4f60-5a64-93e7-e99dae8c4ed6 with identifier: GU66110
2026-03-30 07:47:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21e6de5e-4f60-5a64-93e7-e99dae8c4ed6 with scrape type 2
2026-03-30 07:47:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21e6de5e-4f60-5a64-93e7-e99dae8c4ed6 with scrape type 2
2026-03-30 07:47:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 21e6de5e-4f60-5a64-93e7-e99dae8c4ed6, identifier: GU66110
2026-03-30 07:47:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 21e6de5e-4f60-5a64-93e7-e99dae8c4ed6 with identifier: GU66110
2026-03-30 07:47:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 21e6de5e-4f60-5a64-93e7-e99dae8c4ed6 with identifier: GU66110
2026-03-30 07:47:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 21e6de5e-4f60-5a64-93e7-e99dae8c4ed6 with identifier: GU66110 to the API
2026-03-30 07:47:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:46:09Z',
 'fuel_type': 'petrol',
 'id': '21e6de5e-4f60-5a64-93e7-e99dae8c4ed6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU66110',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 111033,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-05',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2017}
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU66110%27 HTTP/1.1" 200 None
2026-03-30 07:47:15 [auto1.de] INFO: Saving data for GU66110: {'auction_closing_time': 1774885569.0, 'created_time': 1774636860.251477, 'last_price_update_time': 1774856835.119144}
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU66110') HTTP/1.1" 204 0
2026-03-30 07:47:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:15 [auto1.de] INFO: Found listing with ID: AW80803
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AW80803%27 HTTP/1.1" 200 None
2026-03-30 07:47:15 [auto1.de] INFO: Scrape type for AW80803: 0
2026-03-30 07:47:15 [auto1.de] INFO: Found listing with ID: PT90816
2026-03-30 07:47:15 [auto1.de] INFO: Found listing with ID: AL23415
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL23415%27 HTTP/1.1" 200 None
2026-03-30 07:47:15 [auto1.de] INFO: Scrape type for AL23415: 2
2026-03-30 07:47:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbac7b56-02b0-5101-aed6-77c48fa219b4 with identifier: AL23415
2026-03-30 07:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbac7b56-02b0-5101-aed6-77c48fa219b4 with scrape type 2
2026-03-30 07:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbac7b56-02b0-5101-aed6-77c48fa219b4 with scrape type 2
2026-03-30 07:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fbac7b56-02b0-5101-aed6-77c48fa219b4, identifier: AL23415
2026-03-30 07:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fbac7b56-02b0-5101-aed6-77c48fa219b4 with identifier: AL23415
2026-03-30 07:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fbac7b56-02b0-5101-aed6-77c48fa219b4 with identifier: AL23415
2026-03-30 07:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fbac7b56-02b0-5101-aed6-77c48fa219b4 with identifier: AL23415 to the API
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:00:15Z',
 'fuel_type': 'petrol',
 'id': 'fbac7b56-02b0-5101-aed6-77c48fa219b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL23415',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 280072,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-25',
 'seller_name': None,
 'title': 'BMW 7er 728i',
 'transmission': 'manual',
 'trim': '',
 'year': 1999}
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL23415%27 HTTP/1.1" 200 None
2026-03-30 07:47:15 [auto1.de] INFO: Saving data for AL23415: {'auction_closing_time': 1774882815.0, 'created_time': 1773307460.619199, 'last_price_update_time': 1774856835.645986}
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AL23415') HTTP/1.1" 204 0
2026-03-30 07:47:15 [auto1.de] INFO: Found listing with ID: YE69852
2026-03-30 07:47:15 [auto1.de] INFO: Found listing with ID: VS72441
2026-03-30 07:47:15 [auto1.de] INFO: Found listing with ID: BH52991
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH52991%27 HTTP/1.1" 200 None
2026-03-30 07:47:15 [auto1.de] INFO: Scrape type for BH52991: 0
2026-03-30 07:47:15 [auto1.de] INFO: Found listing with ID: KY72629
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY72629%27 HTTP/1.1" 200 None
2026-03-30 07:47:15 [auto1.de] INFO: Scrape type for KY72629: 2
2026-03-30 07:47:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43fe091e-b782-531a-b5c6-bf756f554ff0 with identifier: KY72629
2026-03-30 07:47:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43fe091e-b782-531a-b5c6-bf756f554ff0 with scrape type 2
2026-03-30 07:47:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43fe091e-b782-531a-b5c6-bf756f554ff0 with scrape type 2
2026-03-30 07:47:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43fe091e-b782-531a-b5c6-bf756f554ff0, identifier: KY72629
2026-03-30 07:47:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43fe091e-b782-531a-b5c6-bf756f554ff0 with identifier: KY72629
2026-03-30 07:47:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43fe091e-b782-531a-b5c6-bf756f554ff0 with identifier: KY72629
2026-03-30 07:47:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43fe091e-b782-531a-b5c6-bf756f554ff0 with identifier: KY72629 to the API
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:07:48Z',
 'fuel_type': 'hybrid',
 'id': '43fe091e-b782-531a-b5c6-bf756f554ff0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY72629',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 43657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300e Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2020}
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY72629%27 HTTP/1.1" 200 None
2026-03-30 07:47:16 [auto1.de] INFO: Saving data for KY72629: {'auction_closing_time': 1774883268.0, 'created_time': 1774639392.523734, 'last_price_update_time': 1774856836.064625}
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY72629') HTTP/1.1" 204 0
2026-03-30 07:47:16 [auto1.de] INFO: Found listing with ID: JE81559
2026-03-30 07:47:16 [auto1.de] INFO: Found listing with ID: ME89657
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME89657%27 HTTP/1.1" 200 None
2026-03-30 07:47:16 [auto1.de] INFO: Scrape type for ME89657: 0
2026-03-30 07:47:16 [auto1.de] INFO: Found listing with ID: GJ05712
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ05712%27 HTTP/1.1" 200 None
2026-03-30 07:47:16 [auto1.de] INFO: Scrape type for GJ05712: 0
2026-03-30 07:47:16 [auto1.de] INFO: Found listing with ID: TT27495
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT27495%27 HTTP/1.1" 200 None
2026-03-30 07:47:16 [auto1.de] INFO: Scrape type for TT27495: 0
2026-03-30 07:47:16 [auto1.de] INFO: Found listing with ID: AM19734
2026-03-30 07:47:16 [auto1.de] INFO: Found listing with ID: HU29731
2026-03-30 07:47:16 [auto1.de] INFO: Found listing with ID: ND35935
2026-03-30 07:47:16 [auto1.de] INFO: Found listing with ID: ZM99082
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM99082%27 HTTP/1.1" 200 None
2026-03-30 07:47:16 [auto1.de] INFO: Scrape type for ZM99082: 2
2026-03-30 07:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd76518c-07f5-5d2a-805c-74ca02d927a6 with identifier: ZM99082
2026-03-30 07:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd76518c-07f5-5d2a-805c-74ca02d927a6 with scrape type 2
2026-03-30 07:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd76518c-07f5-5d2a-805c-74ca02d927a6 with scrape type 2
2026-03-30 07:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd76518c-07f5-5d2a-805c-74ca02d927a6, identifier: ZM99082
2026-03-30 07:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd76518c-07f5-5d2a-805c-74ca02d927a6 with identifier: ZM99082
2026-03-30 07:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd76518c-07f5-5d2a-805c-74ca02d927a6 with identifier: ZM99082
2026-03-30 07:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd76518c-07f5-5d2a-805c-74ca02d927a6 with identifier: ZM99082 to the API
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:30:55Z',
 'fuel_type': 'diesel',
 'id': 'bd76518c-07f5-5d2a-805c-74ca02d927a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZM99082',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 253401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-05',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2011}
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZM99082%27 HTTP/1.1" 200 None
2026-03-30 07:47:16 [auto1.de] INFO: Saving data for ZM99082: {'auction_closing_time': 1774884655.0, 'created_time': 1774639664.473337, 'last_price_update_time': 1774856836.601135}
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZM99082') HTTP/1.1" 204 0
2026-03-30 07:47:16 [auto1.de] INFO: Found listing with ID: FJ59032
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59032%27 HTTP/1.1" 200 None
2026-03-30 07:47:16 [auto1.de] INFO: Scrape type for FJ59032: 2
2026-03-30 07:47:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with identifier: FJ59032
2026-03-30 07:47:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with scrape type 2
2026-03-30 07:47:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with scrape type 2
2026-03-30 07:47:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a3df8a99-d70a-56e6-bf5e-e9c24c16b327, identifier: FJ59032
2026-03-30 07:47:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with identifier: FJ59032
2026-03-30 07:47:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with identifier: FJ59032
2026-03-30 07:47:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a3df8a99-d70a-56e6-bf5e-e9c24c16b327 with identifier: FJ59032 to the API
2026-03-30 07:47:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:32:29Z',
 'fuel_type': 'petrol',
 'id': 'a3df8a99-d70a-56e6-bf5e-e9c24c16b327',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ59032',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 131065,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-18',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo 150 Jahre Opel',
 'transmission': 'manual',
 'trim': '150 Jahre',
 'year': 2012}
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ59032%27 HTTP/1.1" 200 None
2026-03-30 07:47:17 [auto1.de] INFO: Saving data for FJ59032: {'auction_closing_time': 1774884749.0, 'created_time': 1774552669.187664, 'last_price_update_time': 1774856837.119091}
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ59032') HTTP/1.1" 204 0
2026-03-30 07:47:17 [auto1.de] INFO: Found listing with ID: UZ52700
2026-03-30 07:47:17 [auto1.de] INFO: Found listing with ID: MA76308
2026-03-30 07:47:17 [auto1.de] INFO: Found listing with ID: BD50097
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD50097%27 HTTP/1.1" 200 None
2026-03-30 07:47:17 [auto1.de] INFO: Scrape type for BD50097: 0
2026-03-30 07:47:17 [auto1.de] INFO: Found listing with ID: PS82659
2026-03-30 07:47:17 [auto1.de] INFO: Found listing with ID: CD03678
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD03678%27 HTTP/1.1" 200 None
2026-03-30 07:47:17 [auto1.de] INFO: Scrape type for CD03678: 0
2026-03-30 07:47:17 [auto1.de] INFO: Found listing with ID: FG98454
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG98454%27 HTTP/1.1" 200 None
2026-03-30 07:47:17 [auto1.de] INFO: Scrape type for FG98454: 0
2026-03-30 07:47:17 [auto1.de] INFO: Found listing with ID: LM85601
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM85601%27 HTTP/1.1" 200 None
2026-03-30 07:47:17 [auto1.de] INFO: Scrape type for LM85601: 0
2026-03-30 07:47:17 [auto1.de] INFO: Found listing with ID: XU55815
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU55815%27 HTTP/1.1" 200 None
2026-03-30 07:47:17 [auto1.de] INFO: Scrape type for XU55815: 0
2026-03-30 07:47:17 [auto1.de] INFO: Found listing with ID: EC14916
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC14916%27 HTTP/1.1" 200 None
2026-03-30 07:47:17 [auto1.de] INFO: Scrape type for EC14916: 2
2026-03-30 07:47:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92558692-110c-551f-aa31-0fc434be3108 with identifier: EC14916
2026-03-30 07:47:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92558692-110c-551f-aa31-0fc434be3108 with scrape type 2
2026-03-30 07:47:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92558692-110c-551f-aa31-0fc434be3108 with scrape type 2
2026-03-30 07:47:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92558692-110c-551f-aa31-0fc434be3108, identifier: EC14916
2026-03-30 07:47:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92558692-110c-551f-aa31-0fc434be3108 with identifier: EC14916
2026-03-30 07:47:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92558692-110c-551f-aa31-0fc434be3108 with identifier: EC14916
2026-03-30 07:47:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92558692-110c-551f-aa31-0fc434be3108 with identifier: EC14916 to the API
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:27:36Z',
 'fuel_type': 'petrol',
 'id': '92558692-110c-551f-aa31-0fc434be3108',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC14916',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 139027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-17',
 'seller_name': None,
 'title': 'Suzuki Swift 1.0 BoosterJet Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC14916%27 HTTP/1.1" 200 None
2026-03-30 07:47:18 [auto1.de] INFO: Saving data for EC14916: {'auction_closing_time': 1774884456.0, 'created_time': 1774552016.059288, 'last_price_update_time': 1774856838.071311}
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EC14916') HTTP/1.1" 204 0
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: XC25059
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: NH67676
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: TX40216
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: YX31470
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX31470%27 HTTP/1.1" 200 None
2026-03-30 07:47:18 [auto1.de] INFO: Scrape type for YX31470: 0
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: MK08111
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK08111%27 HTTP/1.1" 200 None
2026-03-30 07:47:18 [auto1.de] INFO: Scrape type for MK08111: 0
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: FP02134
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP02134%27 HTTP/1.1" 200 None
2026-03-30 07:47:18 [auto1.de] INFO: Scrape type for FP02134: 2
2026-03-30 07:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0112e5b-3b94-5ab1-b449-11aa67a85372 with identifier: FP02134
2026-03-30 07:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0112e5b-3b94-5ab1-b449-11aa67a85372 with scrape type 2
2026-03-30 07:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0112e5b-3b94-5ab1-b449-11aa67a85372 with scrape type 2
2026-03-30 07:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e0112e5b-3b94-5ab1-b449-11aa67a85372, identifier: FP02134
2026-03-30 07:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e0112e5b-3b94-5ab1-b449-11aa67a85372 with identifier: FP02134
2026-03-30 07:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e0112e5b-3b94-5ab1-b449-11aa67a85372 with identifier: FP02134
2026-03-30 07:47:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e0112e5b-3b94-5ab1-b449-11aa67a85372 with identifier: FP02134 to the API
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:12Z',
 'fuel_type': 'diesel',
 'id': 'e0112e5b-3b94-5ab1-b449-11aa67a85372',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP02134',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Alhambra',
 'odometer': 138792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-11',
 'seller_name': None,
 'title': 'Seat Alhambra 2.0 TDI FR-Line',
 'transmission': 'manual',
 'trim': 'FR-Line',
 'year': 2017}
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP02134%27 HTTP/1.1" 200 None
2026-03-30 07:47:18 [auto1.de] INFO: Saving data for FP02134: {'auction_closing_time': 1774885692.0, 'created_time': 1774638563.204955, 'last_price_update_time': 1774856838.513724}
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP02134') HTTP/1.1" 204 0
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: AD30182
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: LX22574
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: DJ81890
2026-03-30 07:47:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:18 [auto1.de] INFO: Channel: 24h | Page: 134 | totalHits: 8393 | hits on page: 40
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: UE87725
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE87725%27 HTTP/1.1" 200 None
2026-03-30 07:47:18 [auto1.de] INFO: Scrape type for UE87725: 0
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: TJ52961
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: LV52918
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: NC46979
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC46979%27 HTTP/1.1" 200 None
2026-03-30 07:47:18 [auto1.de] INFO: Scrape type for NC46979: 0
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: PW08848
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: YL92844
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: UC42370
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC42370%27 HTTP/1.1" 200 None
2026-03-30 07:47:18 [auto1.de] INFO: Scrape type for UC42370: 0
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: XC92552
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC92552%27 HTTP/1.1" 200 None
2026-03-30 07:47:18 [auto1.de] INFO: Scrape type for XC92552: 0
2026-03-30 07:47:18 [auto1.de] INFO: Found listing with ID: LN34178
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN34178%27 HTTP/1.1" 200 None
2026-03-30 07:47:18 [auto1.de] INFO: Scrape type for LN34178: 2
2026-03-30 07:47:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a92c413a-46c7-58ac-854a-d9aac97ba7df with identifier: LN34178
2026-03-30 07:47:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a92c413a-46c7-58ac-854a-d9aac97ba7df with scrape type 2
2026-03-30 07:47:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a92c413a-46c7-58ac-854a-d9aac97ba7df with scrape type 2
2026-03-30 07:47:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a92c413a-46c7-58ac-854a-d9aac97ba7df, identifier: LN34178
2026-03-30 07:47:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a92c413a-46c7-58ac-854a-d9aac97ba7df with identifier: LN34178
2026-03-30 07:47:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a92c413a-46c7-58ac-854a-d9aac97ba7df with identifier: LN34178
2026-03-30 07:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a92c413a-46c7-58ac-854a-d9aac97ba7df with identifier: LN34178 to the API
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:41:45Z',
 'fuel_type': 'petrol',
 'id': 'a92c413a-46c7-58ac-854a-d9aac97ba7df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LN34178',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 145253,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-28',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive pure',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive pure',
 'year': 2009}
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN34178%27 HTTP/1.1" 200 None
2026-03-30 07:47:19 [auto1.de] INFO: Saving data for LN34178: {'auction_closing_time': 1774885305.0, 'created_time': 1773946934.032415, 'last_price_update_time': 1774856839.214042}
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LN34178') HTTP/1.1" 204 0
2026-03-30 07:47:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:19 [auto1.de] INFO: Found listing with ID: CK27476
2026-03-30 07:47:19 [auto1.de] INFO: Found listing with ID: WV16405
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV16405%27 HTTP/1.1" 200 None
2026-03-30 07:47:19 [auto1.de] INFO: Scrape type for WV16405: 0
2026-03-30 07:47:19 [auto1.de] INFO: Found listing with ID: BT49963
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT49963%27 HTTP/1.1" 200 None
2026-03-30 07:47:19 [auto1.de] INFO: Scrape type for BT49963: 2
2026-03-30 07:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41bff248-9609-5989-ad44-2d983e96df7b with identifier: BT49963
2026-03-30 07:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41bff248-9609-5989-ad44-2d983e96df7b with scrape type 2
2026-03-30 07:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41bff248-9609-5989-ad44-2d983e96df7b with scrape type 2
2026-03-30 07:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41bff248-9609-5989-ad44-2d983e96df7b, identifier: BT49963
2026-03-30 07:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41bff248-9609-5989-ad44-2d983e96df7b with identifier: BT49963
2026-03-30 07:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41bff248-9609-5989-ad44-2d983e96df7b with identifier: BT49963
2026-03-30 07:47:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41bff248-9609-5989-ad44-2d983e96df7b with identifier: BT49963 to the API
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:36:36Z',
 'fuel_type': 'diesel',
 'id': '41bff248-9609-5989-ad44-2d983e96df7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT49963',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 311416,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-04-18',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2007}
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT49963%27 HTTP/1.1" 200 None
2026-03-30 07:47:19 [auto1.de] INFO: Saving data for BT49963: {'auction_closing_time': 1774884996.0, 'created_time': 1774638965.071662, 'last_price_update_time': 1774856839.785714}
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BT49963') HTTP/1.1" 204 0
2026-03-30 07:47:19 [auto1.de] INFO: Found listing with ID: AN68791
2026-03-30 07:47:19 [auto1.de] INFO: Found listing with ID: SA68147
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA68147%27 HTTP/1.1" 200 None
2026-03-30 07:47:19 [auto1.de] INFO: Scrape type for SA68147: 0
2026-03-30 07:47:19 [auto1.de] INFO: Found listing with ID: SP68179
2026-03-30 07:47:19 [auto1.de] INFO: Found listing with ID: NT27416
2026-03-30 07:47:19 [auto1.de] INFO: Found listing with ID: TY58494
2026-03-30 07:47:19 [auto1.de] INFO: Found listing with ID: WC33817
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC33817%27 HTTP/1.1" 200 None
2026-03-30 07:47:19 [auto1.de] INFO: Scrape type for WC33817: 2
2026-03-30 07:47:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a751389-2957-55b7-b863-421eb5c62040 with identifier: WC33817
2026-03-30 07:47:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a751389-2957-55b7-b863-421eb5c62040 with scrape type 2
2026-03-30 07:47:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9a751389-2957-55b7-b863-421eb5c62040 with scrape type 2
2026-03-30 07:47:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9a751389-2957-55b7-b863-421eb5c62040, identifier: WC33817
2026-03-30 07:47:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9a751389-2957-55b7-b863-421eb5c62040 with identifier: WC33817
2026-03-30 07:47:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9a751389-2957-55b7-b863-421eb5c62040 with identifier: WC33817
2026-03-30 07:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9a751389-2957-55b7-b863-421eb5c62040 with identifier: WC33817 to the API
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:48Z',
 'fuel_type': 'petrol',
 'id': '9a751389-2957-55b7-b863-421eb5c62040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC33817',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 84342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-15',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Join',
 'transmission': 'automatic',
 'trim': 'Join',
 'year': 2018}
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC33817%27 HTTP/1.1" 200 None
2026-03-30 07:47:20 [auto1.de] INFO: Saving data for WC33817: {'auction_closing_time': 1774884528.0, 'created_time': 1774550860.280691, 'last_price_update_time': 1774856840.21178}
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WC33817') HTTP/1.1" 204 0
2026-03-30 07:47:20 [auto1.de] INFO: Found listing with ID: PR32105
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR32105%27 HTTP/1.1" 200 None
2026-03-30 07:47:20 [auto1.de] INFO: Scrape type for PR32105: 0
2026-03-30 07:47:20 [auto1.de] INFO: Found listing with ID: EU37880
2026-03-30 07:47:20 [auto1.de] INFO: Found listing with ID: CD36674
2026-03-30 07:47:20 [auto1.de] INFO: Found listing with ID: UM48488
2026-03-30 07:47:20 [auto1.de] INFO: Found listing with ID: MP89368
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP89368%27 HTTP/1.1" 200 None
2026-03-30 07:47:20 [auto1.de] INFO: Scrape type for MP89368: 2
2026-03-30 07:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9928227b-849f-5218-9fd2-fe114578665d with identifier: MP89368
2026-03-30 07:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9928227b-849f-5218-9fd2-fe114578665d with scrape type 2
2026-03-30 07:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9928227b-849f-5218-9fd2-fe114578665d with scrape type 2
2026-03-30 07:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9928227b-849f-5218-9fd2-fe114578665d, identifier: MP89368
2026-03-30 07:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9928227b-849f-5218-9fd2-fe114578665d with identifier: MP89368
2026-03-30 07:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9928227b-849f-5218-9fd2-fe114578665d with identifier: MP89368
2026-03-30 07:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9928227b-849f-5218-9fd2-fe114578665d with identifier: MP89368 to the API
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:26:03Z',
 'fuel_type': 'diesel',
 'id': '9928227b-849f-5218-9fd2-fe114578665d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP89368',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 200302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-02',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2014}
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP89368%27 HTTP/1.1" 200 None
2026-03-30 07:47:20 [auto1.de] INFO: Saving data for MP89368: {'auction_closing_time': 1774884363.0, 'created_time': 1774550966.131932, 'last_price_update_time': 1774856840.633038}
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP89368') HTTP/1.1" 204 0
2026-03-30 07:47:20 [auto1.de] INFO: Found listing with ID: FX08537
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX08537%27 HTTP/1.1" 200 None
2026-03-30 07:47:20 [auto1.de] INFO: Scrape type for FX08537: 0
2026-03-30 07:47:20 [auto1.de] INFO: Found listing with ID: PV26171
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV26171%27 HTTP/1.1" 200 None
2026-03-30 07:47:20 [auto1.de] INFO: Scrape type for PV26171: 2
2026-03-30 07:47:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 866d85c3-7362-5325-83f6-6fc13362cb54 with identifier: PV26171
2026-03-30 07:47:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 866d85c3-7362-5325-83f6-6fc13362cb54 with scrape type 2
2026-03-30 07:47:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 866d85c3-7362-5325-83f6-6fc13362cb54 with scrape type 2
2026-03-30 07:47:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 866d85c3-7362-5325-83f6-6fc13362cb54, identifier: PV26171
2026-03-30 07:47:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 866d85c3-7362-5325-83f6-6fc13362cb54 with identifier: PV26171
2026-03-30 07:47:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 866d85c3-7362-5325-83f6-6fc13362cb54 with identifier: PV26171
2026-03-30 07:47:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 866d85c3-7362-5325-83f6-6fc13362cb54 with identifier: PV26171 to the API
2026-03-30 07:47:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:59:39Z',
 'fuel_type': 'diesel',
 'id': '866d85c3-7362-5325-83f6-6fc13362cb54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV26171',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 66442,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300 d Mild-Hybrid T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PV26171%27 HTTP/1.1" 200 None
2026-03-30 07:47:21 [auto1.de] INFO: Saving data for PV26171: {'auction_closing_time': 1774886379.0, 'created_time': 1774550124.712138, 'last_price_update_time': 1774856841.162926}
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PV26171') HTTP/1.1" 204 0
2026-03-30 07:47:21 [auto1.de] INFO: Found listing with ID: PB35717
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35717%27 HTTP/1.1" 200 None
2026-03-30 07:47:21 [auto1.de] INFO: Scrape type for PB35717: 2
2026-03-30 07:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f266ae4-16ca-58a1-9740-c8a8742325fd with identifier: PB35717
2026-03-30 07:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f266ae4-16ca-58a1-9740-c8a8742325fd with scrape type 2
2026-03-30 07:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f266ae4-16ca-58a1-9740-c8a8742325fd with scrape type 2
2026-03-30 07:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8f266ae4-16ca-58a1-9740-c8a8742325fd, identifier: PB35717
2026-03-30 07:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8f266ae4-16ca-58a1-9740-c8a8742325fd with identifier: PB35717
2026-03-30 07:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8f266ae4-16ca-58a1-9740-c8a8742325fd with identifier: PB35717
2026-03-30 07:47:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8f266ae4-16ca-58a1-9740-c8a8742325fd with identifier: PB35717 to the API
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:48:22Z',
 'fuel_type': 'diesel',
 'id': '8f266ae4-16ca-58a1-9740-c8a8742325fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB35717',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 175313,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-27',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB35717%27 HTTP/1.1" 200 None
2026-03-30 07:47:21 [auto1.de] INFO: Saving data for PB35717: {'auction_closing_time': 1774885702.0, 'created_time': 1774639492.13877, 'last_price_update_time': 1774856841.716614}
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB35717') HTTP/1.1" 204 0
2026-03-30 07:47:21 [auto1.de] INFO: Found listing with ID: SK54405
2026-03-30 07:47:21 [auto1.de] INFO: Found listing with ID: VB58565
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB58565%27 HTTP/1.1" 200 None
2026-03-30 07:47:21 [auto1.de] INFO: Scrape type for VB58565: 2
2026-03-30 07:47:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a712147c-97aa-5052-94f9-b93d90edf49b with identifier: VB58565
2026-03-30 07:47:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a712147c-97aa-5052-94f9-b93d90edf49b with scrape type 2
2026-03-30 07:47:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a712147c-97aa-5052-94f9-b93d90edf49b with scrape type 2
2026-03-30 07:47:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a712147c-97aa-5052-94f9-b93d90edf49b, identifier: VB58565
2026-03-30 07:47:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a712147c-97aa-5052-94f9-b93d90edf49b with identifier: VB58565
2026-03-30 07:47:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a712147c-97aa-5052-94f9-b93d90edf49b with identifier: VB58565
2026-03-30 07:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a712147c-97aa-5052-94f9-b93d90edf49b with identifier: VB58565 to the API
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:22:07Z',
 'fuel_type': 'diesel',
 'id': 'a712147c-97aa-5052-94f9-b93d90edf49b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB58565',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 208676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-15',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB58565%27 HTTP/1.1" 200 None
2026-03-30 07:47:22 [auto1.de] INFO: Saving data for VB58565: {'auction_closing_time': 1774884127.0, 'created_time': 1773946710.554615, 'last_price_update_time': 1774856842.190624}
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB58565') HTTP/1.1" 204 0
2026-03-30 07:47:22 [auto1.de] INFO: Found listing with ID: RW84791
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RW84791%27 HTTP/1.1" 200 None
2026-03-30 07:47:22 [auto1.de] INFO: Scrape type for RW84791: 0
2026-03-30 07:47:22 [auto1.de] INFO: Found listing with ID: NW62126
2026-03-30 07:47:22 [auto1.de] INFO: Found listing with ID: JG35044
2026-03-30 07:47:22 [auto1.de] INFO: Found listing with ID: EK27182
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK27182%27 HTTP/1.1" 200 None
2026-03-30 07:47:22 [auto1.de] INFO: Scrape type for EK27182: 2
2026-03-30 07:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with identifier: EK27182
2026-03-30 07:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with scrape type 2
2026-03-30 07:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with scrape type 2
2026-03-30 07:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91, identifier: EK27182
2026-03-30 07:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with identifier: EK27182
2026-03-30 07:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with identifier: EK27182
2026-03-30 07:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91 with identifier: EK27182 to the API
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:14Z',
 'fuel_type': 'diesel',
 'id': '8a9ed9bf-e3de-55e9-9e85-cad18b0d8a91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK27182',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 183913,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-15',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2012}
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK27182%27 HTTP/1.1" 200 None
2026-03-30 07:47:22 [auto1.de] INFO: Saving data for EK27182: {'auction_closing_time': 1774883054.0, 'created_time': 1774436944.480799, 'last_price_update_time': 1774856842.625246}
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EK27182') HTTP/1.1" 204 0
2026-03-30 07:47:22 [auto1.de] INFO: Found listing with ID: ZJ06184
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ06184%27 HTTP/1.1" 200 None
2026-03-30 07:47:22 [auto1.de] INFO: Scrape type for ZJ06184: 0
2026-03-30 07:47:22 [auto1.de] INFO: Found listing with ID: BW05751
2026-03-30 07:47:22 [auto1.de] INFO: Found listing with ID: BU48960
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU48960%27 HTTP/1.1" 200 None
2026-03-30 07:47:22 [auto1.de] INFO: Scrape type for BU48960: 0
2026-03-30 07:47:22 [auto1.de] INFO: Found listing with ID: MT90802
2026-03-30 07:47:22 [auto1.de] INFO: Found listing with ID: NL59666
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL59666%27 HTTP/1.1" 200 None
2026-03-30 07:47:22 [auto1.de] INFO: Scrape type for NL59666: 0
2026-03-30 07:47:22 [auto1.de] INFO: Found listing with ID: MS67551
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS67551%27 HTTP/1.1" 200 None
2026-03-30 07:47:22 [auto1.de] INFO: Scrape type for MS67551: 2
2026-03-30 07:47:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a894b69c-940a-54fd-9225-c58704e7566e with identifier: MS67551
2026-03-30 07:47:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a894b69c-940a-54fd-9225-c58704e7566e with scrape type 2
2026-03-30 07:47:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a894b69c-940a-54fd-9225-c58704e7566e with scrape type 2
2026-03-30 07:47:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a894b69c-940a-54fd-9225-c58704e7566e, identifier: MS67551
2026-03-30 07:47:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a894b69c-940a-54fd-9225-c58704e7566e with identifier: MS67551
2026-03-30 07:47:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a894b69c-940a-54fd-9225-c58704e7566e with identifier: MS67551
2026-03-30 07:47:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a894b69c-940a-54fd-9225-c58704e7566e with identifier: MS67551 to the API
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:02:47Z',
 'fuel_type': 'diesel',
 'id': 'a894b69c-940a-54fd-9225-c58704e7566e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS67551',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 276663,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-22',
 'seller_name': None,
 'title': 'Opel Astra 1.7 CDTI Edition "111 Jahre"',
 'transmission': 'manual',
 'trim': 'Edition "111 Jahre"',
 'year': 2010}
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS67551%27 HTTP/1.1" 200 None
2026-03-30 07:47:23 [auto1.de] INFO: Saving data for MS67551: {'auction_closing_time': 1774882967.0, 'created_time': 1774640033.676636, 'last_price_update_time': 1774856843.102228}
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS67551') HTTP/1.1" 204 0
2026-03-30 07:47:23 [auto1.de] INFO: Found listing with ID: ZW20696
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW20696%27 HTTP/1.1" 200 None
2026-03-30 07:47:23 [auto1.de] INFO: Scrape type for ZW20696: 2
2026-03-30 07:47:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8974f458-cf1c-59eb-97d7-73634030c341 with identifier: ZW20696
2026-03-30 07:47:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8974f458-cf1c-59eb-97d7-73634030c341 with scrape type 2
2026-03-30 07:47:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8974f458-cf1c-59eb-97d7-73634030c341 with scrape type 2
2026-03-30 07:47:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8974f458-cf1c-59eb-97d7-73634030c341, identifier: ZW20696
2026-03-30 07:47:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8974f458-cf1c-59eb-97d7-73634030c341 with identifier: ZW20696
2026-03-30 07:47:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8974f458-cf1c-59eb-97d7-73634030c341 with identifier: ZW20696
2026-03-30 07:47:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8974f458-cf1c-59eb-97d7-73634030c341 with identifier: ZW20696 to the API
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:55Z',
 'fuel_type': 'diesel',
 'id': '8974f458-cf1c-59eb-97d7-73634030c341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW20696',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 129143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-26',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2016}
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW20696%27 HTTP/1.1" 200 None
2026-03-30 07:47:23 [auto1.de] INFO: Saving data for ZW20696: {'auction_closing_time': 1774883035.0, 'created_time': 1774639397.36131, 'last_price_update_time': 1774856843.628121}
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW20696') HTTP/1.1" 204 0
2026-03-30 07:47:23 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-30 07:47:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:29 [auto1.de] INFO: Channel: 24h | Page: 135 | totalHits: 8394 | hits on page: 40
2026-03-30 07:47:29 [auto1.de] INFO: Found listing with ID: XG94093
2026-03-30 07:47:29 [auto1.de] INFO: Found listing with ID: ZV40367
2026-03-30 07:47:29 [auto1.de] INFO: Found listing with ID: RP15707
2026-03-30 07:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15707%27 HTTP/1.1" 200 None
2026-03-30 07:47:29 [auto1.de] INFO: Scrape type for RP15707: 2
2026-03-30 07:47:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2421f8c1-4d0a-57bb-8367-c7161aa35c99 with identifier: RP15707
2026-03-30 07:47:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2421f8c1-4d0a-57bb-8367-c7161aa35c99 with scrape type 2
2026-03-30 07:47:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2421f8c1-4d0a-57bb-8367-c7161aa35c99 with scrape type 2
2026-03-30 07:47:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2421f8c1-4d0a-57bb-8367-c7161aa35c99, identifier: RP15707
2026-03-30 07:47:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2421f8c1-4d0a-57bb-8367-c7161aa35c99 with identifier: RP15707
2026-03-30 07:47:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2421f8c1-4d0a-57bb-8367-c7161aa35c99 with identifier: RP15707
2026-03-30 07:47:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2421f8c1-4d0a-57bb-8367-c7161aa35c99 with identifier: RP15707 to the API
2026-03-30 07:47:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 151,
 'expiration_date': '2026-03-30T15:53:46Z',
 'fuel_type': 'petrol',
 'id': '2421f8c1-4d0a-57bb-8367-c7161aa35c99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP15707',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 48706,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-06',
 'seller_name': None,
 'title': 'Fiat 500X 1.3 Turbo Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP15707%27 HTTP/1.1" 200 None
2026-03-30 07:47:30 [auto1.de] INFO: Saving data for RP15707: {'auction_closing_time': 1774886026.0, 'created_time': 1774350295.737172, 'last_price_update_time': 1774856850.01817}
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP15707') HTTP/1.1" 204 0
2026-03-30 07:47:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:30 [auto1.de] INFO: Found listing with ID: UY58997
2026-03-30 07:47:30 [auto1.de] INFO: Found listing with ID: SF33056
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF33056%27 HTTP/1.1" 200 None
2026-03-30 07:47:30 [auto1.de] INFO: Scrape type for SF33056: 0
2026-03-30 07:47:30 [auto1.de] INFO: Found listing with ID: ZV16812
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV16812%27 HTTP/1.1" 200 None
2026-03-30 07:47:30 [auto1.de] INFO: Scrape type for ZV16812: 0
2026-03-30 07:47:30 [auto1.de] INFO: Found listing with ID: SY19126
2026-03-30 07:47:30 [auto1.de] INFO: Found listing with ID: CR33136
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR33136%27 HTTP/1.1" 200 None
2026-03-30 07:47:30 [auto1.de] INFO: Scrape type for CR33136: 2
2026-03-30 07:47:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1852cec3-0e84-51a9-816f-c6c9366418c6 with identifier: CR33136
2026-03-30 07:47:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1852cec3-0e84-51a9-816f-c6c9366418c6 with scrape type 2
2026-03-30 07:47:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1852cec3-0e84-51a9-816f-c6c9366418c6 with scrape type 2
2026-03-30 07:47:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1852cec3-0e84-51a9-816f-c6c9366418c6, identifier: CR33136
2026-03-30 07:47:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1852cec3-0e84-51a9-816f-c6c9366418c6 with identifier: CR33136
2026-03-30 07:47:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1852cec3-0e84-51a9-816f-c6c9366418c6 with identifier: CR33136
2026-03-30 07:47:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1852cec3-0e84-51a9-816f-c6c9366418c6 with identifier: CR33136 to the API
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:19:45Z',
 'fuel_type': 'petrol',
 'id': '1852cec3-0e84-51a9-816f-c6c9366418c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR33136',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 100353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-11',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR33136%27 HTTP/1.1" 200 None
2026-03-30 07:47:30 [auto1.de] INFO: Saving data for CR33136: {'auction_closing_time': 1774883985.0, 'created_time': 1774638547.14593, 'last_price_update_time': 1774856850.960144}
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CR33136') HTTP/1.1" 204 0
2026-03-30 07:47:30 [auto1.de] INFO: Found listing with ID: CE31107
2026-03-30 07:47:30 [auto1.de] INFO: Found listing with ID: BN03285
2026-03-30 07:47:30 [auto1.de] INFO: Found listing with ID: TH26087
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH26087%27 HTTP/1.1" 200 None
2026-03-30 07:47:30 [auto1.de] INFO: Scrape type for TH26087: 0
2026-03-30 07:47:30 [auto1.de] INFO: Found listing with ID: FB95771
2026-03-30 07:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB95771%27 HTTP/1.1" 200 None
2026-03-30 07:47:31 [auto1.de] INFO: Scrape type for FB95771: 2
2026-03-30 07:47:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9cc4e01d-8a44-5e10-b750-3a0ae7d04b98 with identifier: FB95771
2026-03-30 07:47:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9cc4e01d-8a44-5e10-b750-3a0ae7d04b98 with scrape type 2
2026-03-30 07:47:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9cc4e01d-8a44-5e10-b750-3a0ae7d04b98 with scrape type 2
2026-03-30 07:47:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9cc4e01d-8a44-5e10-b750-3a0ae7d04b98, identifier: FB95771
2026-03-30 07:47:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9cc4e01d-8a44-5e10-b750-3a0ae7d04b98 with identifier: FB95771
2026-03-30 07:47:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9cc4e01d-8a44-5e10-b750-3a0ae7d04b98 with identifier: FB95771
2026-03-30 07:47:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9cc4e01d-8a44-5e10-b750-3a0ae7d04b98 with identifier: FB95771 to the API
2026-03-30 07:47:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:14Z',
 'fuel_type': 'petrol',
 'id': '9cc4e01d-8a44-5e10-b750-3a0ae7d04b98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB95771',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 89379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': None,
 'title': 'BMW 1er 116i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2018}
2026-03-30 07:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB95771%27 HTTP/1.1" 200 None
2026-03-30 07:47:31 [auto1.de] INFO: Saving data for FB95771: {'auction_closing_time': 1774885454.0, 'created_time': 1774550126.9387, 'last_price_update_time': 1774856851.92517}
2026-03-30 07:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB95771') HTTP/1.1" 204 0
2026-03-30 07:47:32 [auto1.de] INFO: Found listing with ID: EB29224
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB29224%27 HTTP/1.1" 200 None
2026-03-30 07:47:32 [auto1.de] INFO: Scrape type for EB29224: 2
2026-03-30 07:47:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05775e78-cdd6-5b99-864d-8d9abe4c16ff with identifier: EB29224
2026-03-30 07:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05775e78-cdd6-5b99-864d-8d9abe4c16ff with scrape type 2
2026-03-30 07:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05775e78-cdd6-5b99-864d-8d9abe4c16ff with scrape type 2
2026-03-30 07:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 05775e78-cdd6-5b99-864d-8d9abe4c16ff, identifier: EB29224
2026-03-30 07:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 05775e78-cdd6-5b99-864d-8d9abe4c16ff with identifier: EB29224
2026-03-30 07:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 05775e78-cdd6-5b99-864d-8d9abe4c16ff with identifier: EB29224
2026-03-30 07:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 05775e78-cdd6-5b99-864d-8d9abe4c16ff with identifier: EB29224 to the API
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:58:34Z',
 'fuel_type': 'petrol',
 'id': '05775e78-cdd6-5b99-864d-8d9abe4c16ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB29224',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 179586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-17',
 'seller_name': None,
 'title': "Kia cee'd 1.4 Dream Team",
 'transmission': 'manual',
 'trim': 'Dream Team',
 'year': 2013}
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB29224%27 HTTP/1.1" 200 None
2026-03-30 07:47:32 [auto1.de] INFO: Saving data for EB29224: {'auction_closing_time': 1774886314.0, 'created_time': 1774637202.237816, 'last_price_update_time': 1774856852.496261}
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB29224') HTTP/1.1" 204 0
2026-03-30 07:47:32 [auto1.de] INFO: Found listing with ID: MM04684
2026-03-30 07:47:32 [auto1.de] INFO: Found listing with ID: SZ04450
2026-03-30 07:47:32 [auto1.de] INFO: Found listing with ID: KT29520
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KT29520%27 HTTP/1.1" 200 None
2026-03-30 07:47:32 [auto1.de] INFO: Scrape type for KT29520: 0
2026-03-30 07:47:32 [auto1.de] INFO: Found listing with ID: VU07666
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU07666%27 HTTP/1.1" 200 None
2026-03-30 07:47:32 [auto1.de] INFO: Scrape type for VU07666: 0
2026-03-30 07:47:32 [auto1.de] INFO: Found listing with ID: UD17125
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17125%27 HTTP/1.1" 200 None
2026-03-30 07:47:32 [auto1.de] INFO: Scrape type for UD17125: 2
2026-03-30 07:47:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa076a01-1f6b-5721-a922-dcac0d043476 with identifier: UD17125
2026-03-30 07:47:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa076a01-1f6b-5721-a922-dcac0d043476 with scrape type 2
2026-03-30 07:47:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa076a01-1f6b-5721-a922-dcac0d043476 with scrape type 2
2026-03-30 07:47:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aa076a01-1f6b-5721-a922-dcac0d043476, identifier: UD17125
2026-03-30 07:47:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aa076a01-1f6b-5721-a922-dcac0d043476 with identifier: UD17125
2026-03-30 07:47:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aa076a01-1f6b-5721-a922-dcac0d043476 with identifier: UD17125
2026-03-30 07:47:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aa076a01-1f6b-5721-a922-dcac0d043476 with identifier: UD17125 to the API
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:03:50Z',
 'fuel_type': 'petrol',
 'id': 'aa076a01-1f6b-5721-a922-dcac0d043476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD17125',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 61041,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-13',
 'seller_name': None,
 'title': 'BMW 1er 118i Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2017}
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17125%27 HTTP/1.1" 200 None
2026-03-30 07:47:33 [auto1.de] INFO: Saving data for UD17125: {'auction_closing_time': 1774883030.0, 'created_time': 1773132462.831862, 'last_price_update_time': 1774856853.014312}
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UD17125') HTTP/1.1" 204 0
2026-03-30 07:47:33 [auto1.de] INFO: Found listing with ID: KG96622
2026-03-30 07:47:33 [auto1.de] INFO: Found listing with ID: EZ36931
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ36931%27 HTTP/1.1" 200 None
2026-03-30 07:47:33 [auto1.de] INFO: Scrape type for EZ36931: 0
2026-03-30 07:47:33 [auto1.de] INFO: Found listing with ID: JZ27200
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ27200%27 HTTP/1.1" 200 None
2026-03-30 07:47:33 [auto1.de] INFO: Scrape type for JZ27200: 0
2026-03-30 07:47:33 [auto1.de] INFO: Found listing with ID: FN92851
2026-03-30 07:47:33 [auto1.de] INFO: Found listing with ID: RD90003
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD90003%27 HTTP/1.1" 200 None
2026-03-30 07:47:33 [auto1.de] INFO: Scrape type for RD90003: 0
2026-03-30 07:47:33 [auto1.de] INFO: Found listing with ID: HF47887
2026-03-30 07:47:33 [auto1.de] INFO: Found listing with ID: UA79270
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA79270%27 HTTP/1.1" 200 None
2026-03-30 07:47:33 [auto1.de] INFO: Scrape type for UA79270: 2
2026-03-30 07:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d1e72dd-387d-5d84-a3db-49e5c4f6db6c with identifier: UA79270
2026-03-30 07:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d1e72dd-387d-5d84-a3db-49e5c4f6db6c with scrape type 2
2026-03-30 07:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d1e72dd-387d-5d84-a3db-49e5c4f6db6c with scrape type 2
2026-03-30 07:47:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d1e72dd-387d-5d84-a3db-49e5c4f6db6c, identifier: UA79270
2026-03-30 07:47:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d1e72dd-387d-5d84-a3db-49e5c4f6db6c with identifier: UA79270
2026-03-30 07:47:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d1e72dd-387d-5d84-a3db-49e5c4f6db6c with identifier: UA79270
2026-03-30 07:47:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d1e72dd-387d-5d84-a3db-49e5c4f6db6c with identifier: UA79270 to the API
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:48:56Z',
 'fuel_type': 'petrol',
 'id': '3d1e72dd-387d-5d84-a3db-49e5c4f6db6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA79270',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 184047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-26',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA79270%27 HTTP/1.1" 200 None
2026-03-30 07:47:33 [auto1.de] INFO: Saving data for UA79270: {'auction_closing_time': 1774885736.0, 'created_time': 1773831288.94491, 'last_price_update_time': 1774856853.841585}
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA79270') HTTP/1.1" 204 0
2026-03-30 07:47:33 [auto1.de] INFO: Found listing with ID: EN47046
2026-03-30 07:47:33 [auto1.de] INFO: Found listing with ID: NS17316
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17316%27 HTTP/1.1" 200 None
2026-03-30 07:47:33 [auto1.de] INFO: Scrape type for NS17316: 2
2026-03-30 07:47:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddc4985d-3eef-59d4-8be5-6d12306f1e94 with identifier: NS17316
2026-03-30 07:47:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddc4985d-3eef-59d4-8be5-6d12306f1e94 with scrape type 2
2026-03-30 07:47:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddc4985d-3eef-59d4-8be5-6d12306f1e94 with scrape type 2
2026-03-30 07:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ddc4985d-3eef-59d4-8be5-6d12306f1e94, identifier: NS17316
2026-03-30 07:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ddc4985d-3eef-59d4-8be5-6d12306f1e94 with identifier: NS17316
2026-03-30 07:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ddc4985d-3eef-59d4-8be5-6d12306f1e94 with identifier: NS17316
2026-03-30 07:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ddc4985d-3eef-59d4-8be5-6d12306f1e94 with identifier: NS17316 to the API
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:26:09Z',
 'fuel_type': 'diesel',
 'id': 'ddc4985d-3eef-59d4-8be5-6d12306f1e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS17316',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 147594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-03',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 CRDi Vision 4WD',
 'transmission': 'automatic',
 'trim': 'Vision 4WD',
 'year': 2017}
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS17316%27 HTTP/1.1" 200 None
2026-03-30 07:47:34 [auto1.de] INFO: Saving data for NS17316: {'auction_closing_time': 1774884369.0, 'created_time': 1774350072.42261, 'last_price_update_time': 1774856854.366305}
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS17316') HTTP/1.1" 204 0
2026-03-30 07:47:34 [auto1.de] INFO: Found listing with ID: CK62580
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CK62580%27 HTTP/1.1" 200 None
2026-03-30 07:47:34 [auto1.de] INFO: Scrape type for CK62580: 0
2026-03-30 07:47:34 [auto1.de] INFO: Found listing with ID: GA34239
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA34239%27 HTTP/1.1" 200 None
2026-03-30 07:47:34 [auto1.de] INFO: Scrape type for GA34239: 0
2026-03-30 07:47:34 [auto1.de] INFO: Found listing with ID: LS63557
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS63557%27 HTTP/1.1" 200 None
2026-03-30 07:47:34 [auto1.de] INFO: Scrape type for LS63557: 2
2026-03-30 07:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with identifier: LS63557
2026-03-30 07:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with scrape type 2
2026-03-30 07:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with scrape type 2
2026-03-30 07:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fe2c16f-59ab-534b-a26b-810dd8bc3a77, identifier: LS63557
2026-03-30 07:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with identifier: LS63557
2026-03-30 07:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with identifier: LS63557
2026-03-30 07:47:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fe2c16f-59ab-534b-a26b-810dd8bc3a77 with identifier: LS63557 to the API
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:22Z',
 'fuel_type': 'diesel',
 'id': '4fe2c16f-59ab-534b-a26b-810dd8bc3a77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LS63557',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 102470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-07',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2018}
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS63557%27 HTTP/1.1" 200 None
2026-03-30 07:47:34 [auto1.de] INFO: Saving data for LS63557: {'auction_closing_time': 1774885702.0, 'created_time': 1774550704.922733, 'last_price_update_time': 1774856854.842033}
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LS63557') HTTP/1.1" 204 0
2026-03-30 07:47:34 [auto1.de] INFO: Found listing with ID: WP78953
2026-03-30 07:47:34 [auto1.de] INFO: Found listing with ID: HT34266
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT34266%27 HTTP/1.1" 200 None
2026-03-30 07:47:34 [auto1.de] INFO: Scrape type for HT34266: 2
2026-03-30 07:47:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ccd67018-14e1-5590-b63c-dc03bfb4d13c with identifier: HT34266
2026-03-30 07:47:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ccd67018-14e1-5590-b63c-dc03bfb4d13c with scrape type 2
2026-03-30 07:47:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ccd67018-14e1-5590-b63c-dc03bfb4d13c with scrape type 2
2026-03-30 07:47:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ccd67018-14e1-5590-b63c-dc03bfb4d13c, identifier: HT34266
2026-03-30 07:47:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ccd67018-14e1-5590-b63c-dc03bfb4d13c with identifier: HT34266
2026-03-30 07:47:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ccd67018-14e1-5590-b63c-dc03bfb4d13c with identifier: HT34266
2026-03-30 07:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ccd67018-14e1-5590-b63c-dc03bfb4d13c with identifier: HT34266 to the API
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:04:42Z',
 'fuel_type': 'diesel',
 'id': 'ccd67018-14e1-5590-b63c-dc03bfb4d13c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT34266',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 197270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-08-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT34266%27 HTTP/1.1" 200 None
2026-03-30 07:47:35 [auto1.de] INFO: Saving data for HT34266: {'auction_closing_time': 1774883082.0, 'created_time': 1774551128.02563, 'last_price_update_time': 1774856855.252791}
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT34266') HTTP/1.1" 204 0
2026-03-30 07:47:35 [auto1.de] INFO: Found listing with ID: EH62859
2026-03-30 07:47:35 [auto1.de] INFO: Found listing with ID: ZJ71499
2026-03-30 07:47:35 [auto1.de] INFO: Found listing with ID: PR50786
2026-03-30 07:47:35 [auto1.de] INFO: Found listing with ID: ZU57618
2026-03-30 07:47:35 [auto1.de] INFO: Found listing with ID: RG74932
2026-03-30 07:47:35 [auto1.de] INFO: Found listing with ID: AS18464
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS18464%27 HTTP/1.1" 200 None
2026-03-30 07:47:35 [auto1.de] INFO: Scrape type for AS18464: 2
2026-03-30 07:47:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edabeeff-f959-564e-99c2-a382ccaeaa28 with identifier: AS18464
2026-03-30 07:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edabeeff-f959-564e-99c2-a382ccaeaa28 with scrape type 2
2026-03-30 07:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edabeeff-f959-564e-99c2-a382ccaeaa28 with scrape type 2
2026-03-30 07:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: edabeeff-f959-564e-99c2-a382ccaeaa28, identifier: AS18464
2026-03-30 07:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: edabeeff-f959-564e-99c2-a382ccaeaa28 with identifier: AS18464
2026-03-30 07:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: edabeeff-f959-564e-99c2-a382ccaeaa28 with identifier: AS18464
2026-03-30 07:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: edabeeff-f959-564e-99c2-a382ccaeaa28 with identifier: AS18464 to the API
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:08:34Z',
 'fuel_type': 'petrol',
 'id': 'edabeeff-f959-564e-99c2-a382ccaeaa28',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS18464',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 130193,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-23',
 'seller_name': None,
 'title': 'Peugeot 206 1.6 CC Filou',
 'transmission': 'manual',
 'trim': 'CC Filou',
 'year': 2005}
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS18464%27 HTTP/1.1" 200 None
2026-03-30 07:47:35 [auto1.de] INFO: Saving data for AS18464: {'auction_closing_time': 1774883314.0, 'created_time': 1774552905.342277, 'last_price_update_time': 1774856855.642527}
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AS18464') HTTP/1.1" 204 0
2026-03-30 07:47:35 [auto1.de] INFO: Found listing with ID: WE68456
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE68456%27 HTTP/1.1" 200 None
2026-03-30 07:47:35 [auto1.de] INFO: Scrape type for WE68456: 2
2026-03-30 07:47:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4ad961e-04ea-5888-a79b-91da2577c2b5 with identifier: WE68456
2026-03-30 07:47:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4ad961e-04ea-5888-a79b-91da2577c2b5 with scrape type 2
2026-03-30 07:47:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4ad961e-04ea-5888-a79b-91da2577c2b5 with scrape type 2
2026-03-30 07:47:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d4ad961e-04ea-5888-a79b-91da2577c2b5, identifier: WE68456
2026-03-30 07:47:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d4ad961e-04ea-5888-a79b-91da2577c2b5 with identifier: WE68456
2026-03-30 07:47:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d4ad961e-04ea-5888-a79b-91da2577c2b5 with identifier: WE68456
2026-03-30 07:47:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d4ad961e-04ea-5888-a79b-91da2577c2b5 with identifier: WE68456 to the API
2026-03-30 07:47:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:14:46Z',
 'fuel_type': 'petrol',
 'id': 'd4ad961e-04ea-5888-a79b-91da2577c2b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE68456',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 79867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-25',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2015}
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE68456%27 HTTP/1.1" 200 None
2026-03-30 07:47:36 [auto1.de] INFO: Saving data for WE68456: {'auction_closing_time': 1774883686.0, 'created_time': 1774638932.291679, 'last_price_update_time': 1774856856.150584}
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE68456') HTTP/1.1" 204 0
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: JH37191
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH37191%27 HTTP/1.1" 200 None
2026-03-30 07:47:36 [auto1.de] INFO: Scrape type for JH37191: 0
2026-03-30 07:47:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:36 [auto1.de] INFO: Channel: 24h | Page: 136 | totalHits: 8394 | hits on page: 40
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: MD24708
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD24708%27 HTTP/1.1" 200 None
2026-03-30 07:47:36 [auto1.de] INFO: Scrape type for MD24708: 0
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: LX45168
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: GD48947
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD48947%27 HTTP/1.1" 200 None
2026-03-30 07:47:36 [auto1.de] INFO: Scrape type for GD48947: 0
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: BX95848
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: DZ36531
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: MV67104
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: CF55359
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: GK88230
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: XM77164
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: SB93381
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB93381%27 HTTP/1.1" 200 None
2026-03-30 07:47:36 [auto1.de] INFO: Scrape type for SB93381: 0
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: UU73518
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: HD14897
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: ZL38204
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: ZY13516
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY13516%27 HTTP/1.1" 200 None
2026-03-30 07:47:36 [auto1.de] INFO: Scrape type for ZY13516: 0
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: UU35907
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: DZ93039
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: CJ15757
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: AG38936
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: XT91085
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: ZE67546
2026-03-30 07:47:36 [auto1.de] INFO: Found listing with ID: DF58718
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF58718%27 HTTP/1.1" 200 None
2026-03-30 07:47:36 [auto1.de] INFO: Scrape type for DF58718: 2
2026-03-30 07:47:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ac8dc20-aa50-5360-a8c9-1575857dde66 with identifier: DF58718
2026-03-30 07:47:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ac8dc20-aa50-5360-a8c9-1575857dde66 with scrape type 2
2026-03-30 07:47:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ac8dc20-aa50-5360-a8c9-1575857dde66 with scrape type 2
2026-03-30 07:47:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ac8dc20-aa50-5360-a8c9-1575857dde66, identifier: DF58718
2026-03-30 07:47:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ac8dc20-aa50-5360-a8c9-1575857dde66 with identifier: DF58718
2026-03-30 07:47:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ac8dc20-aa50-5360-a8c9-1575857dde66 with identifier: DF58718
2026-03-30 07:47:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ac8dc20-aa50-5360-a8c9-1575857dde66 with identifier: DF58718 to the API
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:04:52Z',
 'fuel_type': 'petrol',
 'id': '4ac8dc20-aa50-5360-a8c9-1575857dde66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF58718',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-06',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 250 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF58718%27 HTTP/1.1" 200 None
2026-03-30 07:47:36 [auto1.de] INFO: Saving data for DF58718: {'auction_closing_time': 1774883092.0, 'created_time': 1773305369.269059, 'last_price_update_time': 1774856856.891544}
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DF58718') HTTP/1.1" 204 0
2026-03-30 07:47:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:37 [auto1.de] INFO: Found listing with ID: DS04882
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS04882%27 HTTP/1.1" 200 None
2026-03-30 07:47:37 [auto1.de] INFO: Scrape type for DS04882: 2
2026-03-30 07:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b821b196-a546-508b-a282-569c391b672d with identifier: DS04882
2026-03-30 07:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b821b196-a546-508b-a282-569c391b672d with scrape type 2
2026-03-30 07:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b821b196-a546-508b-a282-569c391b672d with scrape type 2
2026-03-30 07:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b821b196-a546-508b-a282-569c391b672d, identifier: DS04882
2026-03-30 07:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b821b196-a546-508b-a282-569c391b672d with identifier: DS04882
2026-03-30 07:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b821b196-a546-508b-a282-569c391b672d with identifier: DS04882
2026-03-30 07:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b821b196-a546-508b-a282-569c391b672d with identifier: DS04882 to the API
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:55:22Z',
 'fuel_type': 'diesel',
 'id': 'b821b196-a546-508b-a282-569c391b672d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS04882',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 255700,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-26',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CDI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2010}
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS04882%27 HTTP/1.1" 200 None
2026-03-30 07:47:37 [auto1.de] INFO: Saving data for DS04882: {'auction_closing_time': 1774886122.0, 'created_time': 1774552901.578613, 'last_price_update_time': 1774856857.417843}
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS04882') HTTP/1.1" 204 0
2026-03-30 07:47:37 [auto1.de] INFO: Found listing with ID: PT06802
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT06802%27 HTTP/1.1" 200 None
2026-03-30 07:47:37 [auto1.de] INFO: Scrape type for PT06802: 0
2026-03-30 07:47:37 [auto1.de] INFO: Found listing with ID: VW18097
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW18097%27 HTTP/1.1" 200 None
2026-03-30 07:47:37 [auto1.de] INFO: Scrape type for VW18097: 2
2026-03-30 07:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d791a3be-bbc3-5aac-8000-37edd666f176 with identifier: VW18097
2026-03-30 07:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d791a3be-bbc3-5aac-8000-37edd666f176 with scrape type 2
2026-03-30 07:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d791a3be-bbc3-5aac-8000-37edd666f176 with scrape type 2
2026-03-30 07:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d791a3be-bbc3-5aac-8000-37edd666f176, identifier: VW18097
2026-03-30 07:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d791a3be-bbc3-5aac-8000-37edd666f176 with identifier: VW18097
2026-03-30 07:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d791a3be-bbc3-5aac-8000-37edd666f176 with identifier: VW18097
2026-03-30 07:47:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d791a3be-bbc3-5aac-8000-37edd666f176 with identifier: VW18097 to the API
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:56:54Z',
 'fuel_type': 'petrol',
 'id': 'd791a3be-bbc3-5aac-8000-37edd666f176',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW18097',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 209320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-13',
 'seller_name': None,
 'title': 'Audi A4 1.8 TFSI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW18097%27 HTTP/1.1" 200 None
2026-03-30 07:47:37 [auto1.de] INFO: Saving data for VW18097: {'auction_closing_time': 1774886214.0, 'created_time': 1774639503.874528, 'last_price_update_time': 1774856857.840045}
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW18097') HTTP/1.1" 204 0
2026-03-30 07:47:37 [auto1.de] INFO: Found listing with ID: GC08315
2026-03-30 07:47:37 [auto1.de] INFO: Found listing with ID: MJ66272
2026-03-30 07:47:37 [auto1.de] INFO: Found listing with ID: ND71699
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND71699%27 HTTP/1.1" 200 None
2026-03-30 07:47:37 [auto1.de] INFO: Scrape type for ND71699: 2
2026-03-30 07:47:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7644b2f4-949c-5042-a80c-94033c9ed8b9 with identifier: ND71699
2026-03-30 07:47:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7644b2f4-949c-5042-a80c-94033c9ed8b9 with scrape type 2
2026-03-30 07:47:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7644b2f4-949c-5042-a80c-94033c9ed8b9 with scrape type 2
2026-03-30 07:47:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7644b2f4-949c-5042-a80c-94033c9ed8b9, identifier: ND71699
2026-03-30 07:47:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7644b2f4-949c-5042-a80c-94033c9ed8b9 with identifier: ND71699
2026-03-30 07:47:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7644b2f4-949c-5042-a80c-94033c9ed8b9 with identifier: ND71699
2026-03-30 07:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7644b2f4-949c-5042-a80c-94033c9ed8b9 with identifier: ND71699 to the API
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:39:42Z',
 'fuel_type': 'petrol',
 'id': '7644b2f4-949c-5042-a80c-94033c9ed8b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND71699',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 70406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND71699%27 HTTP/1.1" 200 None
2026-03-30 07:47:38 [auto1.de] INFO: Saving data for ND71699: {'auction_closing_time': 1774885182.0, 'created_time': 1774639153.811765, 'last_price_update_time': 1774856858.259977}
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND71699') HTTP/1.1" 204 0
2026-03-30 07:47:38 [auto1.de] INFO: Found listing with ID: DN96798
2026-03-30 07:47:38 [auto1.de] INFO: Found listing with ID: XC89129
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC89129%27 HTTP/1.1" 200 None
2026-03-30 07:47:38 [auto1.de] INFO: Scrape type for XC89129: 2
2026-03-30 07:47:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0aa2ec45-3c42-5721-b77b-403627c36d29 with identifier: XC89129
2026-03-30 07:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0aa2ec45-3c42-5721-b77b-403627c36d29 with scrape type 2
2026-03-30 07:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0aa2ec45-3c42-5721-b77b-403627c36d29 with scrape type 2
2026-03-30 07:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0aa2ec45-3c42-5721-b77b-403627c36d29, identifier: XC89129
2026-03-30 07:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0aa2ec45-3c42-5721-b77b-403627c36d29 with identifier: XC89129
2026-03-30 07:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0aa2ec45-3c42-5721-b77b-403627c36d29 with identifier: XC89129
2026-03-30 07:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0aa2ec45-3c42-5721-b77b-403627c36d29 with identifier: XC89129 to the API
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:29:08Z',
 'fuel_type': 'hybrid',
 'id': '0aa2ec45-3c42-5721-b77b-403627c36d29',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC89129',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 74672,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-29',
 'seller_name': None,
 'title': 'BMW 3er 320e Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2022}
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC89129%27 HTTP/1.1" 200 None
2026-03-30 07:47:38 [auto1.de] INFO: Saving data for XC89129: {'auction_closing_time': 1774884548.0, 'created_time': 1774638689.235824, 'last_price_update_time': 1774856858.679511}
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC89129') HTTP/1.1" 204 0
2026-03-30 07:47:38 [auto1.de] INFO: Found listing with ID: DV32986
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV32986%27 HTTP/1.1" 200 None
2026-03-30 07:47:38 [auto1.de] INFO: Scrape type for DV32986: 0
2026-03-30 07:47:38 [auto1.de] INFO: Found listing with ID: XF58855
2026-03-30 07:47:38 [auto1.de] INFO: Found listing with ID: YR51740
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR51740%27 HTTP/1.1" 200 None
2026-03-30 07:47:38 [auto1.de] INFO: Scrape type for YR51740: 2
2026-03-30 07:47:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75a69d2a-493e-5784-a93c-1f831c7d1290 with identifier: YR51740
2026-03-30 07:47:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75a69d2a-493e-5784-a93c-1f831c7d1290 with scrape type 2
2026-03-30 07:47:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75a69d2a-493e-5784-a93c-1f831c7d1290 with scrape type 2
2026-03-30 07:47:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75a69d2a-493e-5784-a93c-1f831c7d1290, identifier: YR51740
2026-03-30 07:47:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75a69d2a-493e-5784-a93c-1f831c7d1290 with identifier: YR51740
2026-03-30 07:47:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75a69d2a-493e-5784-a93c-1f831c7d1290 with identifier: YR51740
2026-03-30 07:47:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75a69d2a-493e-5784-a93c-1f831c7d1290 with identifier: YR51740 to the API
2026-03-30 07:47:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 52,
 'expiration_date': '2026-03-30T15:04:06Z',
 'fuel_type': 'petrol',
 'id': '75a69d2a-493e-5784-a93c-1f831c7d1290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR51740',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Matiz',
 'odometer': 92570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-22',
 'seller_name': None,
 'title': 'Chevrolet Matiz 0.8 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2010}
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR51740%27 HTTP/1.1" 200 None
2026-03-30 07:47:39 [auto1.de] INFO: Saving data for YR51740: {'auction_closing_time': 1774883046.0, 'created_time': 1774639104.86846, 'last_price_update_time': 1774856859.153114}
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR51740') HTTP/1.1" 204 0
2026-03-30 07:47:39 [auto1.de] INFO: Found listing with ID: ZX08266
2026-03-30 07:47:39 [auto1.de] INFO: Found listing with ID: DA14400
2026-03-30 07:47:39 [auto1.de] INFO: Found listing with ID: DK33698
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33698%27 HTTP/1.1" 200 None
2026-03-30 07:47:39 [auto1.de] INFO: Scrape type for DK33698: 2
2026-03-30 07:47:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da916fca-db24-5d3d-96bf-44deaeab1f0a with identifier: DK33698
2026-03-30 07:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da916fca-db24-5d3d-96bf-44deaeab1f0a with scrape type 2
2026-03-30 07:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item da916fca-db24-5d3d-96bf-44deaeab1f0a with scrape type 2
2026-03-30 07:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: da916fca-db24-5d3d-96bf-44deaeab1f0a, identifier: DK33698
2026-03-30 07:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: da916fca-db24-5d3d-96bf-44deaeab1f0a with identifier: DK33698
2026-03-30 07:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: da916fca-db24-5d3d-96bf-44deaeab1f0a with identifier: DK33698
2026-03-30 07:47:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: da916fca-db24-5d3d-96bf-44deaeab1f0a with identifier: DK33698 to the API
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:31:36Z',
 'fuel_type': 'petrol',
 'id': 'da916fca-db24-5d3d-96bf-44deaeab1f0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK33698',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 285134,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-30',
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.4 MIVEC Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'Instyle 4WD',
 'year': 2011}
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK33698%27 HTTP/1.1" 200 None
2026-03-30 07:47:39 [auto1.de] INFO: Saving data for DK33698: {'auction_closing_time': 1774884696.0, 'created_time': 1774551850.082415, 'last_price_update_time': 1774856859.667346}
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DK33698') HTTP/1.1" 204 0
2026-03-30 07:47:39 [auto1.de] INFO: Found listing with ID: WA63684
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA63684%27 HTTP/1.1" 200 None
2026-03-30 07:47:39 [auto1.de] INFO: Scrape type for WA63684: 2
2026-03-30 07:47:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2f8fcdc-b2da-5c8c-95c5-bd6fb210debf with identifier: WA63684
2026-03-30 07:47:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f8fcdc-b2da-5c8c-95c5-bd6fb210debf with scrape type 2
2026-03-30 07:47:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2f8fcdc-b2da-5c8c-95c5-bd6fb210debf with scrape type 2
2026-03-30 07:47:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2f8fcdc-b2da-5c8c-95c5-bd6fb210debf, identifier: WA63684
2026-03-30 07:47:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2f8fcdc-b2da-5c8c-95c5-bd6fb210debf with identifier: WA63684
2026-03-30 07:47:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2f8fcdc-b2da-5c8c-95c5-bd6fb210debf with identifier: WA63684
2026-03-30 07:47:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2f8fcdc-b2da-5c8c-95c5-bd6fb210debf with identifier: WA63684 to the API
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:44:11Z',
 'fuel_type': 'petrol',
 'id': 'a2f8fcdc-b2da-5c8c-95c5-bd6fb210debf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA63684',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 52927,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 35 TFSI ACT S line',
 'transmission': 'manual',
 'trim': 'ACT S line',
 'year': 2021}
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA63684%27 HTTP/1.1" 200 None
2026-03-30 07:47:40 [auto1.de] INFO: Saving data for WA63684: {'auction_closing_time': 1774885451.0, 'created_time': 1774035484.691717, 'last_price_update_time': 1774856860.074621}
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WA63684') HTTP/1.1" 204 0
2026-03-30 07:47:40 [auto1.de] INFO: Found listing with ID: BW69940
2026-03-30 07:47:40 [auto1.de] INFO: Found listing with ID: HK34206
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK34206%27 HTTP/1.1" 200 None
2026-03-30 07:47:40 [auto1.de] INFO: Scrape type for HK34206: 2
2026-03-30 07:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with identifier: HK34206
2026-03-30 07:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with scrape type 2
2026-03-30 07:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with scrape type 2
2026-03-30 07:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19, identifier: HK34206
2026-03-30 07:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with identifier: HK34206
2026-03-30 07:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with identifier: HK34206
2026-03-30 07:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d143d77-a736-5d72-b1d1-ae6a2a4c3f19 with identifier: HK34206 to the API
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:14:17Z',
 'fuel_type': 'petrol',
 'id': '3d143d77-a736-5d72-b1d1-ae6a2a4c3f19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK34206',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 77013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-12-06',
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 1998}
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK34206%27 HTTP/1.1" 200 None
2026-03-30 07:47:40 [auto1.de] INFO: Saving data for HK34206: {'auction_closing_time': 1774883657.0, 'created_time': 1774550625.237234, 'last_price_update_time': 1774856860.52655}
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HK34206') HTTP/1.1" 204 0
2026-03-30 07:47:40 [auto1.de] INFO: Found listing with ID: BX53792
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX53792%27 HTTP/1.1" 200 None
2026-03-30 07:47:40 [auto1.de] INFO: Scrape type for BX53792: 0
2026-03-30 07:47:40 [auto1.de] INFO: Found listing with ID: JT26189
2026-03-30 07:47:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:40 [auto1.de] INFO: Channel: 24h | Page: 137 | totalHits: 8394 | hits on page: 40
2026-03-30 07:47:40 [auto1.de] INFO: Found listing with ID: AR87592
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR87592%27 HTTP/1.1" 200 None
2026-03-30 07:47:40 [auto1.de] INFO: Scrape type for AR87592: 2
2026-03-30 07:47:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44576285-94c9-5357-a321-787700829e66 with identifier: AR87592
2026-03-30 07:47:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44576285-94c9-5357-a321-787700829e66 with scrape type 2
2026-03-30 07:47:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44576285-94c9-5357-a321-787700829e66 with scrape type 2
2026-03-30 07:47:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44576285-94c9-5357-a321-787700829e66, identifier: AR87592
2026-03-30 07:47:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44576285-94c9-5357-a321-787700829e66 with identifier: AR87592
2026-03-30 07:47:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44576285-94c9-5357-a321-787700829e66 with identifier: AR87592
2026-03-30 07:47:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44576285-94c9-5357-a321-787700829e66 with identifier: AR87592 to the API
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 351,
 'expiration_date': '2026-03-30T15:32:04Z',
 'fuel_type': 'diesel',
 'id': '44576285-94c9-5357-a321-787700829e66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR87592',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 89701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-22',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40d Mild-Hybrid M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2021}
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR87592%27 HTTP/1.1" 200 None
2026-03-30 07:47:41 [auto1.de] INFO: Saving data for AR87592: {'auction_closing_time': 1774884724.0, 'created_time': 1774639267.77653, 'last_price_update_time': 1774856861.048492}
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AR87592') HTTP/1.1" 204 0
2026-03-30 07:47:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: YW88691
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: FS76993
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS76993%27 HTTP/1.1" 200 None
2026-03-30 07:47:41 [auto1.de] INFO: Scrape type for FS76993: 0
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: RS40485
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS40485%27 HTTP/1.1" 200 None
2026-03-30 07:47:41 [auto1.de] INFO: Scrape type for RS40485: 0
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: PN31203
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: FS96919
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS96919%27 HTTP/1.1" 200 None
2026-03-30 07:47:41 [auto1.de] INFO: Scrape type for FS96919: 0
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: BF85943
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: GL29302
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: MK56575
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56575%27 HTTP/1.1" 200 None
2026-03-30 07:47:41 [auto1.de] INFO: Scrape type for MK56575: 0
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: LM46602
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: YH44518
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: SD35692
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD35692%27 HTTP/1.1" 200 None
2026-03-30 07:47:41 [auto1.de] INFO: Scrape type for SD35692: 2
2026-03-30 07:47:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92effc51-2cae-5f57-bc01-95a1522757dd with identifier: SD35692
2026-03-30 07:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92effc51-2cae-5f57-bc01-95a1522757dd with scrape type 2
2026-03-30 07:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92effc51-2cae-5f57-bc01-95a1522757dd with scrape type 2
2026-03-30 07:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92effc51-2cae-5f57-bc01-95a1522757dd, identifier: SD35692
2026-03-30 07:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92effc51-2cae-5f57-bc01-95a1522757dd with identifier: SD35692
2026-03-30 07:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92effc51-2cae-5f57-bc01-95a1522757dd with identifier: SD35692
2026-03-30 07:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92effc51-2cae-5f57-bc01-95a1522757dd with identifier: SD35692 to the API
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:46:21Z',
 'fuel_type': 'petrol',
 'id': '92effc51-2cae-5f57-bc01-95a1522757dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD35692',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 78233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-31',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Sendo 2WD',
 'transmission': 'manual',
 'trim': 'Sendo 2WD',
 'year': 2014}
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD35692%27 HTTP/1.1" 200 None
2026-03-30 07:47:41 [auto1.de] INFO: Saving data for SD35692: {'auction_closing_time': 1774885581.0, 'created_time': 1774550687.251769, 'last_price_update_time': 1774856861.54709}
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SD35692') HTTP/1.1" 204 0
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: VY57936
2026-03-30 07:47:41 [auto1.de] INFO: Found listing with ID: EA77246
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA77246%27 HTTP/1.1" 200 None
2026-03-30 07:47:41 [auto1.de] INFO: Scrape type for EA77246: 2
2026-03-30 07:47:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f494d46-eb77-5a45-be61-7ba37633c437 with identifier: EA77246
2026-03-30 07:47:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f494d46-eb77-5a45-be61-7ba37633c437 with scrape type 2
2026-03-30 07:47:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f494d46-eb77-5a45-be61-7ba37633c437 with scrape type 2
2026-03-30 07:47:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f494d46-eb77-5a45-be61-7ba37633c437, identifier: EA77246
2026-03-30 07:47:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f494d46-eb77-5a45-be61-7ba37633c437 with identifier: EA77246
2026-03-30 07:47:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f494d46-eb77-5a45-be61-7ba37633c437 with identifier: EA77246
2026-03-30 07:47:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f494d46-eb77-5a45-be61-7ba37633c437 with identifier: EA77246 to the API
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:22:35Z',
 'fuel_type': 'diesel',
 'id': '1f494d46-eb77-5a45-be61-7ba37633c437',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA77246',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Viano',
 'odometer': 265928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-23',
 'seller_name': None,
 'title': 'Mercedes-Benz Viano 2.1 CDI lang Trend',
 'transmission': 'automatic',
 'trim': 'lang Trend',
 'year': 2011}
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA77246%27 HTTP/1.1" 200 None
2026-03-30 07:47:42 [auto1.de] INFO: Saving data for EA77246: {'auction_closing_time': 1774884155.0, 'created_time': 1774676135.556088, 'last_price_update_time': 1774856862.054045}
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EA77246') HTTP/1.1" 204 0
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: EE67524
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: HA16942
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: NG74955
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: XV26734
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV26734%27 HTTP/1.1" 200 None
2026-03-30 07:47:42 [auto1.de] INFO: Scrape type for XV26734: 0
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: UM69189
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: AJ85569
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: GL61675
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: VH78642
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: FL30108
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: NG69344
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG69344%27 HTTP/1.1" 200 None
2026-03-30 07:47:42 [auto1.de] INFO: Scrape type for NG69344: 2
2026-03-30 07:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6099a6c2-b5fd-50bb-8abc-e68a1b6fbb62 with identifier: NG69344
2026-03-30 07:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6099a6c2-b5fd-50bb-8abc-e68a1b6fbb62 with scrape type 2
2026-03-30 07:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6099a6c2-b5fd-50bb-8abc-e68a1b6fbb62 with scrape type 2
2026-03-30 07:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6099a6c2-b5fd-50bb-8abc-e68a1b6fbb62, identifier: NG69344
2026-03-30 07:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6099a6c2-b5fd-50bb-8abc-e68a1b6fbb62 with identifier: NG69344
2026-03-30 07:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6099a6c2-b5fd-50bb-8abc-e68a1b6fbb62 with identifier: NG69344
2026-03-30 07:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6099a6c2-b5fd-50bb-8abc-e68a1b6fbb62 with identifier: NG69344 to the API
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:35:22Z',
 'fuel_type': 'petrol',
 'id': '6099a6c2-b5fd-50bb-8abc-e68a1b6fbb62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG69344',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 213911,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-10',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG69344%27 HTTP/1.1" 200 None
2026-03-30 07:47:42 [auto1.de] INFO: Saving data for NG69344: {'auction_closing_time': 1774884922.0, 'created_time': 1774638964.467112, 'last_price_update_time': 1774856862.479199}
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NG69344') HTTP/1.1" 204 0
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: ZW88785
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW88785%27 HTTP/1.1" 200 None
2026-03-30 07:47:42 [auto1.de] INFO: Scrape type for ZW88785: 2
2026-03-30 07:47:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7471232a-3422-5104-b40c-fb2193942df1 with identifier: ZW88785
2026-03-30 07:47:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7471232a-3422-5104-b40c-fb2193942df1 with scrape type 2
2026-03-30 07:47:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7471232a-3422-5104-b40c-fb2193942df1 with scrape type 2
2026-03-30 07:47:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7471232a-3422-5104-b40c-fb2193942df1, identifier: ZW88785
2026-03-30 07:47:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7471232a-3422-5104-b40c-fb2193942df1 with identifier: ZW88785
2026-03-30 07:47:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7471232a-3422-5104-b40c-fb2193942df1 with identifier: ZW88785
2026-03-30 07:47:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7471232a-3422-5104-b40c-fb2193942df1 with identifier: ZW88785 to the API
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:31:29Z',
 'fuel_type': 'petrol',
 'id': '7471232a-3422-5104-b40c-fb2193942df1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW88785',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 118617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2013}
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW88785%27 HTTP/1.1" 200 None
2026-03-30 07:47:42 [auto1.de] INFO: Saving data for ZW88785: {'auction_closing_time': 1774884689.0, 'created_time': 1774639860.426112, 'last_price_update_time': 1774856862.974669}
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW88785') HTTP/1.1" 204 0
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: CW59742
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: BW06132
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: FP32439
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: GR86063
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: KY67779
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: TV11727
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: WJ94391
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: KM78395
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: TC26510
2026-03-30 07:47:42 [auto1.de] INFO: Found listing with ID: EP74565
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP74565%27 HTTP/1.1" 200 None
2026-03-30 07:47:43 [auto1.de] INFO: Scrape type for EP74565: 2
2026-03-30 07:47:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 099ffad0-ea84-54e3-97d2-2952dfc3ffcb with identifier: EP74565
2026-03-30 07:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 099ffad0-ea84-54e3-97d2-2952dfc3ffcb with scrape type 2
2026-03-30 07:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 099ffad0-ea84-54e3-97d2-2952dfc3ffcb with scrape type 2
2026-03-30 07:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 099ffad0-ea84-54e3-97d2-2952dfc3ffcb, identifier: EP74565
2026-03-30 07:47:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 099ffad0-ea84-54e3-97d2-2952dfc3ffcb with identifier: EP74565
2026-03-30 07:47:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 099ffad0-ea84-54e3-97d2-2952dfc3ffcb with identifier: EP74565
2026-03-30 07:47:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 099ffad0-ea84-54e3-97d2-2952dfc3ffcb with identifier: EP74565 to the API
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 121,
 'expiration_date': '2026-03-30T15:42:53Z',
 'fuel_type': 'petrol',
 'id': '099ffad0-ea84-54e3-97d2-2952dfc3ffcb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP74565',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 41012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-21',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Skyactiv-G Exclusive-Line',
 'transmission': 'automatic',
 'trim': 'Exclusive-Line',
 'year': 2018}
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP74565%27 HTTP/1.1" 200 None
2026-03-30 07:47:43 [auto1.de] INFO: Saving data for EP74565: {'auction_closing_time': 1774885373.0, 'created_time': 1774639520.050307, 'last_price_update_time': 1774856863.401872}
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP74565') HTTP/1.1" 204 0
2026-03-30 07:47:43 [auto1.de] INFO: Found listing with ID: LW85167
2026-03-30 07:47:43 [auto1.de] INFO: Found listing with ID: UH78050
2026-03-30 07:47:43 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-30 07:47:43 [auto1.de] INFO: Scrape type for DN13458: 0
2026-03-30 07:47:43 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-30 07:47:43 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG80172%27 HTTP/1.1" 200 None
2026-03-30 07:47:43 [auto1.de] INFO: Scrape type for UG80172: 2
2026-03-30 07:47:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4934215-bcc1-5739-8396-0a270575f7a7 with identifier: UG80172
2026-03-30 07:47:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4934215-bcc1-5739-8396-0a270575f7a7 with scrape type 2
2026-03-30 07:47:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4934215-bcc1-5739-8396-0a270575f7a7 with scrape type 2
2026-03-30 07:47:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4934215-bcc1-5739-8396-0a270575f7a7, identifier: UG80172
2026-03-30 07:47:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4934215-bcc1-5739-8396-0a270575f7a7 with identifier: UG80172
2026-03-30 07:47:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4934215-bcc1-5739-8396-0a270575f7a7 with identifier: UG80172
2026-03-30 07:47:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4934215-bcc1-5739-8396-0a270575f7a7 with identifier: UG80172 to the API
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:23Z',
 'fuel_type': 'diesel',
 'id': 'f4934215-bcc1-5739-8396-0a270575f7a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG80172',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 93361,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-05',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Trendline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Trendline BlueMotion',
 'year': 2018}
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG80172%27 HTTP/1.1" 200 None
2026-03-30 07:47:43 [auto1.de] INFO: Saving data for UG80172: {'auction_closing_time': 1774886243.0, 'created_time': 1773945602.045003, 'last_price_update_time': 1774856863.979874}
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UG80172') HTTP/1.1" 204 0
2026-03-30 07:47:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:44 [auto1.de] INFO: Channel: 24h | Page: 138 | totalHits: 8397 | hits on page: 40
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: DN13458
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN13458%27 HTTP/1.1" 200 None
2026-03-30 07:47:44 [auto1.de] INFO: Scrape type for DN13458: 0
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: JL85877
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: UG80172
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG80172%27 HTTP/1.1" 200 None
2026-03-30 07:47:44 [auto1.de] INFO: Scrape type for UG80172: 0
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: AC95378
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC95378%27 HTTP/1.1" 200 None
2026-03-30 07:47:44 [auto1.de] INFO: Scrape type for AC95378: 2
2026-03-30 07:47:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ae758bd-fed1-5226-bff1-f7aa499e5015 with identifier: AC95378
2026-03-30 07:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae758bd-fed1-5226-bff1-f7aa499e5015 with scrape type 2
2026-03-30 07:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ae758bd-fed1-5226-bff1-f7aa499e5015 with scrape type 2
2026-03-30 07:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ae758bd-fed1-5226-bff1-f7aa499e5015, identifier: AC95378
2026-03-30 07:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ae758bd-fed1-5226-bff1-f7aa499e5015 with identifier: AC95378
2026-03-30 07:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ae758bd-fed1-5226-bff1-f7aa499e5015 with identifier: AC95378
2026-03-30 07:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ae758bd-fed1-5226-bff1-f7aa499e5015 with identifier: AC95378 to the API
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:30:46Z',
 'fuel_type': 'diesel',
 'id': '1ae758bd-fed1-5226-bff1-f7aa499e5015',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC95378',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 131573,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-29',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC95378%27 HTTP/1.1" 200 None
2026-03-30 07:47:44 [auto1.de] INFO: Saving data for AC95378: {'auction_closing_time': 1774884646.0, 'created_time': 1773381413.78064, 'last_price_update_time': 1774856864.671768}
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AC95378') HTTP/1.1" 204 0
2026-03-30 07:47:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: LN38152
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN38152%27 HTTP/1.1" 200 None
2026-03-30 07:47:44 [auto1.de] INFO: Scrape type for LN38152: 0
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: CW13893
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: DR31322
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: YS72291
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS72291%27 HTTP/1.1" 200 None
2026-03-30 07:47:44 [auto1.de] INFO: Scrape type for YS72291: 0
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: TJ09014
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: HL58412
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: AL26903
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: KU21621
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: TA25367
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: AD35771
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: SR77795
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: PN78353
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: ML19559
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: TF52264
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: HR97485
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR97485%27 HTTP/1.1" 200 None
2026-03-30 07:47:44 [auto1.de] INFO: Scrape type for HR97485: 0
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: EJ83325
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ83325%27 HTTP/1.1" 200 None
2026-03-30 07:47:44 [auto1.de] INFO: Scrape type for EJ83325: 0
2026-03-30 07:47:44 [auto1.de] INFO: Found listing with ID: PD62787
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD62787%27 HTTP/1.1" 200 None
2026-03-30 07:47:44 [auto1.de] INFO: Scrape type for PD62787: 2
2026-03-30 07:47:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 876bc048-4e36-56eb-8284-16af95ced447 with identifier: PD62787
2026-03-30 07:47:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 876bc048-4e36-56eb-8284-16af95ced447 with scrape type 2
2026-03-30 07:47:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 876bc048-4e36-56eb-8284-16af95ced447 with scrape type 2
2026-03-30 07:47:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 876bc048-4e36-56eb-8284-16af95ced447, identifier: PD62787
2026-03-30 07:47:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 876bc048-4e36-56eb-8284-16af95ced447 with identifier: PD62787
2026-03-30 07:47:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 876bc048-4e36-56eb-8284-16af95ced447 with identifier: PD62787
2026-03-30 07:47:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 876bc048-4e36-56eb-8284-16af95ced447 with identifier: PD62787 to the API
2026-03-30 07:47:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:58:20Z',
 'fuel_type': 'diesel',
 'id': '876bc048-4e36-56eb-8284-16af95ced447',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PD62787',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 252716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-10',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2014}
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD62787%27 HTTP/1.1" 200 None
2026-03-30 07:47:45 [auto1.de] INFO: Saving data for PD62787: {'auction_closing_time': 1774886300.0, 'created_time': 1774552823.185377, 'last_price_update_time': 1774856865.167734}
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PD62787') HTTP/1.1" 204 0
2026-03-30 07:47:45 [auto1.de] INFO: Found listing with ID: HY91019
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY91019%27 HTTP/1.1" 200 None
2026-03-30 07:47:45 [auto1.de] INFO: Scrape type for HY91019: 0
2026-03-30 07:47:45 [auto1.de] INFO: Found listing with ID: ZY28796
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY28796%27 HTTP/1.1" 200 None
2026-03-30 07:47:45 [auto1.de] INFO: Scrape type for ZY28796: 2
2026-03-30 07:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b42ad69c-4f78-57cd-8c0b-7abbdf708747 with identifier: ZY28796
2026-03-30 07:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b42ad69c-4f78-57cd-8c0b-7abbdf708747 with scrape type 2
2026-03-30 07:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b42ad69c-4f78-57cd-8c0b-7abbdf708747 with scrape type 2
2026-03-30 07:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b42ad69c-4f78-57cd-8c0b-7abbdf708747, identifier: ZY28796
2026-03-30 07:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b42ad69c-4f78-57cd-8c0b-7abbdf708747 with identifier: ZY28796
2026-03-30 07:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b42ad69c-4f78-57cd-8c0b-7abbdf708747 with identifier: ZY28796
2026-03-30 07:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b42ad69c-4f78-57cd-8c0b-7abbdf708747 with identifier: ZY28796 to the API
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-30T15:41:21Z',
 'fuel_type': 'petrol',
 'id': 'b42ad69c-4f78-57cd-8c0b-7abbdf708747',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY28796',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 77531,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-30',
 'seller_name': None,
 'title': 'BMW 3er 320i Luxury Line',
 'transmission': 'automatic',
 'trim': 'Luxury Line',
 'year': 2021}
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY28796%27 HTTP/1.1" 200 None
2026-03-30 07:47:45 [auto1.de] INFO: Saving data for ZY28796: {'auction_closing_time': 1774885281.0, 'created_time': 1774676142.801674, 'last_price_update_time': 1774856865.685103}
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY28796') HTTP/1.1" 204 0
2026-03-30 07:47:45 [auto1.de] INFO: Found listing with ID: PW70056
2026-03-30 07:47:45 [auto1.de] INFO: Found listing with ID: EL68687
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL68687%27 HTTP/1.1" 200 None
2026-03-30 07:47:45 [auto1.de] INFO: Scrape type for EL68687: 0
2026-03-30 07:47:45 [auto1.de] INFO: Found listing with ID: SM91292
2026-03-30 07:47:45 [auto1.de] INFO: Found listing with ID: RB37125
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB37125%27 HTTP/1.1" 200 None
2026-03-30 07:47:45 [auto1.de] INFO: Scrape type for RB37125: 2
2026-03-30 07:47:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4c09795-3025-51d3-bb68-a07718a64907 with identifier: RB37125
2026-03-30 07:47:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4c09795-3025-51d3-bb68-a07718a64907 with scrape type 2
2026-03-30 07:47:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4c09795-3025-51d3-bb68-a07718a64907 with scrape type 2
2026-03-30 07:47:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4c09795-3025-51d3-bb68-a07718a64907, identifier: RB37125
2026-03-30 07:47:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4c09795-3025-51d3-bb68-a07718a64907 with identifier: RB37125
2026-03-30 07:47:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4c09795-3025-51d3-bb68-a07718a64907 with identifier: RB37125
2026-03-30 07:47:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4c09795-3025-51d3-bb68-a07718a64907 with identifier: RB37125 to the API
2026-03-30 07:47:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:25:53Z',
 'fuel_type': 'diesel',
 'id': 'e4c09795-3025-51d3-bb68-a07718a64907',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RB37125',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 45650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-06',
 'seller_name': None,
 'title': 'BMW 3er 320d Mild-Hybrid xDrive Advantage',
 'transmission': 'automatic',
 'trim': 'xDrive Advantage',
 'year': 2022}
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB37125%27 HTTP/1.1" 200 None
2026-03-30 07:47:46 [auto1.de] INFO: Saving data for RB37125: {'auction_closing_time': 1774884353.0, 'created_time': 1774639288.32906, 'last_price_update_time': 1774856866.127377}
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RB37125') HTTP/1.1" 204 0
2026-03-30 07:47:46 [auto1.de] INFO: Found listing with ID: FZ71323
2026-03-30 07:47:46 [auto1.de] INFO: Found listing with ID: AH37368
2026-03-30 07:47:46 [auto1.de] INFO: Found listing with ID: GN24423
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN24423%27 HTTP/1.1" 200 None
2026-03-30 07:47:46 [auto1.de] INFO: Scrape type for GN24423: 2
2026-03-30 07:47:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faf83e1c-dc9c-579f-b791-f863bb2d89f7 with identifier: GN24423
2026-03-30 07:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faf83e1c-dc9c-579f-b791-f863bb2d89f7 with scrape type 2
2026-03-30 07:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faf83e1c-dc9c-579f-b791-f863bb2d89f7 with scrape type 2
2026-03-30 07:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: faf83e1c-dc9c-579f-b791-f863bb2d89f7, identifier: GN24423
2026-03-30 07:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: faf83e1c-dc9c-579f-b791-f863bb2d89f7 with identifier: GN24423
2026-03-30 07:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: faf83e1c-dc9c-579f-b791-f863bb2d89f7 with identifier: GN24423
2026-03-30 07:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: faf83e1c-dc9c-579f-b791-f863bb2d89f7 with identifier: GN24423 to the API
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:30:31Z',
 'fuel_type': 'petrol',
 'id': 'faf83e1c-dc9c-579f-b791-f863bb2d89f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN24423',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 156714,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN24423%27 HTTP/1.1" 200 None
2026-03-30 07:47:46 [auto1.de] INFO: Saving data for GN24423: {'auction_closing_time': 1774884631.0, 'created_time': 1774034348.323943, 'last_price_update_time': 1774856866.521285}
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN24423') HTTP/1.1" 204 0
2026-03-30 07:47:46 [auto1.de] INFO: Found listing with ID: SB28206
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB28206%27 HTTP/1.1" 200 None
2026-03-30 07:47:46 [auto1.de] INFO: Scrape type for SB28206: 0
2026-03-30 07:47:46 [auto1.de] INFO: Found listing with ID: MG33600
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG33600%27 HTTP/1.1" 200 None
2026-03-30 07:47:46 [auto1.de] INFO: Scrape type for MG33600: 2
2026-03-30 07:47:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62230ea2-c954-5105-a9e3-583c1ec14637 with identifier: MG33600
2026-03-30 07:47:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62230ea2-c954-5105-a9e3-583c1ec14637 with scrape type 2
2026-03-30 07:47:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62230ea2-c954-5105-a9e3-583c1ec14637 with scrape type 2
2026-03-30 07:47:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62230ea2-c954-5105-a9e3-583c1ec14637, identifier: MG33600
2026-03-30 07:47:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62230ea2-c954-5105-a9e3-583c1ec14637 with identifier: MG33600
2026-03-30 07:47:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62230ea2-c954-5105-a9e3-583c1ec14637 with identifier: MG33600
2026-03-30 07:47:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62230ea2-c954-5105-a9e3-583c1ec14637 with identifier: MG33600 to the API
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:56:59Z',
 'fuel_type': 'petrol',
 'id': '62230ea2-c954-5105-a9e3-583c1ec14637',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MG33600',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 229636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-28',
 'seller_name': None,
 'title': 'Audi A6 2.4 V6 quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 1999}
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG33600%27 HTTP/1.1" 200 None
2026-03-30 07:47:46 [auto1.de] INFO: Saving data for MG33600: {'auction_closing_time': 1774886219.0, 'created_time': 1774552582.872309, 'last_price_update_time': 1774856866.933379}
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MG33600') HTTP/1.1" 204 0
2026-03-30 07:47:47 [auto1.de] INFO: Found listing with ID: UA59851
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59851%27 HTTP/1.1" 200 None
2026-03-30 07:47:47 [auto1.de] INFO: Scrape type for UA59851: 2
2026-03-30 07:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7f73f57-e089-503e-8e66-b889c5dee97f with identifier: UA59851
2026-03-30 07:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7f73f57-e089-503e-8e66-b889c5dee97f with scrape type 2
2026-03-30 07:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7f73f57-e089-503e-8e66-b889c5dee97f with scrape type 2
2026-03-30 07:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c7f73f57-e089-503e-8e66-b889c5dee97f, identifier: UA59851
2026-03-30 07:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c7f73f57-e089-503e-8e66-b889c5dee97f with identifier: UA59851
2026-03-30 07:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c7f73f57-e089-503e-8e66-b889c5dee97f with identifier: UA59851
2026-03-30 07:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c7f73f57-e089-503e-8e66-b889c5dee97f with identifier: UA59851 to the API
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:47:24Z',
 'fuel_type': 'diesel',
 'id': 'c7f73f57-e089-503e-8e66-b889c5dee97f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UA59851',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 234628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-23',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.0 V6 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2019}
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA59851%27 HTTP/1.1" 200 None
2026-03-30 07:47:47 [auto1.de] INFO: Saving data for UA59851: {'auction_closing_time': 1774885644.0, 'created_time': 1773132804.940803, 'last_price_update_time': 1774856867.496952}
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UA59851') HTTP/1.1" 204 0
2026-03-30 07:47:47 [auto1.de] INFO: Found listing with ID: AN78451
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN78451%27 HTTP/1.1" 200 None
2026-03-30 07:47:47 [auto1.de] INFO: Scrape type for AN78451: 2
2026-03-30 07:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38ffda81-d297-51cc-836e-3d48c130649d with identifier: AN78451
2026-03-30 07:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38ffda81-d297-51cc-836e-3d48c130649d with scrape type 2
2026-03-30 07:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38ffda81-d297-51cc-836e-3d48c130649d with scrape type 2
2026-03-30 07:47:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 38ffda81-d297-51cc-836e-3d48c130649d, identifier: AN78451
2026-03-30 07:47:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 38ffda81-d297-51cc-836e-3d48c130649d with identifier: AN78451
2026-03-30 07:47:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 38ffda81-d297-51cc-836e-3d48c130649d with identifier: AN78451
2026-03-30 07:47:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 38ffda81-d297-51cc-836e-3d48c130649d with identifier: AN78451 to the API
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 280,
 'expiration_date': '2026-03-30T15:18:10Z',
 'fuel_type': 'petrol',
 'id': '38ffda81-d297-51cc-836e-3d48c130649d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN78451',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touareg',
 'odometer': 248640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-28',
 'seller_name': None,
 'title': 'Volkswagen Touareg 3.6 V6 FSI Kong',
 'transmission': 'automatic',
 'trim': 'Kong',
 'year': 2006}
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN78451%27 HTTP/1.1" 200 None
2026-03-30 07:47:47 [auto1.de] INFO: Saving data for AN78451: {'auction_closing_time': 1774883890.0, 'created_time': 1774639475.080951, 'last_price_update_time': 1774856867.897979}
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AN78451') HTTP/1.1" 204 0
2026-03-30 07:47:47 [auto1.de] INFO: Found listing with ID: EF84485
2026-03-30 07:47:47 [auto1.de] INFO: Found listing with ID: TT68659
2026-03-30 07:47:47 [auto1.de] INFO: Found listing with ID: EG87318
2026-03-30 07:47:47 [auto1.de] INFO: Found listing with ID: MD27320
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD27320%27 HTTP/1.1" 200 None
2026-03-30 07:47:47 [auto1.de] INFO: Scrape type for MD27320: 2
2026-03-30 07:47:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f1f08f1-3f84-5d00-a90a-487f73c7aa94 with identifier: MD27320
2026-03-30 07:47:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f1f08f1-3f84-5d00-a90a-487f73c7aa94 with scrape type 2
2026-03-30 07:47:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f1f08f1-3f84-5d00-a90a-487f73c7aa94 with scrape type 2
2026-03-30 07:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f1f08f1-3f84-5d00-a90a-487f73c7aa94, identifier: MD27320
2026-03-30 07:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f1f08f1-3f84-5d00-a90a-487f73c7aa94 with identifier: MD27320
2026-03-30 07:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f1f08f1-3f84-5d00-a90a-487f73c7aa94 with identifier: MD27320
2026-03-30 07:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f1f08f1-3f84-5d00-a90a-487f73c7aa94 with identifier: MD27320 to the API
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:21:20Z',
 'fuel_type': 'petrol',
 'id': '7f1f08f1-3f84-5d00-a90a-487f73c7aa94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD27320',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 135142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-21',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD27320%27 HTTP/1.1" 200 None
2026-03-30 07:47:48 [auto1.de] INFO: Saving data for MD27320: {'auction_closing_time': 1774884080.0, 'created_time': 1774550164.082356, 'last_price_update_time': 1774856868.317081}
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD27320') HTTP/1.1" 204 0
2026-03-30 07:47:48 [auto1.de] INFO: Found listing with ID: UW23884
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW23884%27 HTTP/1.1" 200 None
2026-03-30 07:47:48 [auto1.de] INFO: Scrape type for UW23884: 2
2026-03-30 07:47:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97650d51-9949-5857-a916-7d6767008e0e with identifier: UW23884
2026-03-30 07:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97650d51-9949-5857-a916-7d6767008e0e with scrape type 2
2026-03-30 07:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97650d51-9949-5857-a916-7d6767008e0e with scrape type 2
2026-03-30 07:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97650d51-9949-5857-a916-7d6767008e0e, identifier: UW23884
2026-03-30 07:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97650d51-9949-5857-a916-7d6767008e0e with identifier: UW23884
2026-03-30 07:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97650d51-9949-5857-a916-7d6767008e0e with identifier: UW23884
2026-03-30 07:47:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97650d51-9949-5857-a916-7d6767008e0e with identifier: UW23884 to the API
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:59:03Z',
 'fuel_type': 'petrol',
 'id': '97650d51-9949-5857-a916-7d6767008e0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW23884',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 154986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-09',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2009}
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW23884%27 HTTP/1.1" 200 None
2026-03-30 07:47:48 [auto1.de] INFO: Saving data for UW23884: {'auction_closing_time': 1774886343.0, 'created_time': 1774350047.632469, 'last_price_update_time': 1774856868.742601}
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UW23884') HTTP/1.1" 204 0
2026-03-30 07:47:48 [auto1.de] INFO: Found listing with ID: EG77695
2026-03-30 07:47:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:48 [auto1.de] INFO: Channel: 24h | Page: 139 | totalHits: 8397 | hits on page: 40
2026-03-30 07:47:48 [auto1.de] INFO: Found listing with ID: WC45623
2026-03-30 07:47:48 [auto1.de] INFO: Found listing with ID: HF48601
2026-03-30 07:47:48 [auto1.de] INFO: Found listing with ID: CA65942
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65942%27 HTTP/1.1" 200 None
2026-03-30 07:47:48 [auto1.de] INFO: Scrape type for CA65942: 2
2026-03-30 07:47:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with identifier: CA65942
2026-03-30 07:47:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with scrape type 2
2026-03-30 07:47:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with scrape type 2
2026-03-30 07:47:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4, identifier: CA65942
2026-03-30 07:47:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with identifier: CA65942
2026-03-30 07:47:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with identifier: CA65942
2026-03-30 07:47:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4 with identifier: CA65942 to the API
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:19:12Z',
 'fuel_type': 'diesel',
 'id': 'e8c74cf3-35ba-5326-a5c0-d6b08fb2bdf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CA65942',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 106856,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-17',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA65942%27 HTTP/1.1" 200 None
2026-03-30 07:47:49 [auto1.de] INFO: Saving data for CA65942: {'auction_closing_time': 1774883952.0, 'created_time': 1774552912.713365, 'last_price_update_time': 1774856869.255441}
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CA65942') HTTP/1.1" 204 0
2026-03-30 07:47:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:49 [auto1.de] INFO: Found listing with ID: EX93586
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EX93586%27 HTTP/1.1" 200 None
2026-03-30 07:47:49 [auto1.de] INFO: Scrape type for EX93586: 0
2026-03-30 07:47:49 [auto1.de] INFO: Found listing with ID: NV85283
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV85283%27 HTTP/1.1" 200 None
2026-03-30 07:47:49 [auto1.de] INFO: Scrape type for NV85283: 2
2026-03-30 07:47:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f86cc13-52ef-5b62-a65f-20c997f770ef with identifier: NV85283
2026-03-30 07:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f86cc13-52ef-5b62-a65f-20c997f770ef with scrape type 2
2026-03-30 07:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f86cc13-52ef-5b62-a65f-20c997f770ef with scrape type 2
2026-03-30 07:47:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f86cc13-52ef-5b62-a65f-20c997f770ef, identifier: NV85283
2026-03-30 07:47:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f86cc13-52ef-5b62-a65f-20c997f770ef with identifier: NV85283
2026-03-30 07:47:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f86cc13-52ef-5b62-a65f-20c997f770ef with identifier: NV85283
2026-03-30 07:47:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f86cc13-52ef-5b62-a65f-20c997f770ef with identifier: NV85283 to the API
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:38:58Z',
 'fuel_type': 'diesel',
 'id': '9f86cc13-52ef-5b62-a65f-20c997f770ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV85283',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 259269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-03',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Match BlueMotion',
 'transmission': 'automatic',
 'trim': 'Match BlueMotion',
 'year': 2012}
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV85283%27 HTTP/1.1" 200 None
2026-03-30 07:47:49 [auto1.de] INFO: Saving data for NV85283: {'auction_closing_time': 1774885138.0, 'created_time': 1773916580.241007, 'last_price_update_time': 1774856869.806138}
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV85283') HTTP/1.1" 204 0
2026-03-30 07:47:49 [auto1.de] INFO: Found listing with ID: KP12697
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP12697%27 HTTP/1.1" 200 None
2026-03-30 07:47:49 [auto1.de] INFO: Scrape type for KP12697: 0
2026-03-30 07:47:49 [auto1.de] INFO: Found listing with ID: UY74953
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY74953%27 HTTP/1.1" 200 None
2026-03-30 07:47:49 [auto1.de] INFO: Scrape type for UY74953: 0
2026-03-30 07:47:49 [auto1.de] INFO: Found listing with ID: UB26055
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB26055%27 HTTP/1.1" 200 None
2026-03-30 07:47:49 [auto1.de] INFO: Scrape type for UB26055: 0
2026-03-30 07:47:49 [auto1.de] INFO: Found listing with ID: JP54532
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP54532%27 HTTP/1.1" 200 None
2026-03-30 07:47:49 [auto1.de] INFO: Scrape type for JP54532: 0
2026-03-30 07:47:49 [auto1.de] INFO: Found listing with ID: VL71663
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL71663%27 HTTP/1.1" 200 None
2026-03-30 07:47:49 [auto1.de] INFO: Scrape type for VL71663: 0
2026-03-30 07:47:49 [auto1.de] INFO: Found listing with ID: BA73417
2026-03-30 07:47:49 [auto1.de] INFO: Found listing with ID: DW23670
2026-03-30 07:47:49 [auto1.de] INFO: Found listing with ID: GU60494
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU60494%27 HTTP/1.1" 200 None
2026-03-30 07:47:49 [auto1.de] INFO: Scrape type for GU60494: 2
2026-03-30 07:47:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a207d31-6587-5796-bfb2-bd812df8e139 with identifier: GU60494
2026-03-30 07:47:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a207d31-6587-5796-bfb2-bd812df8e139 with scrape type 2
2026-03-30 07:47:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a207d31-6587-5796-bfb2-bd812df8e139 with scrape type 2
2026-03-30 07:47:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a207d31-6587-5796-bfb2-bd812df8e139, identifier: GU60494
2026-03-30 07:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a207d31-6587-5796-bfb2-bd812df8e139 with identifier: GU60494
2026-03-30 07:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a207d31-6587-5796-bfb2-bd812df8e139 with identifier: GU60494
2026-03-30 07:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a207d31-6587-5796-bfb2-bd812df8e139 with identifier: GU60494 to the API
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:07Z',
 'fuel_type': 'petrol',
 'id': '0a207d31-6587-5796-bfb2-bd812df8e139',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU60494',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 104084,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-11',
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.5 TSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2021}
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU60494%27 HTTP/1.1" 200 None
2026-03-30 07:47:50 [auto1.de] INFO: Saving data for GU60494: {'auction_closing_time': 1774883947.0, 'created_time': 1774552780.735016, 'last_price_update_time': 1774856870.296644}
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU60494') HTTP/1.1" 204 0
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: VH26233
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: DJ93554
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ93554%27 HTTP/1.1" 200 None
2026-03-30 07:47:50 [auto1.de] INFO: Scrape type for DJ93554: 0
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: NU40384
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU40384%27 HTTP/1.1" 200 None
2026-03-30 07:47:50 [auto1.de] INFO: Scrape type for NU40384: 0
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: XN26192
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: WA19353
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: MX70218
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX70218%27 HTTP/1.1" 200 None
2026-03-30 07:47:50 [auto1.de] INFO: Scrape type for MX70218: 2
2026-03-30 07:47:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44624f98-5e3b-501b-9dc9-5f6308a025ce with identifier: MX70218
2026-03-30 07:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44624f98-5e3b-501b-9dc9-5f6308a025ce with scrape type 2
2026-03-30 07:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44624f98-5e3b-501b-9dc9-5f6308a025ce with scrape type 2
2026-03-30 07:47:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44624f98-5e3b-501b-9dc9-5f6308a025ce, identifier: MX70218
2026-03-30 07:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44624f98-5e3b-501b-9dc9-5f6308a025ce with identifier: MX70218
2026-03-30 07:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44624f98-5e3b-501b-9dc9-5f6308a025ce with identifier: MX70218
2026-03-30 07:47:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44624f98-5e3b-501b-9dc9-5f6308a025ce with identifier: MX70218 to the API
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:16:38Z',
 'fuel_type': 'diesel',
 'id': '44624f98-5e3b-501b-9dc9-5f6308a025ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX70218',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 208248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-22',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Biturbo CDTI DPF Innovation Start/Stop',
 'transmission': 'manual',
 'trim': 'Innovation Start/Stop',
 'year': 2016}
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX70218%27 HTTP/1.1" 200 None
2026-03-30 07:47:50 [auto1.de] INFO: Saving data for MX70218: {'auction_closing_time': 1774883798.0, 'created_time': 1774639094.928202, 'last_price_update_time': 1774856870.734986}
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX70218') HTTP/1.1" 204 0
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: UY13477
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: GM59511
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: RR46383
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: BL86865
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: ZL15649
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: TR74961
2026-03-30 07:47:50 [auto1.de] INFO: Found listing with ID: EP31898
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP31898%27 HTTP/1.1" 200 None
2026-03-30 07:47:50 [auto1.de] INFO: Scrape type for EP31898: 2
2026-03-30 07:47:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43fed8f9-61f8-5511-a48d-1c960125504b with identifier: EP31898
2026-03-30 07:47:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43fed8f9-61f8-5511-a48d-1c960125504b with scrape type 2
2026-03-30 07:47:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43fed8f9-61f8-5511-a48d-1c960125504b with scrape type 2
2026-03-30 07:47:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43fed8f9-61f8-5511-a48d-1c960125504b, identifier: EP31898
2026-03-30 07:47:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43fed8f9-61f8-5511-a48d-1c960125504b with identifier: EP31898
2026-03-30 07:47:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43fed8f9-61f8-5511-a48d-1c960125504b with identifier: EP31898
2026-03-30 07:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43fed8f9-61f8-5511-a48d-1c960125504b with identifier: EP31898 to the API
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:58:30Z',
 'fuel_type': 'diesel',
 'id': '43fed8f9-61f8-5511-a48d-1c960125504b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP31898',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 175593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-06',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2017}
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP31898%27 HTTP/1.1" 200 None
2026-03-30 07:47:51 [auto1.de] INFO: Saving data for EP31898: {'auction_closing_time': 1774886310.0, 'created_time': 1773946210.240584, 'last_price_update_time': 1774856871.214118}
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EP31898') HTTP/1.1" 204 0
2026-03-30 07:47:51 [auto1.de] INFO: Found listing with ID: EE83336
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE83336%27 HTTP/1.1" 200 None
2026-03-30 07:47:51 [auto1.de] INFO: Scrape type for EE83336: 0
2026-03-30 07:47:51 [auto1.de] INFO: Found listing with ID: GE21325
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE21325%27 HTTP/1.1" 200 None
2026-03-30 07:47:51 [auto1.de] INFO: Scrape type for GE21325: 0
2026-03-30 07:47:51 [auto1.de] INFO: Found listing with ID: CB52035
2026-03-30 07:47:51 [auto1.de] INFO: Found listing with ID: XS82974
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS82974%27 HTTP/1.1" 200 None
2026-03-30 07:47:51 [auto1.de] INFO: Scrape type for XS82974: 0
2026-03-30 07:47:51 [auto1.de] INFO: Found listing with ID: AE81199
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE81199%27 HTTP/1.1" 200 None
2026-03-30 07:47:51 [auto1.de] INFO: Scrape type for AE81199: 2
2026-03-30 07:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with identifier: AE81199
2026-03-30 07:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with scrape type 2
2026-03-30 07:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with scrape type 2
2026-03-30 07:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdbe779b-65b8-5b9e-bbf1-8323dd4abe62, identifier: AE81199
2026-03-30 07:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with identifier: AE81199
2026-03-30 07:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with identifier: AE81199
2026-03-30 07:47:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdbe779b-65b8-5b9e-bbf1-8323dd4abe62 with identifier: AE81199 to the API
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:52Z',
 'fuel_type': 'petrol',
 'id': 'cdbe779b-65b8-5b9e-bbf1-8323dd4abe62',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE81199',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 121294,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-11',
 'seller_name': None,
 'title': 'Seat Leon 1.5 TSI ACT FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2021}
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE81199%27 HTTP/1.1" 200 None
2026-03-30 07:47:51 [auto1.de] INFO: Saving data for AE81199: {'auction_closing_time': 1774883032.0, 'created_time': 1774552999.217942, 'last_price_update_time': 1774856871.674003}
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AE81199') HTTP/1.1" 204 0
2026-03-30 07:47:51 [auto1.de] INFO: Found listing with ID: SR51449
2026-03-30 07:47:51 [auto1.de] INFO: Found listing with ID: XD56030
2026-03-30 07:47:51 [auto1.de] INFO: Found listing with ID: EN73396
2026-03-30 07:47:51 [auto1.de] INFO: Found listing with ID: MJ31328
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ31328%27 HTTP/1.1" 200 None
2026-03-30 07:47:51 [auto1.de] INFO: Scrape type for MJ31328: 0
2026-03-30 07:47:51 [auto1.de] INFO: Found listing with ID: DT53290
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT53290%27 HTTP/1.1" 200 None
2026-03-30 07:47:51 [auto1.de] INFO: Scrape type for DT53290: 2
2026-03-30 07:47:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a539516-572d-5d8b-b829-8a688b1ec859 with identifier: DT53290
2026-03-30 07:47:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a539516-572d-5d8b-b829-8a688b1ec859 with scrape type 2
2026-03-30 07:47:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a539516-572d-5d8b-b829-8a688b1ec859 with scrape type 2
2026-03-30 07:47:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0a539516-572d-5d8b-b829-8a688b1ec859, identifier: DT53290
2026-03-30 07:47:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0a539516-572d-5d8b-b829-8a688b1ec859 with identifier: DT53290
2026-03-30 07:47:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0a539516-572d-5d8b-b829-8a688b1ec859 with identifier: DT53290
2026-03-30 07:47:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0a539516-572d-5d8b-b829-8a688b1ec859 with identifier: DT53290 to the API
2026-03-30 07:47:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 76,
 'expiration_date': '2026-03-30T15:03:20Z',
 'fuel_type': 'petrol',
 'id': '0a539516-572d-5d8b-b829-8a688b1ec859',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT53290',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 24766,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-24',
 'seller_name': None,
 'title': 'Renault Clio 0.9 TCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT53290%27 HTTP/1.1" 200 None
2026-03-30 07:47:53 [auto1.de] INFO: Saving data for DT53290: {'auction_closing_time': 1774883000.0, 'created_time': 1774639284.231145, 'last_price_update_time': 1774856873.170171}
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT53290') HTTP/1.1" 204 0
2026-03-30 07:47:53 [auto1.de] INFO: Found listing with ID: CC89680
2026-03-30 07:47:53 [auto1.de] INFO: Found listing with ID: BR53906
2026-03-30 07:47:53 [auto1.de] INFO: Found listing with ID: UP12343
2026-03-30 07:47:53 [auto1.de] INFO: Found listing with ID: FJ72456
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72456%27 HTTP/1.1" 200 None
2026-03-30 07:47:53 [auto1.de] INFO: Scrape type for FJ72456: 2
2026-03-30 07:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90e6efdd-a623-5ea9-9793-9403167a396a with identifier: FJ72456
2026-03-30 07:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90e6efdd-a623-5ea9-9793-9403167a396a with scrape type 2
2026-03-30 07:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90e6efdd-a623-5ea9-9793-9403167a396a with scrape type 2
2026-03-30 07:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90e6efdd-a623-5ea9-9793-9403167a396a, identifier: FJ72456
2026-03-30 07:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90e6efdd-a623-5ea9-9793-9403167a396a with identifier: FJ72456
2026-03-30 07:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90e6efdd-a623-5ea9-9793-9403167a396a with identifier: FJ72456
2026-03-30 07:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90e6efdd-a623-5ea9-9793-9403167a396a with identifier: FJ72456 to the API
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:16:21Z',
 'fuel_type': 'petrol',
 'id': '90e6efdd-a623-5ea9-9793-9403167a396a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ72456',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 148688,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-30',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ72456%27 HTTP/1.1" 200 None
2026-03-30 07:47:53 [auto1.de] INFO: Saving data for FJ72456: {'auction_closing_time': 1774883781.0, 'created_time': 1774639069.79044, 'last_price_update_time': 1774856873.568036}
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ72456') HTTP/1.1" 204 0
2026-03-30 07:47:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:53 [auto1.de] INFO: Channel: 24h | Page: 140 | totalHits: 8397 | hits on page: 40
2026-03-30 07:47:53 [auto1.de] INFO: Found listing with ID: XV53612
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV53612%27 HTTP/1.1" 200 None
2026-03-30 07:47:53 [auto1.de] INFO: Scrape type for XV53612: 0
2026-03-30 07:47:53 [auto1.de] INFO: Found listing with ID: ZP66388
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP66388%27 HTTP/1.1" 200 None
2026-03-30 07:47:53 [auto1.de] INFO: Scrape type for ZP66388: 2
2026-03-30 07:47:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66b2d298-c015-5c99-a855-9b3e4e682d77 with identifier: ZP66388
2026-03-30 07:47:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66b2d298-c015-5c99-a855-9b3e4e682d77 with scrape type 2
2026-03-30 07:47:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66b2d298-c015-5c99-a855-9b3e4e682d77 with scrape type 2
2026-03-30 07:47:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66b2d298-c015-5c99-a855-9b3e4e682d77, identifier: ZP66388
2026-03-30 07:47:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66b2d298-c015-5c99-a855-9b3e4e682d77 with identifier: ZP66388
2026-03-30 07:47:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66b2d298-c015-5c99-a855-9b3e4e682d77 with identifier: ZP66388
2026-03-30 07:47:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66b2d298-c015-5c99-a855-9b3e4e682d77 with identifier: ZP66388 to the API
2026-03-30 07:47:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:49:24Z',
 'fuel_type': 'petrol',
 'id': '66b2d298-c015-5c99-a855-9b3e4e682d77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP66388',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 118805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-17',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2018}
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP66388%27 HTTP/1.1" 200 None
2026-03-30 07:47:54 [auto1.de] INFO: Saving data for ZP66388: {'auction_closing_time': 1774885764.0, 'created_time': 1774639885.988605, 'last_price_update_time': 1774856874.126713}
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP66388') HTTP/1.1" 204 0
2026-03-30 07:47:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:54 [auto1.de] INFO: Found listing with ID: HJ28276
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ28276%27 HTTP/1.1" 200 None
2026-03-30 07:47:54 [auto1.de] INFO: Scrape type for HJ28276: 2
2026-03-30 07:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 394d86ae-c6a2-5dba-80c8-8c293c563389 with identifier: HJ28276
2026-03-30 07:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 394d86ae-c6a2-5dba-80c8-8c293c563389 with scrape type 2
2026-03-30 07:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 394d86ae-c6a2-5dba-80c8-8c293c563389 with scrape type 2
2026-03-30 07:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 394d86ae-c6a2-5dba-80c8-8c293c563389, identifier: HJ28276
2026-03-30 07:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 394d86ae-c6a2-5dba-80c8-8c293c563389 with identifier: HJ28276
2026-03-30 07:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 394d86ae-c6a2-5dba-80c8-8c293c563389 with identifier: HJ28276
2026-03-30 07:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 394d86ae-c6a2-5dba-80c8-8c293c563389 with identifier: HJ28276 to the API
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:52:40Z',
 'fuel_type': 'petrol',
 'id': '394d86ae-c6a2-5dba-80c8-8c293c563389',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ28276',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 148975,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-07-17',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2008}
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ28276%27 HTTP/1.1" 200 None
2026-03-30 07:47:54 [auto1.de] INFO: Saving data for HJ28276: {'auction_closing_time': 1774885960.0, 'created_time': 1774639204.40745, 'last_price_update_time': 1774856874.652483}
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HJ28276') HTTP/1.1" 204 0
2026-03-30 07:47:54 [auto1.de] INFO: Found listing with ID: YJ21750
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21750%27 HTTP/1.1" 200 None
2026-03-30 07:47:54 [auto1.de] INFO: Scrape type for YJ21750: 2
2026-03-30 07:47:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf41e13-4d20-5a91-a4da-40c1321618cf with identifier: YJ21750
2026-03-30 07:47:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf41e13-4d20-5a91-a4da-40c1321618cf with scrape type 2
2026-03-30 07:47:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acf41e13-4d20-5a91-a4da-40c1321618cf with scrape type 2
2026-03-30 07:47:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acf41e13-4d20-5a91-a4da-40c1321618cf, identifier: YJ21750
2026-03-30 07:47:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acf41e13-4d20-5a91-a4da-40c1321618cf with identifier: YJ21750
2026-03-30 07:47:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acf41e13-4d20-5a91-a4da-40c1321618cf with identifier: YJ21750
2026-03-30 07:47:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acf41e13-4d20-5a91-a4da-40c1321618cf with identifier: YJ21750 to the API
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:40:37Z',
 'fuel_type': 'diesel',
 'id': 'acf41e13-4d20-5a91-a4da-40c1321618cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ21750',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 184161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-25',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Exclusive BlueMotion',
 'transmission': 'manual',
 'trim': 'Exclusive BlueMotion',
 'year': 2012}
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21750%27 HTTP/1.1" 200 None
2026-03-30 07:47:55 [auto1.de] INFO: Saving data for YJ21750: {'auction_closing_time': 1774885237.0, 'created_time': 1774552958.195043, 'last_price_update_time': 1774856875.065537}
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YJ21750') HTTP/1.1" 204 0
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: YF42870
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: YH44643
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH44643%27 HTTP/1.1" 200 None
2026-03-30 07:47:55 [auto1.de] INFO: Scrape type for YH44643: 0
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: FJ98191
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: JJ72083
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ72083%27 HTTP/1.1" 200 None
2026-03-30 07:47:55 [auto1.de] INFO: Scrape type for JJ72083: 0
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: PT78073
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT78073%27 HTTP/1.1" 200 None
2026-03-30 07:47:55 [auto1.de] INFO: Scrape type for PT78073: 0
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: MX02891
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: JP08522
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP08522%27 HTTP/1.1" 200 None
2026-03-30 07:47:55 [auto1.de] INFO: Scrape type for JP08522: 0
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: KB55712
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: CN91045
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN91045%27 HTTP/1.1" 200 None
2026-03-30 07:47:55 [auto1.de] INFO: Scrape type for CN91045: 0
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: JN55022
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: SG10067
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: CX18884
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX18884%27 HTTP/1.1" 200 None
2026-03-30 07:47:55 [auto1.de] INFO: Scrape type for CX18884: 0
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: MM29891
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM29891%27 HTTP/1.1" 200 None
2026-03-30 07:47:55 [auto1.de] INFO: Scrape type for MM29891: 0
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: YC44419
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC44419%27 HTTP/1.1" 200 None
2026-03-30 07:47:55 [auto1.de] INFO: Scrape type for YC44419: 2
2026-03-30 07:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15b684a7-1e3c-54aa-807a-b5fa44e830ce with identifier: YC44419
2026-03-30 07:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15b684a7-1e3c-54aa-807a-b5fa44e830ce with scrape type 2
2026-03-30 07:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15b684a7-1e3c-54aa-807a-b5fa44e830ce with scrape type 2
2026-03-30 07:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15b684a7-1e3c-54aa-807a-b5fa44e830ce, identifier: YC44419
2026-03-30 07:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15b684a7-1e3c-54aa-807a-b5fa44e830ce with identifier: YC44419
2026-03-30 07:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15b684a7-1e3c-54aa-807a-b5fa44e830ce with identifier: YC44419
2026-03-30 07:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15b684a7-1e3c-54aa-807a-b5fa44e830ce with identifier: YC44419 to the API
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:40:45Z',
 'fuel_type': 'diesel',
 'id': '15b684a7-1e3c-54aa-807a-b5fa44e830ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC44419',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 201796,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-26',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2017}
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC44419%27 HTTP/1.1" 200 None
2026-03-30 07:47:55 [auto1.de] INFO: Saving data for YC44419: {'auction_closing_time': 1774885245.0, 'created_time': 1773304084.708749, 'last_price_update_time': 1774856875.601423}
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC44419') HTTP/1.1" 204 0
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: EM77424
2026-03-30 07:47:55 [auto1.de] INFO: Found listing with ID: WZ42381
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ42381%27 HTTP/1.1" 200 None
2026-03-30 07:47:55 [auto1.de] INFO: Scrape type for WZ42381: 2
2026-03-30 07:47:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee6df84e-4fb8-581a-8bdb-dc60a4a98e9b with identifier: WZ42381
2026-03-30 07:47:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee6df84e-4fb8-581a-8bdb-dc60a4a98e9b with scrape type 2
2026-03-30 07:47:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee6df84e-4fb8-581a-8bdb-dc60a4a98e9b with scrape type 2
2026-03-30 07:47:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ee6df84e-4fb8-581a-8bdb-dc60a4a98e9b, identifier: WZ42381
2026-03-30 07:47:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ee6df84e-4fb8-581a-8bdb-dc60a4a98e9b with identifier: WZ42381
2026-03-30 07:47:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ee6df84e-4fb8-581a-8bdb-dc60a4a98e9b with identifier: WZ42381
2026-03-30 07:47:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ee6df84e-4fb8-581a-8bdb-dc60a4a98e9b with identifier: WZ42381 to the API
2026-03-30 07:47:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:54:10Z',
 'fuel_type': 'diesel',
 'id': 'ee6df84e-4fb8-581a-8bdb-dc60a4a98e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ42381',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 93413,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-02',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.0 Sd4 SE Dynamic',
 'transmission': 'automatic',
 'trim': 'SE Dynamic',
 'year': 2018}
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ42381%27 HTTP/1.1" 200 None
2026-03-30 07:47:56 [auto1.de] INFO: Saving data for WZ42381: {'auction_closing_time': 1774886050.0, 'created_time': 1774639185.462734, 'last_price_update_time': 1774856876.121117}
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WZ42381') HTTP/1.1" 204 0
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: CV73879
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: VJ82092
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ82092%27 HTTP/1.1" 200 None
2026-03-30 07:47:56 [auto1.de] INFO: Scrape type for VJ82092: 2
2026-03-30 07:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1c2ec43-7c22-5cd8-8d51-87e436788732 with identifier: VJ82092
2026-03-30 07:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1c2ec43-7c22-5cd8-8d51-87e436788732 with scrape type 2
2026-03-30 07:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1c2ec43-7c22-5cd8-8d51-87e436788732 with scrape type 2
2026-03-30 07:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c1c2ec43-7c22-5cd8-8d51-87e436788732, identifier: VJ82092
2026-03-30 07:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c1c2ec43-7c22-5cd8-8d51-87e436788732 with identifier: VJ82092
2026-03-30 07:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c1c2ec43-7c22-5cd8-8d51-87e436788732 with identifier: VJ82092
2026-03-30 07:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c1c2ec43-7c22-5cd8-8d51-87e436788732 with identifier: VJ82092 to the API
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:16:34Z',
 'fuel_type': 'diesel',
 'id': 'c1c2ec43-7c22-5cd8-8d51-87e436788732',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ82092',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 247535,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-23',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2011}
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ82092%27 HTTP/1.1" 200 None
2026-03-30 07:47:56 [auto1.de] INFO: Saving data for VJ82092: {'auction_closing_time': 1774883794.0, 'created_time': 1774638846.587929, 'last_price_update_time': 1774856876.537351}
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VJ82092') HTTP/1.1" 204 0
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: DG24182
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: CD36219
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD36219%27 HTTP/1.1" 200 None
2026-03-30 07:47:56 [auto1.de] INFO: Scrape type for CD36219: 0
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: CH69099
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: WL17910
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: MC57954
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC57954%27 HTTP/1.1" 200 None
2026-03-30 07:47:56 [auto1.de] INFO: Scrape type for MC57954: 2
2026-03-30 07:47:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19824232-d35a-5f2f-96d9-1d79da51bb38 with identifier: MC57954
2026-03-30 07:47:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19824232-d35a-5f2f-96d9-1d79da51bb38 with scrape type 2
2026-03-30 07:47:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19824232-d35a-5f2f-96d9-1d79da51bb38 with scrape type 2
2026-03-30 07:47:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19824232-d35a-5f2f-96d9-1d79da51bb38, identifier: MC57954
2026-03-30 07:47:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19824232-d35a-5f2f-96d9-1d79da51bb38 with identifier: MC57954
2026-03-30 07:47:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19824232-d35a-5f2f-96d9-1d79da51bb38 with identifier: MC57954
2026-03-30 07:47:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19824232-d35a-5f2f-96d9-1d79da51bb38 with identifier: MC57954 to the API
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:46:04Z',
 'fuel_type': 'diesel',
 'id': '19824232-d35a-5f2f-96d9-1d79da51bb38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC57954',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 329350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-27',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC57954%27 HTTP/1.1" 200 None
2026-03-30 07:47:56 [auto1.de] INFO: Saving data for MC57954: {'auction_closing_time': 1774885564.0, 'created_time': 1773945880.527781, 'last_price_update_time': 1774856876.954458}
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC57954') HTTP/1.1" 204 0
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: PM25348
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: HS03842
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: BS26605
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: VV03695
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV03695%27 HTTP/1.1" 200 None
2026-03-30 07:47:56 [auto1.de] INFO: Scrape type for VV03695: 0
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: JS09258
2026-03-30 07:47:56 [auto1.de] INFO: Found listing with ID: MV92494
2026-03-30 07:47:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92494%27 HTTP/1.1" 200 None
2026-03-30 07:47:57 [auto1.de] INFO: Scrape type for MV92494: 2
2026-03-30 07:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c233d254-639a-5bce-8b33-0ea2e2e755cc with identifier: MV92494
2026-03-30 07:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c233d254-639a-5bce-8b33-0ea2e2e755cc with scrape type 2
2026-03-30 07:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c233d254-639a-5bce-8b33-0ea2e2e755cc with scrape type 2
2026-03-30 07:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c233d254-639a-5bce-8b33-0ea2e2e755cc, identifier: MV92494
2026-03-30 07:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c233d254-639a-5bce-8b33-0ea2e2e755cc with identifier: MV92494
2026-03-30 07:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c233d254-639a-5bce-8b33-0ea2e2e755cc with identifier: MV92494
2026-03-30 07:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c233d254-639a-5bce-8b33-0ea2e2e755cc with identifier: MV92494 to the API
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:55Z',
 'fuel_type': 'petrol',
 'id': 'c233d254-639a-5bce-8b33-0ea2e2e755cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV92494',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 40341,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-02',
 'seller_name': None,
 'title': 'Audi Q3 1.4 TFSI ACT Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV92494%27 HTTP/1.1" 200 None
2026-03-30 07:47:57 [auto1.de] INFO: Saving data for MV92494: {'auction_closing_time': 1774883995.0, 'created_time': 1774636852.055925, 'last_price_update_time': 1774856877.369138}
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MV92494') HTTP/1.1" 204 0
2026-03-30 07:47:57 [auto1.de] INFO: Found listing with ID: GD60404
2026-03-30 07:47:57 [auto1.de] INFO: Found listing with ID: TJ67594
2026-03-30 07:47:57 [auto1.de] INFO: Found listing with ID: TL45864
2026-03-30 07:47:57 [auto1.de] INFO: Found listing with ID: AE71125
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE71125%27 HTTP/1.1" 200 None
2026-03-30 07:47:57 [auto1.de] INFO: Scrape type for AE71125: 0
2026-03-30 07:47:57 [auto1.de] INFO: Found listing with ID: CF09149
2026-03-30 07:47:57 [auto1.de] INFO: Found listing with ID: VT43931
2026-03-30 07:47:57 [auto1.de] INFO: Found listing with ID: RP65815
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP65815%27 HTTP/1.1" 200 None
2026-03-30 07:47:57 [auto1.de] INFO: Scrape type for RP65815: 0
2026-03-30 07:47:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:47:57 [auto1.de] INFO: Channel: 24h | Page: 141 | totalHits: 8397 | hits on page: 40
2026-03-30 07:47:57 [auto1.de] INFO: Found listing with ID: MJ41620
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41620%27 HTTP/1.1" 200 None
2026-03-30 07:47:57 [auto1.de] INFO: Scrape type for MJ41620: 2
2026-03-30 07:47:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39b4b464-4495-593f-9b21-f2a6f1f3f373 with identifier: MJ41620
2026-03-30 07:47:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39b4b464-4495-593f-9b21-f2a6f1f3f373 with scrape type 2
2026-03-30 07:47:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39b4b464-4495-593f-9b21-f2a6f1f3f373 with scrape type 2
2026-03-30 07:47:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39b4b464-4495-593f-9b21-f2a6f1f3f373, identifier: MJ41620
2026-03-30 07:47:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39b4b464-4495-593f-9b21-f2a6f1f3f373 with identifier: MJ41620
2026-03-30 07:47:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39b4b464-4495-593f-9b21-f2a6f1f3f373 with identifier: MJ41620
2026-03-30 07:47:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39b4b464-4495-593f-9b21-f2a6f1f3f373 with identifier: MJ41620 to the API
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:52:09Z',
 'fuel_type': 'diesel',
 'id': '39b4b464-4495-593f-9b21-f2a6f1f3f373',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ41620',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 149305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-07',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ41620%27 HTTP/1.1" 200 None
2026-03-30 07:47:58 [auto1.de] INFO: Saving data for MJ41620: {'auction_closing_time': 1774885929.0, 'created_time': 1773402366.329151, 'last_price_update_time': 1774856878.031809}
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ41620') HTTP/1.1" 204 0
2026-03-30 07:47:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:47:58 [auto1.de] INFO: Found listing with ID: GV28684
2026-03-30 07:47:58 [auto1.de] INFO: Found listing with ID: HV65540
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV65540%27 HTTP/1.1" 200 None
2026-03-30 07:47:58 [auto1.de] INFO: Scrape type for HV65540: 2
2026-03-30 07:47:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0e1299d-5143-5bb5-afc7-fce8fa4e8455 with identifier: HV65540
2026-03-30 07:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0e1299d-5143-5bb5-afc7-fce8fa4e8455 with scrape type 2
2026-03-30 07:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0e1299d-5143-5bb5-afc7-fce8fa4e8455 with scrape type 2
2026-03-30 07:47:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0e1299d-5143-5bb5-afc7-fce8fa4e8455, identifier: HV65540
2026-03-30 07:47:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0e1299d-5143-5bb5-afc7-fce8fa4e8455 with identifier: HV65540
2026-03-30 07:47:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0e1299d-5143-5bb5-afc7-fce8fa4e8455 with identifier: HV65540
2026-03-30 07:47:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0e1299d-5143-5bb5-afc7-fce8fa4e8455 with identifier: HV65540 to the API
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:11:36Z',
 'fuel_type': 'hybrid',
 'id': 'b0e1299d-5143-5bb5-afc7-fce8fa4e8455',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV65540',
 'listing': 'auction',
 'make': 'GWM',
 'model': 'Wey 03',
 'odometer': 29365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-28',
 'seller_name': None,
 'title': 'GWM Wey 03 2.0 PHEV FWD Premium',
 'transmission': 'automatic',
 'trim': 'FWD Premium',
 'year': 2024}
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV65540%27 HTTP/1.1" 200 None
2026-03-30 07:47:58 [auto1.de] INFO: Saving data for HV65540: {'auction_closing_time': 1774883496.0, 'created_time': 1774639594.979237, 'last_price_update_time': 1774856878.434701}
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV65540') HTTP/1.1" 204 0
2026-03-30 07:47:58 [auto1.de] INFO: Found listing with ID: TS05974
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS05974%27 HTTP/1.1" 200 None
2026-03-30 07:47:58 [auto1.de] INFO: Scrape type for TS05974: 2
2026-03-30 07:47:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8612791b-1e68-5a97-897e-bc19bf28b877 with identifier: TS05974
2026-03-30 07:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8612791b-1e68-5a97-897e-bc19bf28b877 with scrape type 2
2026-03-30 07:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8612791b-1e68-5a97-897e-bc19bf28b877 with scrape type 2
2026-03-30 07:47:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8612791b-1e68-5a97-897e-bc19bf28b877, identifier: TS05974
2026-03-30 07:47:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8612791b-1e68-5a97-897e-bc19bf28b877 with identifier: TS05974
2026-03-30 07:47:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8612791b-1e68-5a97-897e-bc19bf28b877 with identifier: TS05974
2026-03-30 07:47:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8612791b-1e68-5a97-897e-bc19bf28b877 with identifier: TS05974 to the API
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:59:12Z',
 'fuel_type': 'diesel',
 'id': '8612791b-1e68-5a97-897e-bc19bf28b877',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS05974',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 213509,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-26',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2015}
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS05974%27 HTTP/1.1" 200 None
2026-03-30 07:47:58 [auto1.de] INFO: Saving data for TS05974: {'auction_closing_time': 1774886352.0, 'created_time': 1773946817.812079, 'last_price_update_time': 1774856878.839172}
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS05974') HTTP/1.1" 204 0
2026-03-30 07:47:58 [auto1.de] INFO: Found listing with ID: ME33936
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME33936%27 HTTP/1.1" 200 None
2026-03-30 07:47:58 [auto1.de] INFO: Scrape type for ME33936: 2
2026-03-30 07:47:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41b434b9-8b61-5466-bae7-3979d0c659c4 with identifier: ME33936
2026-03-30 07:47:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41b434b9-8b61-5466-bae7-3979d0c659c4 with scrape type 2
2026-03-30 07:47:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41b434b9-8b61-5466-bae7-3979d0c659c4 with scrape type 2
2026-03-30 07:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41b434b9-8b61-5466-bae7-3979d0c659c4, identifier: ME33936
2026-03-30 07:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41b434b9-8b61-5466-bae7-3979d0c659c4 with identifier: ME33936
2026-03-30 07:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41b434b9-8b61-5466-bae7-3979d0c659c4 with identifier: ME33936
2026-03-30 07:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41b434b9-8b61-5466-bae7-3979d0c659c4 with identifier: ME33936 to the API
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:24:58Z',
 'fuel_type': 'diesel',
 'id': '41b434b9-8b61-5466-bae7-3979d0c659c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME33936',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 197342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-25',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2015}
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME33936%27 HTTP/1.1" 200 None
2026-03-30 07:47:59 [auto1.de] INFO: Saving data for ME33936: {'auction_closing_time': 1774884298.0, 'created_time': 1774638655.8772, 'last_price_update_time': 1774856879.333243}
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME33936') HTTP/1.1" 204 0
2026-03-30 07:47:59 [auto1.de] INFO: Found listing with ID: YS13064
2026-03-30 07:47:59 [auto1.de] INFO: Found listing with ID: CU80256
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU80256%27 HTTP/1.1" 200 None
2026-03-30 07:47:59 [auto1.de] INFO: Scrape type for CU80256: 2
2026-03-30 07:47:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 357c35ca-15d5-597d-adde-8e22a6de2163 with identifier: CU80256
2026-03-30 07:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 357c35ca-15d5-597d-adde-8e22a6de2163 with scrape type 2
2026-03-30 07:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 357c35ca-15d5-597d-adde-8e22a6de2163 with scrape type 2
2026-03-30 07:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 357c35ca-15d5-597d-adde-8e22a6de2163, identifier: CU80256
2026-03-30 07:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 357c35ca-15d5-597d-adde-8e22a6de2163 with identifier: CU80256
2026-03-30 07:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 357c35ca-15d5-597d-adde-8e22a6de2163 with identifier: CU80256
2026-03-30 07:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 357c35ca-15d5-597d-adde-8e22a6de2163 with identifier: CU80256 to the API
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:47:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:17:17Z',
 'fuel_type': 'petrol',
 'id': '357c35ca-15d5-597d-adde-8e22a6de2163',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU80256',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Omega',
 'odometer': 149377,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-07-13',
 'seller_name': None,
 'title': 'Opel Omega 2.0 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 1997}
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU80256%27 HTTP/1.1" 200 None
2026-03-30 07:47:59 [auto1.de] INFO: Saving data for CU80256: {'auction_closing_time': 1774883837.0, 'created_time': 1773304968.335324, 'last_price_update_time': 1774856879.750831}
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU80256') HTTP/1.1" 204 0
2026-03-30 07:47:59 [auto1.de] INFO: Found listing with ID: NH86896
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH86896%27 HTTP/1.1" 200 None
2026-03-30 07:47:59 [auto1.de] INFO: Scrape type for NH86896: 2
2026-03-30 07:47:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a76e71f-40f8-54ba-bc5f-29de7dadb531 with identifier: NH86896
2026-03-30 07:47:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a76e71f-40f8-54ba-bc5f-29de7dadb531 with scrape type 2
2026-03-30 07:47:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a76e71f-40f8-54ba-bc5f-29de7dadb531 with scrape type 2
2026-03-30 07:47:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6a76e71f-40f8-54ba-bc5f-29de7dadb531, identifier: NH86896
2026-03-30 07:47:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6a76e71f-40f8-54ba-bc5f-29de7dadb531 with identifier: NH86896
2026-03-30 07:47:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6a76e71f-40f8-54ba-bc5f-29de7dadb531 with identifier: NH86896
2026-03-30 07:47:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6a76e71f-40f8-54ba-bc5f-29de7dadb531 with identifier: NH86896 to the API
2026-03-30 07:47:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:47:07Z',
 'fuel_type': 'petrol',
 'id': '6a76e71f-40f8-54ba-bc5f-29de7dadb531',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH86896',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 120266,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-19',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2018}
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH86896%27 HTTP/1.1" 200 None
2026-03-30 07:48:00 [auto1.de] INFO: Saving data for NH86896: {'auction_closing_time': 1774885627.0, 'created_time': 1774639665.496142, 'last_price_update_time': 1774856880.197706}
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH86896') HTTP/1.1" 204 0
2026-03-30 07:48:00 [auto1.de] INFO: Found listing with ID: DG19497
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG19497%27 HTTP/1.1" 200 None
2026-03-30 07:48:00 [auto1.de] INFO: Scrape type for DG19497: 0
2026-03-30 07:48:00 [auto1.de] INFO: Found listing with ID: MU47356
2026-03-30 07:48:00 [auto1.de] INFO: Found listing with ID: WV38848
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV38848%27 HTTP/1.1" 200 None
2026-03-30 07:48:00 [auto1.de] INFO: Scrape type for WV38848: 2
2026-03-30 07:48:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with identifier: WV38848
2026-03-30 07:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with scrape type 2
2026-03-30 07:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with scrape type 2
2026-03-30 07:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f569cbb2-3e4d-5bb1-983d-a9a4e9644e84, identifier: WV38848
2026-03-30 07:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with identifier: WV38848
2026-03-30 07:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with identifier: WV38848
2026-03-30 07:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f569cbb2-3e4d-5bb1-983d-a9a4e9644e84 with identifier: WV38848 to the API
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:42:37Z',
 'fuel_type': 'diesel',
 'id': 'f569cbb2-3e4d-5bb1-983d-a9a4e9644e84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV38848',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 110095,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-12',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t',
 'year': 2016}
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV38848%27 HTTP/1.1" 200 None
2026-03-30 07:48:00 [auto1.de] INFO: Saving data for WV38848: {'auction_closing_time': 1774885357.0, 'created_time': 1774551666.419073, 'last_price_update_time': 1774856880.664919}
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV38848') HTTP/1.1" 204 0
2026-03-30 07:48:00 [auto1.de] INFO: Found listing with ID: CB80286
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB80286%27 HTTP/1.1" 200 None
2026-03-30 07:48:00 [auto1.de] INFO: Scrape type for CB80286: 0
2026-03-30 07:48:00 [auto1.de] INFO: Found listing with ID: RH59786
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH59786%27 HTTP/1.1" 200 None
2026-03-30 07:48:00 [auto1.de] INFO: Scrape type for RH59786: 0
2026-03-30 07:48:00 [auto1.de] INFO: Found listing with ID: VJ59637
2026-03-30 07:48:00 [auto1.de] INFO: Found listing with ID: UU53643
2026-03-30 07:48:00 [auto1.de] INFO: Found listing with ID: LG97713
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG97713%27 HTTP/1.1" 200 None
2026-03-30 07:48:00 [auto1.de] INFO: Scrape type for LG97713: 0
2026-03-30 07:48:00 [auto1.de] INFO: Found listing with ID: HN24396
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN24396%27 HTTP/1.1" 200 None
2026-03-30 07:48:00 [auto1.de] INFO: Scrape type for HN24396: 2
2026-03-30 07:48:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396
2026-03-30 07:48:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79081c0b-3212-5214-9001-bae5c3b59581 with scrape type 2
2026-03-30 07:48:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79081c0b-3212-5214-9001-bae5c3b59581 with scrape type 2
2026-03-30 07:48:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 79081c0b-3212-5214-9001-bae5c3b59581, identifier: HN24396
2026-03-30 07:48:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396
2026-03-30 07:48:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396
2026-03-30 07:48:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 79081c0b-3212-5214-9001-bae5c3b59581 with identifier: HN24396 to the API
2026-03-30 07:48:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:25:29Z',
 'fuel_type': 'petrol',
 'id': '79081c0b-3212-5214-9001-bae5c3b59581',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN24396',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 40182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-18',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'automatic',
 'trim': 'Filou',
 'year': 2009}
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN24396%27 HTTP/1.1" 200 None
2026-03-30 07:48:01 [auto1.de] INFO: Saving data for HN24396: {'auction_closing_time': 1774884329.0, 'created_time': 1773917498.774471, 'last_price_update_time': 1774856881.143792}
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN24396') HTTP/1.1" 204 0
2026-03-30 07:48:01 [auto1.de] INFO: Found listing with ID: RX21744
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX21744%27 HTTP/1.1" 200 None
2026-03-30 07:48:01 [auto1.de] INFO: Scrape type for RX21744: 0
2026-03-30 07:48:01 [auto1.de] INFO: Found listing with ID: PS84197
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS84197%27 HTTP/1.1" 200 None
2026-03-30 07:48:01 [auto1.de] INFO: Scrape type for PS84197: 2
2026-03-30 07:48:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98934b3a-2769-5430-8a5f-f5accb82988d with identifier: PS84197
2026-03-30 07:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98934b3a-2769-5430-8a5f-f5accb82988d with scrape type 2
2026-03-30 07:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 98934b3a-2769-5430-8a5f-f5accb82988d with scrape type 2
2026-03-30 07:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 98934b3a-2769-5430-8a5f-f5accb82988d, identifier: PS84197
2026-03-30 07:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 98934b3a-2769-5430-8a5f-f5accb82988d with identifier: PS84197
2026-03-30 07:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 98934b3a-2769-5430-8a5f-f5accb82988d with identifier: PS84197
2026-03-30 07:48:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 98934b3a-2769-5430-8a5f-f5accb82988d with identifier: PS84197 to the API
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:45:34Z',
 'fuel_type': 'diesel',
 'id': '98934b3a-2769-5430-8a5f-f5accb82988d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS84197',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'ProAce',
 'odometer': 290578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-20',
 'seller_name': None,
 'title': 'Toyota ProAce 2.0 D-4D L2 Kasten Comfort',
 'transmission': 'automatic',
 'trim': 'L2 Kasten Comfort',
 'year': 2017}
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS84197%27 HTTP/1.1" 200 None
2026-03-30 07:48:01 [auto1.de] INFO: Saving data for PS84197: {'auction_closing_time': 1774885534.0, 'created_time': 1774639832.18342, 'last_price_update_time': 1774856881.696902}
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PS84197') HTTP/1.1" 204 0
2026-03-30 07:48:01 [auto1.de] INFO: Found listing with ID: VL16221
2026-03-30 07:48:01 [auto1.de] INFO: Found listing with ID: KD49468
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD49468%27 HTTP/1.1" 200 None
2026-03-30 07:48:01 [auto1.de] INFO: Scrape type for KD49468: 0
2026-03-30 07:48:01 [auto1.de] INFO: Found listing with ID: MV56275
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV56275%27 HTTP/1.1" 200 None
2026-03-30 07:48:01 [auto1.de] INFO: Scrape type for MV56275: 0
2026-03-30 07:48:01 [auto1.de] INFO: Found listing with ID: MF02392
2026-03-30 07:48:01 [auto1.de] INFO: Found listing with ID: AH95980
2026-03-30 07:48:01 [auto1.de] INFO: Found listing with ID: UD17279
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD17279%27 HTTP/1.1" 200 None
2026-03-30 07:48:01 [auto1.de] INFO: Scrape type for UD17279: 0
2026-03-30 07:48:01 [auto1.de] INFO: Found listing with ID: UR77332
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UR77332%27 HTTP/1.1" 200 None
2026-03-30 07:48:01 [auto1.de] INFO: Scrape type for UR77332: 0
2026-03-30 07:48:01 [auto1.de] INFO: Found listing with ID: MR73613
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73613%27 HTTP/1.1" 200 None
2026-03-30 07:48:01 [auto1.de] INFO: Scrape type for MR73613: 2
2026-03-30 07:48:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e98ad0aa-5275-5c54-8aec-76a4f1cce49c with identifier: MR73613
2026-03-30 07:48:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e98ad0aa-5275-5c54-8aec-76a4f1cce49c with scrape type 2
2026-03-30 07:48:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e98ad0aa-5275-5c54-8aec-76a4f1cce49c with scrape type 2
2026-03-30 07:48:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e98ad0aa-5275-5c54-8aec-76a4f1cce49c, identifier: MR73613
2026-03-30 07:48:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e98ad0aa-5275-5c54-8aec-76a4f1cce49c with identifier: MR73613
2026-03-30 07:48:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e98ad0aa-5275-5c54-8aec-76a4f1cce49c with identifier: MR73613
2026-03-30 07:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e98ad0aa-5275-5c54-8aec-76a4f1cce49c with identifier: MR73613 to the API
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:05:24Z',
 'fuel_type': 'diesel',
 'id': 'e98ad0aa-5275-5c54-8aec-76a4f1cce49c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR73613',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 270082,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-06',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 CDI T BlueEfficiency Avantgarde',
 'transmission': 'manual',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2012}
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR73613%27 HTTP/1.1" 200 None
2026-03-30 07:48:02 [auto1.de] INFO: Saving data for MR73613: {'auction_closing_time': 1774883124.0, 'created_time': 1773382845.047659, 'last_price_update_time': 1774856882.20515}
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR73613') HTTP/1.1" 204 0
2026-03-30 07:48:02 [auto1.de] INFO: Found listing with ID: AG53647
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG53647%27 HTTP/1.1" 200 None
2026-03-30 07:48:02 [auto1.de] INFO: Scrape type for AG53647: 0
2026-03-30 07:48:02 [auto1.de] INFO: Found listing with ID: NX28269
2026-03-30 07:48:02 [auto1.de] INFO: Found listing with ID: TE18178
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE18178%27 HTTP/1.1" 200 None
2026-03-30 07:48:02 [auto1.de] INFO: Scrape type for TE18178: 0
2026-03-30 07:48:02 [auto1.de] INFO: Found listing with ID: SZ56060
2026-03-30 07:48:02 [auto1.de] INFO: Found listing with ID: YD00860
2026-03-30 07:48:02 [auto1.de] INFO: Found listing with ID: DH44526
2026-03-30 07:48:02 [auto1.de] INFO: Found listing with ID: PC60688
2026-03-30 07:48:02 [auto1.de] INFO: Found listing with ID: TA92521
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA92521%27 HTTP/1.1" 200 None
2026-03-30 07:48:02 [auto1.de] INFO: Scrape type for TA92521: 2
2026-03-30 07:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af635ecd-a39d-50aa-a968-e8fe2884694f with identifier: TA92521
2026-03-30 07:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af635ecd-a39d-50aa-a968-e8fe2884694f with scrape type 2
2026-03-30 07:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af635ecd-a39d-50aa-a968-e8fe2884694f with scrape type 2
2026-03-30 07:48:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af635ecd-a39d-50aa-a968-e8fe2884694f, identifier: TA92521
2026-03-30 07:48:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af635ecd-a39d-50aa-a968-e8fe2884694f with identifier: TA92521
2026-03-30 07:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af635ecd-a39d-50aa-a968-e8fe2884694f with identifier: TA92521
2026-03-30 07:48:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af635ecd-a39d-50aa-a968-e8fe2884694f with identifier: TA92521 to the API
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:54:57Z',
 'fuel_type': 'petrol',
 'id': 'af635ecd-a39d-50aa-a968-e8fe2884694f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA92521',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'S60',
 'odometer': 154067,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-06',
 'seller_name': None,
 'title': 'Volvo S60 1.6 T4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2011}
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA92521%27 HTTP/1.1" 200 None
2026-03-30 07:48:02 [auto1.de] INFO: Saving data for TA92521: {'auction_closing_time': 1774886097.0, 'created_time': 1774639831.407765, 'last_price_update_time': 1774856882.71605}
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TA92521') HTTP/1.1" 204 0
2026-03-30 07:48:02 [auto1.de] INFO: Found listing with ID: JM70147
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM70147%27 HTTP/1.1" 200 None
2026-03-30 07:48:02 [auto1.de] INFO: Scrape type for JM70147: 2
2026-03-30 07:48:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with identifier: JM70147
2026-03-30 07:48:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with scrape type 2
2026-03-30 07:48:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with scrape type 2
2026-03-30 07:48:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed7e6a5f-2cdd-5892-b866-d307ed17d9f8, identifier: JM70147
2026-03-30 07:48:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with identifier: JM70147
2026-03-30 07:48:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with identifier: JM70147
2026-03-30 07:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed7e6a5f-2cdd-5892-b866-d307ed17d9f8 with identifier: JM70147 to the API
2026-03-30 07:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:49:12Z',
 'fuel_type': 'petrol',
 'id': 'ed7e6a5f-2cdd-5892-b866-d307ed17d9f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM70147',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 64942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-02-15',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2006}
2026-03-30 07:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM70147%27 HTTP/1.1" 200 None
2026-03-30 07:48:03 [auto1.de] INFO: Saving data for JM70147: {'auction_closing_time': 1774885752.0, 'created_time': 1774553075.941197, 'last_price_update_time': 1774856883.329656}
2026-03-30 07:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM70147') HTTP/1.1" 204 0
2026-03-30 07:48:03 [auto1.de] INFO: Found listing with ID: GZ76571
2026-03-30 07:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76571%27 HTTP/1.1" 200 None
2026-03-30 07:48:03 [auto1.de] INFO: Scrape type for GZ76571: 2
2026-03-30 07:48:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with identifier: GZ76571
2026-03-30 07:48:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with scrape type 2
2026-03-30 07:48:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with scrape type 2
2026-03-30 07:48:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0, identifier: GZ76571
2026-03-30 07:48:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with identifier: GZ76571
2026-03-30 07:48:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with identifier: GZ76571
2026-03-30 07:48:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0 with identifier: GZ76571 to the API
2026-03-30 07:48:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:45:26Z',
 'fuel_type': 'diesel',
 'id': '6ce2912b-ae61-51f6-8f1d-8dfd8aa459b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ76571',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Freemont',
 'odometer': 193302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-05',
 'seller_name': None,
 'title': 'Fiat Freemont 2.0 Multijet Urban',
 'transmission': 'manual',
 'trim': 'Urban',
 'year': 2013}
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ76571%27 HTTP/1.1" 200 None
2026-03-30 07:48:04 [auto1.de] INFO: Saving data for GZ76571: {'auction_closing_time': 1774885526.0, 'created_time': 1774552971.118067, 'last_price_update_time': 1774856884.069082}
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ76571') HTTP/1.1" 204 0
2026-03-30 07:48:04 [auto1.de] INFO: Channel: 24h | Page: 142 | totalHits: 8399 | hits on page: 40
2026-03-30 07:48:04 [auto1.de] INFO: Found listing with ID: RN25126
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN25126%27 HTTP/1.1" 200 None
2026-03-30 07:48:04 [auto1.de] INFO: Scrape type for RN25126: 2
2026-03-30 07:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c11402c-90a6-5a04-85d6-53bb7159c0b5 with identifier: RN25126
2026-03-30 07:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c11402c-90a6-5a04-85d6-53bb7159c0b5 with scrape type 2
2026-03-30 07:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c11402c-90a6-5a04-85d6-53bb7159c0b5 with scrape type 2
2026-03-30 07:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c11402c-90a6-5a04-85d6-53bb7159c0b5, identifier: RN25126
2026-03-30 07:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c11402c-90a6-5a04-85d6-53bb7159c0b5 with identifier: RN25126
2026-03-30 07:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c11402c-90a6-5a04-85d6-53bb7159c0b5 with identifier: RN25126
2026-03-30 07:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c11402c-90a6-5a04-85d6-53bb7159c0b5 with identifier: RN25126 to the API
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 275,
 'expiration_date': '2026-03-30T15:58:16Z',
 'fuel_type': 'petrol',
 'id': '8c11402c-90a6-5a04-85d6-53bb7159c0b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RN25126',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 55136,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-27',
 'seller_name': None,
 'title': 'Hyundai i30 2.0 TGDI N Performance',
 'transmission': 'manual',
 'trim': 'N Performance',
 'year': 2020}
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN25126%27 HTTP/1.1" 200 None
2026-03-30 07:48:04 [auto1.de] INFO: Saving data for RN25126: {'auction_closing_time': 1774886296.0, 'created_time': 1774639689.653731, 'last_price_update_time': 1774856884.557256}
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RN25126') HTTP/1.1" 204 0
2026-03-30 07:48:04 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS16825%27 HTTP/1.1" 200 None
2026-03-30 07:48:04 [auto1.de] INFO: Scrape type for NS16825: 2
2026-03-30 07:48:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72 with identifier: NS16825
2026-03-30 07:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72 with scrape type 2
2026-03-30 07:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72 with scrape type 2
2026-03-30 07:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72, identifier: NS16825
2026-03-30 07:48:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:48:04 [auto1.de] INFO: Found listing with ID: NS16825
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS16825%27 HTTP/1.1" 200 None
2026-03-30 07:48:04 [auto1.de] INFO: Scrape type for NS16825: 2
2026-03-30 07:48:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72 with scrape type 2
2026-03-30 07:48:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72 with scrape type 2
2026-03-30 07:48:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72, identifier: NS16825
2026-03-30 07:48:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72 with identifier: NS16825
2026-03-30 07:48:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72 with identifier: NS16825
2026-03-30 07:48:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72 with identifier: NS16825 to the API
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:15:49Z',
 'fuel_type': 'petrol',
 'id': '607b2fb1-bb59-5cc5-b246-a8ceb5b15e72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS16825',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 154526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-28',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Connection',
 'transmission': 'manual',
 'trim': 'Connection',
 'year': 2007}
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS16825%27 HTTP/1.1" 200 None
2026-03-30 07:48:05 [auto1.de] INFO: Saving data for NS16825: {'auction_closing_time': 1774883749.0, 'created_time': 1774550214.790449, 'last_price_update_time': 1774856885.091926}
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS16825') HTTP/1.1" 204 0
2026-03-30 07:48:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72 with identifier: NS16825
2026-03-30 07:48:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72 with identifier: NS16825
2026-03-30 07:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 607b2fb1-bb59-5cc5-b246-a8ceb5b15e72 with identifier: NS16825 to the API
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:15:49Z',
 'fuel_type': 'petrol',
 'id': '607b2fb1-bb59-5cc5-b246-a8ceb5b15e72',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS16825',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 154526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-28',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Connection',
 'transmission': 'manual',
 'trim': 'Connection',
 'year': 2007}
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NS16825%27 HTTP/1.1" 200 None
2026-03-30 07:48:05 [auto1.de] INFO: Saving data for NS16825: {'auction_closing_time': 1774883749.0, 'created_time': 1774550214.790449, 'last_price_update_time': 1774856885.37578}
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NS16825') HTTP/1.1" 204 0
2026-03-30 07:48:05 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-30 07:48:05 [auto1.de] INFO: Scrape type for HD52891: 0
2026-03-30 07:48:05 [auto1.de] INFO: Found listing with ID: XM62598
2026-03-30 07:48:05 [auto1.de] INFO: Found listing with ID: LA13205
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA13205%27 HTTP/1.1" 200 None
2026-03-30 07:48:05 [auto1.de] INFO: Scrape type for LA13205: 0
2026-03-30 07:48:05 [auto1.de] INFO: Found listing with ID: TA95211
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA95211%27 HTTP/1.1" 200 None
2026-03-30 07:48:05 [auto1.de] INFO: Scrape type for TA95211: 0
2026-03-30 07:48:05 [auto1.de] INFO: Found listing with ID: MG28857
2026-03-30 07:48:05 [auto1.de] INFO: Found listing with ID: JK60563
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK60563%27 HTTP/1.1" 200 None
2026-03-30 07:48:05 [auto1.de] INFO: Scrape type for JK60563: 0
2026-03-30 07:48:05 [auto1.de] INFO: Found listing with ID: CP73203
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP73203%27 HTTP/1.1" 200 None
2026-03-30 07:48:05 [auto1.de] INFO: Scrape type for CP73203: 2
2026-03-30 07:48:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0c82589-57b1-500a-a6db-4838ecb884cc with identifier: CP73203
2026-03-30 07:48:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0c82589-57b1-500a-a6db-4838ecb884cc with scrape type 2
2026-03-30 07:48:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0c82589-57b1-500a-a6db-4838ecb884cc with scrape type 2
2026-03-30 07:48:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0c82589-57b1-500a-a6db-4838ecb884cc, identifier: CP73203
2026-03-30 07:48:05 [auto1.de] INFO: Found listing with ID: HD52891
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD52891%27 HTTP/1.1" 200 None
2026-03-30 07:48:05 [auto1.de] INFO: Scrape type for HD52891: 0
2026-03-30 07:48:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0c82589-57b1-500a-a6db-4838ecb884cc with identifier: CP73203
2026-03-30 07:48:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0c82589-57b1-500a-a6db-4838ecb884cc with identifier: CP73203
2026-03-30 07:48:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0c82589-57b1-500a-a6db-4838ecb884cc with identifier: CP73203 to the API
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:55Z',
 'fuel_type': 'petrol',
 'id': 'a0c82589-57b1-500a-a6db-4838ecb884cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP73203',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 112809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-19',
 'seller_name': None,
 'title': 'BMW X1 sDrive 18i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP73203%27 HTTP/1.1" 200 None
2026-03-30 07:48:05 [auto1.de] INFO: Saving data for CP73203: {'auction_closing_time': 1774883395.0, 'created_time': 1773831703.081645, 'last_price_update_time': 1774856885.877175}
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP73203') HTTP/1.1" 204 0
2026-03-30 07:48:05 [auto1.de] INFO: Found listing with ID: UN86111
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN86111%27 HTTP/1.1" 200 None
2026-03-30 07:48:06 [auto1.de] INFO: Scrape type for UN86111: 2
2026-03-30 07:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with identifier: UN86111
2026-03-30 07:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with scrape type 2
2026-03-30 07:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with scrape type 2
2026-03-30 07:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff, identifier: UN86111
2026-03-30 07:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with identifier: UN86111
2026-03-30 07:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with identifier: UN86111
2026-03-30 07:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff with identifier: UN86111 to the API
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:40Z',
 'fuel_type': 'petrol',
 'id': '3694b3a5-c56f-56f7-bdc0-9192ad3bb0ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UN86111',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ateca',
 'odometer': 124942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-18',
 'seller_name': None,
 'title': 'Seat Ateca 1.5 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2019}
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN86111%27 HTTP/1.1" 200 None
2026-03-30 07:48:06 [auto1.de] INFO: Saving data for UN86111: {'auction_closing_time': 1774886080.0, 'created_time': 1774552904.516319, 'last_price_update_time': 1774856886.383571}
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UN86111') HTTP/1.1" 204 0
2026-03-30 07:48:06 [auto1.de] INFO: Found listing with ID: KJ44451
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ44451%27 HTTP/1.1" 200 None
2026-03-30 07:48:06 [auto1.de] INFO: Scrape type for KJ44451: 0
2026-03-30 07:48:06 [auto1.de] INFO: Found listing with ID: LR06917
2026-03-30 07:48:06 [auto1.de] INFO: Found listing with ID: GP13767
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP13767%27 HTTP/1.1" 200 None
2026-03-30 07:48:06 [auto1.de] INFO: Scrape type for GP13767: 2
2026-03-30 07:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a46b005e-5b79-5f79-939e-19efe26fe8cc with identifier: GP13767
2026-03-30 07:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a46b005e-5b79-5f79-939e-19efe26fe8cc with scrape type 2
2026-03-30 07:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a46b005e-5b79-5f79-939e-19efe26fe8cc with scrape type 2
2026-03-30 07:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a46b005e-5b79-5f79-939e-19efe26fe8cc, identifier: GP13767
2026-03-30 07:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a46b005e-5b79-5f79-939e-19efe26fe8cc with identifier: GP13767
2026-03-30 07:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a46b005e-5b79-5f79-939e-19efe26fe8cc with identifier: GP13767
2026-03-30 07:48:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a46b005e-5b79-5f79-939e-19efe26fe8cc with identifier: GP13767 to the API
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:07:26Z',
 'fuel_type': 'hybrid',
 'id': 'a46b005e-5b79-5f79-939e-19efe26fe8cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP13767',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Formentor',
 'odometer': 3650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-23',
 'seller_name': None,
 'title': 'Cupra Formentor 1.4 e-HYBRID VZ',
 'transmission': 'automatic',
 'trim': 'VZ',
 'year': 2021}
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP13767%27 HTTP/1.1" 200 None
2026-03-30 07:48:06 [auto1.de] INFO: Saving data for GP13767: {'auction_closing_time': 1774883246.0, 'created_time': 1774676128.247243, 'last_price_update_time': 1774856886.805469}
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GP13767') HTTP/1.1" 204 0
2026-03-30 07:48:06 [auto1.de] INFO: Found listing with ID: YZ29676
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ29676%27 HTTP/1.1" 200 None
2026-03-30 07:48:06 [auto1.de] INFO: Scrape type for YZ29676: 2
2026-03-30 07:48:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64df7030-8269-5525-b33d-5146d2e7c9cd with identifier: YZ29676
2026-03-30 07:48:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64df7030-8269-5525-b33d-5146d2e7c9cd with scrape type 2
2026-03-30 07:48:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64df7030-8269-5525-b33d-5146d2e7c9cd with scrape type 2
2026-03-30 07:48:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64df7030-8269-5525-b33d-5146d2e7c9cd, identifier: YZ29676
2026-03-30 07:48:06 [scrapy.extensions.logstats] INFO: Crawled 338 pages (at 11 pages/min), scraped 999 items (at 104 items/min)
2026-03-30 07:48:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:48:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64df7030-8269-5525-b33d-5146d2e7c9cd with identifier: YZ29676
2026-03-30 07:48:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64df7030-8269-5525-b33d-5146d2e7c9cd with identifier: YZ29676
2026-03-30 07:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64df7030-8269-5525-b33d-5146d2e7c9cd with identifier: YZ29676 to the API
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:51:36Z',
 'fuel_type': 'petrol',
 'id': '64df7030-8269-5525-b33d-5146d2e7c9cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ29676',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 67866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-20',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2021}
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ29676%27 HTTP/1.1" 200 None
2026-03-30 07:48:07 [auto1.de] INFO: Saving data for YZ29676: {'auction_closing_time': 1774885896.0, 'created_time': 1774550938.158475, 'last_price_update_time': 1774856887.255242}
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ29676') HTTP/1.1" 204 0
2026-03-30 07:48:07 [auto1.de] INFO: Found listing with ID: SX22441
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX22441%27 HTTP/1.1" 200 None
2026-03-30 07:48:07 [auto1.de] INFO: Scrape type for SX22441: 2
2026-03-30 07:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1753a845-8731-58cd-b692-97baae793e3f with identifier: SX22441
2026-03-30 07:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1753a845-8731-58cd-b692-97baae793e3f with scrape type 2
2026-03-30 07:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1753a845-8731-58cd-b692-97baae793e3f with scrape type 2
2026-03-30 07:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1753a845-8731-58cd-b692-97baae793e3f, identifier: SX22441
2026-03-30 07:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1753a845-8731-58cd-b692-97baae793e3f with identifier: SX22441
2026-03-30 07:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1753a845-8731-58cd-b692-97baae793e3f with identifier: SX22441
2026-03-30 07:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1753a845-8731-58cd-b692-97baae793e3f with identifier: SX22441 to the API
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:23:28Z',
 'fuel_type': 'diesel',
 'id': '1753a845-8731-58cd-b692-97baae793e3f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX22441',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 227520,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-31',
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX22441%27 HTTP/1.1" 200 None
2026-03-30 07:48:07 [auto1.de] INFO: Saving data for SX22441: {'auction_closing_time': 1774884208.0, 'created_time': 1774550732.71703, 'last_price_update_time': 1774856887.72187}
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX22441') HTTP/1.1" 204 0
2026-03-30 07:48:07 [auto1.de] INFO: Found listing with ID: UE57150
2026-03-30 07:48:07 [auto1.de] INFO: Found listing with ID: FZ80305
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ80305%27 HTTP/1.1" 200 None
2026-03-30 07:48:07 [auto1.de] INFO: Scrape type for FZ80305: 0
2026-03-30 07:48:07 [auto1.de] INFO: Found listing with ID: FH83727
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH83727%27 HTTP/1.1" 200 None
2026-03-30 07:48:07 [auto1.de] INFO: Scrape type for FH83727: 0
2026-03-30 07:48:07 [auto1.de] INFO: Found listing with ID: VL79730
2026-03-30 07:48:07 [auto1.de] INFO: Found listing with ID: XR36805
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR36805%27 HTTP/1.1" 200 None
2026-03-30 07:48:07 [auto1.de] INFO: Scrape type for XR36805: 2
2026-03-30 07:48:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 930c76cb-4a63-5e14-8e8c-c601263e7d2b with identifier: XR36805
2026-03-30 07:48:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 930c76cb-4a63-5e14-8e8c-c601263e7d2b with scrape type 2
2026-03-30 07:48:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 930c76cb-4a63-5e14-8e8c-c601263e7d2b with scrape type 2
2026-03-30 07:48:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 930c76cb-4a63-5e14-8e8c-c601263e7d2b, identifier: XR36805
2026-03-30 07:48:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 930c76cb-4a63-5e14-8e8c-c601263e7d2b with identifier: XR36805
2026-03-30 07:48:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 930c76cb-4a63-5e14-8e8c-c601263e7d2b with identifier: XR36805
2026-03-30 07:48:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 930c76cb-4a63-5e14-8e8c-c601263e7d2b with identifier: XR36805 to the API
2026-03-30 07:48:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:09:00Z',
 'fuel_type': 'petrol',
 'id': '930c76cb-4a63-5e14-8e8c-c601263e7d2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR36805',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 120001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-14',
 'seller_name': None,
 'title': 'Dacia Sandero 1.0 TCe Stepway Celebration',
 'transmission': 'manual',
 'trim': 'Stepway Celebration',
 'year': 2021}
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR36805%27 HTTP/1.1" 200 None
2026-03-30 07:48:08 [auto1.de] INFO: Saving data for XR36805: {'auction_closing_time': 1774883340.0, 'created_time': 1774032166.720212, 'last_price_update_time': 1774856888.179011}
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR36805') HTTP/1.1" 204 0
2026-03-30 07:48:08 [auto1.de] INFO: Found listing with ID: JX01740
2026-03-30 07:48:08 [auto1.de] INFO: Found listing with ID: RU51432
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51432%27 HTTP/1.1" 200 None
2026-03-30 07:48:08 [auto1.de] INFO: Scrape type for RU51432: 2
2026-03-30 07:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 643faf7f-1931-537f-b434-8e347cc4400e with identifier: RU51432
2026-03-30 07:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 643faf7f-1931-537f-b434-8e347cc4400e with scrape type 2
2026-03-30 07:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 643faf7f-1931-537f-b434-8e347cc4400e with scrape type 2
2026-03-30 07:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 643faf7f-1931-537f-b434-8e347cc4400e, identifier: RU51432
2026-03-30 07:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 643faf7f-1931-537f-b434-8e347cc4400e with identifier: RU51432
2026-03-30 07:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 643faf7f-1931-537f-b434-8e347cc4400e with identifier: RU51432
2026-03-30 07:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 643faf7f-1931-537f-b434-8e347cc4400e with identifier: RU51432 to the API
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:58:53Z',
 'fuel_type': 'diesel',
 'id': '643faf7f-1931-537f-b434-8e347cc4400e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU51432',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 88666,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'Ford Ranger 2.2 TDCi Doppelkabine 4x4 XLT',
 'transmission': 'manual',
 'trim': 'Doppelkabine 4x4 XLT',
 'year': 2018}
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU51432%27 HTTP/1.1" 200 None
2026-03-30 07:48:08 [auto1.de] INFO: Saving data for RU51432: {'auction_closing_time': 1774886333.0, 'created_time': 1774552854.958715, 'last_price_update_time': 1774856888.707367}
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RU51432') HTTP/1.1" 204 0
2026-03-30 07:48:08 [auto1.de] INFO: Found listing with ID: BB82459
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB82459%27 HTTP/1.1" 200 None
2026-03-30 07:48:08 [auto1.de] INFO: Scrape type for BB82459: 2
2026-03-30 07:48:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770491ae-21b0-50de-9429-5b6393926a80 with identifier: BB82459
2026-03-30 07:48:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770491ae-21b0-50de-9429-5b6393926a80 with scrape type 2
2026-03-30 07:48:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 770491ae-21b0-50de-9429-5b6393926a80 with scrape type 2
2026-03-30 07:48:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 770491ae-21b0-50de-9429-5b6393926a80, identifier: BB82459
2026-03-30 07:48:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 770491ae-21b0-50de-9429-5b6393926a80 with identifier: BB82459
2026-03-30 07:48:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 770491ae-21b0-50de-9429-5b6393926a80 with identifier: BB82459
2026-03-30 07:48:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 770491ae-21b0-50de-9429-5b6393926a80 with identifier: BB82459 to the API
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:12:36Z',
 'fuel_type': 'petrol',
 'id': '770491ae-21b0-50de-9429-5b6393926a80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB82459',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 146609,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-06-28',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2001}
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB82459%27 HTTP/1.1" 200 None
2026-03-30 07:48:09 [auto1.de] INFO: Saving data for BB82459: {'auction_closing_time': 1774883556.0, 'created_time': 1774639386.999969, 'last_price_update_time': 1774856889.109105}
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB82459') HTTP/1.1" 204 0
2026-03-30 07:48:09 [auto1.de] INFO: Found listing with ID: CY50821
2026-03-30 07:48:09 [auto1.de] INFO: Found listing with ID: MV29238
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV29238%27 HTTP/1.1" 200 None
2026-03-30 07:48:09 [auto1.de] INFO: Scrape type for MV29238: 0
2026-03-30 07:48:09 [auto1.de] INFO: Found listing with ID: AP93832
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP93832%27 HTTP/1.1" 200 None
2026-03-30 07:48:09 [auto1.de] INFO: Scrape type for AP93832: 2
2026-03-30 07:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0efdbfd7-910d-53cf-a531-9e7835580472 with identifier: AP93832
2026-03-30 07:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0efdbfd7-910d-53cf-a531-9e7835580472 with scrape type 2
2026-03-30 07:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0efdbfd7-910d-53cf-a531-9e7835580472 with scrape type 2
2026-03-30 07:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0efdbfd7-910d-53cf-a531-9e7835580472, identifier: AP93832
2026-03-30 07:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0efdbfd7-910d-53cf-a531-9e7835580472 with identifier: AP93832
2026-03-30 07:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0efdbfd7-910d-53cf-a531-9e7835580472 with identifier: AP93832
2026-03-30 07:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0efdbfd7-910d-53cf-a531-9e7835580472 with identifier: AP93832 to the API
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 109,
 'expiration_date': '2026-03-30T15:56:13Z',
 'fuel_type': 'petrol',
 'id': '0efdbfd7-910d-53cf-a531-9e7835580472',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AP93832',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 69972,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-14',
 'seller_name': None,
 'title': 'BMW 2er 216i Gran Tourer Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2020}
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP93832%27 HTTP/1.1" 200 None
2026-03-30 07:48:09 [auto1.de] INFO: Saving data for AP93832: {'auction_closing_time': 1774886173.0, 'created_time': 1774637689.633256, 'last_price_update_time': 1774856889.579883}
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AP93832') HTTP/1.1" 204 0
2026-03-30 07:48:09 [auto1.de] INFO: Found listing with ID: NA20314
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA20314%27 HTTP/1.1" 200 None
2026-03-30 07:48:09 [auto1.de] INFO: Scrape type for NA20314: 0
2026-03-30 07:48:09 [auto1.de] INFO: Found listing with ID: BD98070
2026-03-30 07:48:09 [auto1.de] INFO: Found listing with ID: LF39104
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF39104%27 HTTP/1.1" 200 None
2026-03-30 07:48:09 [auto1.de] INFO: Scrape type for LF39104: 2
2026-03-30 07:48:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0fbda17-80b9-51d8-a074-d35483eb388e with identifier: LF39104
2026-03-30 07:48:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0fbda17-80b9-51d8-a074-d35483eb388e with scrape type 2
2026-03-30 07:48:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0fbda17-80b9-51d8-a074-d35483eb388e with scrape type 2
2026-03-30 07:48:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0fbda17-80b9-51d8-a074-d35483eb388e, identifier: LF39104
2026-03-30 07:48:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0fbda17-80b9-51d8-a074-d35483eb388e with identifier: LF39104
2026-03-30 07:48:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0fbda17-80b9-51d8-a074-d35483eb388e with identifier: LF39104
2026-03-30 07:48:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0fbda17-80b9-51d8-a074-d35483eb388e with identifier: LF39104 to the API
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:57:53Z',
 'fuel_type': 'petrol',
 'id': 'd0fbda17-80b9-51d8-a074-d35483eb388e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF39104',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 175159,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF39104%27 HTTP/1.1" 200 None
2026-03-30 07:48:10 [auto1.de] INFO: Saving data for LF39104: {'auction_closing_time': 1774886273.0, 'created_time': 1773380387.460693, 'last_price_update_time': 1774856890.051452}
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LF39104') HTTP/1.1" 204 0
2026-03-30 07:48:10 [auto1.de] INFO: Found listing with ID: VC16092
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC16092%27 HTTP/1.1" 200 None
2026-03-30 07:48:10 [auto1.de] INFO: Scrape type for VC16092: 2
2026-03-30 07:48:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 140f4dbc-1088-5ff6-b20a-d0c4922e33f5 with identifier: VC16092
2026-03-30 07:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 140f4dbc-1088-5ff6-b20a-d0c4922e33f5 with scrape type 2
2026-03-30 07:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 140f4dbc-1088-5ff6-b20a-d0c4922e33f5 with scrape type 2
2026-03-30 07:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 140f4dbc-1088-5ff6-b20a-d0c4922e33f5, identifier: VC16092
2026-03-30 07:48:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 140f4dbc-1088-5ff6-b20a-d0c4922e33f5 with identifier: VC16092
2026-03-30 07:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 140f4dbc-1088-5ff6-b20a-d0c4922e33f5 with identifier: VC16092
2026-03-30 07:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 140f4dbc-1088-5ff6-b20a-d0c4922e33f5 with identifier: VC16092 to the API
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:51:18Z',
 'fuel_type': 'diesel',
 'id': '140f4dbc-1088-5ff6-b20a-d0c4922e33f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC16092',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 316445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-28',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 D5 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2016}
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC16092%27 HTTP/1.1" 200 None
2026-03-30 07:48:10 [auto1.de] INFO: Saving data for VC16092: {'auction_closing_time': 1774885878.0, 'created_time': 1774550338.930854, 'last_price_update_time': 1774856890.455361}
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC16092') HTTP/1.1" 204 0
2026-03-30 07:48:10 [auto1.de] INFO: Found listing with ID: CG78657
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG78657%27 HTTP/1.1" 200 None
2026-03-30 07:48:10 [auto1.de] INFO: Scrape type for CG78657: 2
2026-03-30 07:48:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5865a789-43d1-5f48-b00a-542a98583a61 with identifier: CG78657
2026-03-30 07:48:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5865a789-43d1-5f48-b00a-542a98583a61 with scrape type 2
2026-03-30 07:48:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5865a789-43d1-5f48-b00a-542a98583a61 with scrape type 2
2026-03-30 07:48:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5865a789-43d1-5f48-b00a-542a98583a61, identifier: CG78657
2026-03-30 07:48:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5865a789-43d1-5f48-b00a-542a98583a61 with identifier: CG78657
2026-03-30 07:48:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5865a789-43d1-5f48-b00a-542a98583a61 with identifier: CG78657
2026-03-30 07:48:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5865a789-43d1-5f48-b00a-542a98583a61 with identifier: CG78657 to the API
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:20:09Z',
 'fuel_type': 'petrol',
 'id': '5865a789-43d1-5f48-b00a-542a98583a61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG78657',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 56120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-19',
 'seller_name': None,
 'title': 'Peugeot 206 1.4 Grand Filou Cool',
 'transmission': 'manual',
 'trim': 'Grand Filou Cool',
 'year': 2006}
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG78657%27 HTTP/1.1" 200 None
2026-03-30 07:48:10 [auto1.de] INFO: Saving data for CG78657: {'auction_closing_time': 1774884009.0, 'created_time': 1773945341.66204, 'last_price_update_time': 1774856890.856853}
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG78657') HTTP/1.1" 204 0
2026-03-30 07:48:10 [auto1.de] INFO: Found listing with ID: PH00076
2026-03-30 07:48:10 [auto1.de] INFO: Found listing with ID: RD80564
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RD80564%27 HTTP/1.1" 200 None
2026-03-30 07:48:10 [auto1.de] INFO: Scrape type for RD80564: 0
2026-03-30 07:48:10 [auto1.de] INFO: Found listing with ID: TR76591
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR76591%27 HTTP/1.1" 200 None
2026-03-30 07:48:10 [auto1.de] INFO: Scrape type for TR76591: 0
2026-03-30 07:48:10 [auto1.de] INFO: Found listing with ID: AD50420
2026-03-30 07:48:10 [auto1.de] INFO: Found listing with ID: EE47451
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47451%27 HTTP/1.1" 200 None
2026-03-30 07:48:11 [auto1.de] INFO: Scrape type for EE47451: 2
2026-03-30 07:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 628a75bc-3a0a-5bdc-9aee-94fc0c6fafba with identifier: EE47451
2026-03-30 07:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 628a75bc-3a0a-5bdc-9aee-94fc0c6fafba with scrape type 2
2026-03-30 07:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 628a75bc-3a0a-5bdc-9aee-94fc0c6fafba with scrape type 2
2026-03-30 07:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 628a75bc-3a0a-5bdc-9aee-94fc0c6fafba, identifier: EE47451
2026-03-30 07:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 628a75bc-3a0a-5bdc-9aee-94fc0c6fafba with identifier: EE47451
2026-03-30 07:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 628a75bc-3a0a-5bdc-9aee-94fc0c6fafba with identifier: EE47451
2026-03-30 07:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 628a75bc-3a0a-5bdc-9aee-94fc0c6fafba with identifier: EE47451 to the API
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:47:53Z',
 'fuel_type': 'diesel',
 'id': '628a75bc-3a0a-5bdc-9aee-94fc0c6fafba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE47451',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 132622,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-30',
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 TDI Plus Edition',
 'transmission': 'manual',
 'trim': 'Plus Edition',
 'year': 2011}
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47451%27 HTTP/1.1" 200 None
2026-03-30 07:48:11 [auto1.de] INFO: Saving data for EE47451: {'auction_closing_time': 1774885673.0, 'created_time': 1773947070.436557, 'last_price_update_time': 1774856891.407622}
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE47451') HTTP/1.1" 204 0
2026-03-30 07:48:11 [auto1.de] INFO: Channel: 24h | Page: 143 | totalHits: 8400 | hits on page: 40
2026-03-30 07:48:11 [auto1.de] INFO: Found listing with ID: BE83152
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE83152%27 HTTP/1.1" 200 None
2026-03-30 07:48:11 [auto1.de] INFO: Scrape type for BE83152: 2
2026-03-30 07:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 671bc3fe-6eba-5a6f-9709-57a402b9b056 with identifier: BE83152
2026-03-30 07:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 671bc3fe-6eba-5a6f-9709-57a402b9b056 with scrape type 2
2026-03-30 07:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 671bc3fe-6eba-5a6f-9709-57a402b9b056 with scrape type 2
2026-03-30 07:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 671bc3fe-6eba-5a6f-9709-57a402b9b056, identifier: BE83152
2026-03-30 07:48:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 671bc3fe-6eba-5a6f-9709-57a402b9b056 with identifier: BE83152
2026-03-30 07:48:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 671bc3fe-6eba-5a6f-9709-57a402b9b056 with identifier: BE83152
2026-03-30 07:48:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 671bc3fe-6eba-5a6f-9709-57a402b9b056 with identifier: BE83152 to the API
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:49:56Z',
 'fuel_type': 'petrol',
 'id': '671bc3fe-6eba-5a6f-9709-57a402b9b056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE83152',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 10689,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-17',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS',
 'transmission': 'manual',
 'trim': 'GS',
 'year': 2024}
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE83152%27 HTTP/1.1" 200 None
2026-03-30 07:48:11 [auto1.de] INFO: Saving data for BE83152: {'auction_closing_time': 1774885796.0, 'created_time': 1773916955.433568, 'last_price_update_time': 1774856891.808326}
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE83152') HTTP/1.1" 204 0
2026-03-30 07:48:11 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM75105%27 HTTP/1.1" 200 None
2026-03-30 07:48:11 [auto1.de] INFO: Scrape type for JM75105: 2
2026-03-30 07:48:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58a778d1-2af7-5a92-9f02-8808d249e7f9 with identifier: JM75105
2026-03-30 07:48:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58a778d1-2af7-5a92-9f02-8808d249e7f9 with scrape type 2
2026-03-30 07:48:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58a778d1-2af7-5a92-9f02-8808d249e7f9 with scrape type 2
2026-03-30 07:48:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58a778d1-2af7-5a92-9f02-8808d249e7f9, identifier: JM75105
2026-03-30 07:48:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:48:11 [auto1.de] INFO: Found listing with ID: XY17081
2026-03-30 07:48:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY17081%27 HTTP/1.1" 200 None
2026-03-30 07:48:12 [auto1.de] INFO: Scrape type for XY17081: 0
2026-03-30 07:48:12 [auto1.de] INFO: Found listing with ID: YP68247
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP68247%27 HTTP/1.1" 200 None
2026-03-30 07:48:12 [auto1.de] INFO: Scrape type for YP68247: 0
2026-03-30 07:48:12 [auto1.de] INFO: Found listing with ID: UH10138
2026-03-30 07:48:12 [auto1.de] INFO: Found listing with ID: JM75105
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM75105%27 HTTP/1.1" 200 None
2026-03-30 07:48:12 [auto1.de] INFO: Scrape type for JM75105: 2
2026-03-30 07:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58a778d1-2af7-5a92-9f02-8808d249e7f9 with scrape type 2
2026-03-30 07:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58a778d1-2af7-5a92-9f02-8808d249e7f9 with scrape type 2
2026-03-30 07:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58a778d1-2af7-5a92-9f02-8808d249e7f9, identifier: JM75105
2026-03-30 07:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58a778d1-2af7-5a92-9f02-8808d249e7f9 with identifier: JM75105
2026-03-30 07:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58a778d1-2af7-5a92-9f02-8808d249e7f9 with identifier: JM75105
2026-03-30 07:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58a778d1-2af7-5a92-9f02-8808d249e7f9 with identifier: JM75105 to the API
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:19:23Z',
 'fuel_type': 'petrol',
 'id': '58a778d1-2af7-5a92-9f02-8808d249e7f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM75105',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 170013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM75105%27 HTTP/1.1" 200 None
2026-03-30 07:48:12 [auto1.de] INFO: Saving data for JM75105: {'auction_closing_time': 1774883963.0, 'created_time': 1774639331.830778, 'last_price_update_time': 1774856892.42247}
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM75105') HTTP/1.1" 204 0
2026-03-30 07:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58a778d1-2af7-5a92-9f02-8808d249e7f9 with identifier: JM75105
2026-03-30 07:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58a778d1-2af7-5a92-9f02-8808d249e7f9 with identifier: JM75105
2026-03-30 07:48:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58a778d1-2af7-5a92-9f02-8808d249e7f9 with identifier: JM75105 to the API
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:19:23Z',
 'fuel_type': 'petrol',
 'id': '58a778d1-2af7-5a92-9f02-8808d249e7f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM75105',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 170013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-30',
 'seller_name': None,
 'title': 'Renault Megane 1.4 TCe BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2012}
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM75105%27 HTTP/1.1" 200 None
2026-03-30 07:48:12 [auto1.de] INFO: Saving data for JM75105: {'auction_closing_time': 1774883963.0, 'created_time': 1774639331.830778, 'last_price_update_time': 1774856892.859196}
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM75105') HTTP/1.1" 204 0
2026-03-30 07:48:12 [auto1.de] INFO: Found listing with ID: GD70369
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD70369%27 HTTP/1.1" 200 None
2026-03-30 07:48:12 [auto1.de] INFO: Scrape type for GD70369: 2
2026-03-30 07:48:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fe65172-323b-5e6d-9063-a414957c924a with identifier: GD70369
2026-03-30 07:48:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fe65172-323b-5e6d-9063-a414957c924a with scrape type 2
2026-03-30 07:48:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fe65172-323b-5e6d-9063-a414957c924a with scrape type 2
2026-03-30 07:48:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fe65172-323b-5e6d-9063-a414957c924a, identifier: GD70369
2026-03-30 07:48:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fe65172-323b-5e6d-9063-a414957c924a with identifier: GD70369
2026-03-30 07:48:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fe65172-323b-5e6d-9063-a414957c924a with identifier: GD70369
2026-03-30 07:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fe65172-323b-5e6d-9063-a414957c924a with identifier: GD70369 to the API
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:29:52Z',
 'fuel_type': 'diesel',
 'id': '8fe65172-323b-5e6d-9063-a414957c924a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD70369',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 132366,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-20',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueTEC Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueTEC Avantgarde',
 'year': 2015}
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD70369%27 HTTP/1.1" 200 None
2026-03-30 07:48:13 [auto1.de] INFO: Saving data for GD70369: {'auction_closing_time': 1774884592.0, 'created_time': 1773305626.496726, 'last_price_update_time': 1774856893.270788}
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD70369') HTTP/1.1" 204 0
2026-03-30 07:48:13 [auto1.de] INFO: Found listing with ID: ZB26924
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB26924%27 HTTP/1.1" 200 None
2026-03-30 07:48:13 [auto1.de] INFO: Scrape type for ZB26924: 0
2026-03-30 07:48:13 [auto1.de] INFO: Found listing with ID: LN93862
2026-03-30 07:48:13 [auto1.de] INFO: Found listing with ID: ZF91540
2026-03-30 07:48:13 [auto1.de] INFO: Found listing with ID: SZ38457
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ38457%27 HTTP/1.1" 200 None
2026-03-30 07:48:13 [auto1.de] INFO: Scrape type for SZ38457: 2
2026-03-30 07:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83e52d71-18e3-543e-accb-3cf214a6bae5 with identifier: SZ38457
2026-03-30 07:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83e52d71-18e3-543e-accb-3cf214a6bae5 with scrape type 2
2026-03-30 07:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83e52d71-18e3-543e-accb-3cf214a6bae5 with scrape type 2
2026-03-30 07:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 83e52d71-18e3-543e-accb-3cf214a6bae5, identifier: SZ38457
2026-03-30 07:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 83e52d71-18e3-543e-accb-3cf214a6bae5 with identifier: SZ38457
2026-03-30 07:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 83e52d71-18e3-543e-accb-3cf214a6bae5 with identifier: SZ38457
2026-03-30 07:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 83e52d71-18e3-543e-accb-3cf214a6bae5 with identifier: SZ38457 to the API
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:34:04Z',
 'fuel_type': 'diesel',
 'id': '83e52d71-18e3-543e-accb-3cf214a6bae5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ38457',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 150059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-20',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Blue-HDi Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2016}
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ38457%27 HTTP/1.1" 200 None
2026-03-30 07:48:13 [auto1.de] INFO: Saving data for SZ38457: {'auction_closing_time': 1774884844.0, 'created_time': 1774031864.294621, 'last_price_update_time': 1774856893.697143}
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ38457') HTTP/1.1" 204 0
2026-03-30 07:48:13 [auto1.de] INFO: Found listing with ID: VW39086
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW39086%27 HTTP/1.1" 200 None
2026-03-30 07:48:13 [auto1.de] INFO: Scrape type for VW39086: 2
2026-03-30 07:48:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 447536e3-2953-5d76-b75d-1c6a07d1bbbd with identifier: VW39086
2026-03-30 07:48:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 447536e3-2953-5d76-b75d-1c6a07d1bbbd with scrape type 2
2026-03-30 07:48:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 447536e3-2953-5d76-b75d-1c6a07d1bbbd with scrape type 2
2026-03-30 07:48:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 447536e3-2953-5d76-b75d-1c6a07d1bbbd, identifier: VW39086
2026-03-30 07:48:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 447536e3-2953-5d76-b75d-1c6a07d1bbbd with identifier: VW39086
2026-03-30 07:48:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 447536e3-2953-5d76-b75d-1c6a07d1bbbd with identifier: VW39086
2026-03-30 07:48:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 447536e3-2953-5d76-b75d-1c6a07d1bbbd with identifier: VW39086 to the API
2026-03-30 07:48:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 71,
 'expiration_date': '2026-03-30T15:17:27Z',
 'fuel_type': 'petrol',
 'id': '447536e3-2953-5d76-b75d-1c6a07d1bbbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW39086',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 84853,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-06',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.2 Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2022}
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW39086%27 HTTP/1.1" 200 None
2026-03-30 07:48:14 [auto1.de] INFO: Saving data for VW39086: {'auction_closing_time': 1774883847.0, 'created_time': 1774002720.87248, 'last_price_update_time': 1774856894.143991}
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW39086') HTTP/1.1" 204 0
2026-03-30 07:48:14 [auto1.de] INFO: Found listing with ID: ET59047
2026-03-30 07:48:14 [auto1.de] INFO: Found listing with ID: DG70282
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG70282%27 HTTP/1.1" 200 None
2026-03-30 07:48:14 [auto1.de] INFO: Scrape type for DG70282: 2
2026-03-30 07:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a2bf901-6d10-5105-96e6-0621254ba004 with identifier: DG70282
2026-03-30 07:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a2bf901-6d10-5105-96e6-0621254ba004 with scrape type 2
2026-03-30 07:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a2bf901-6d10-5105-96e6-0621254ba004 with scrape type 2
2026-03-30 07:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a2bf901-6d10-5105-96e6-0621254ba004, identifier: DG70282
2026-03-30 07:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a2bf901-6d10-5105-96e6-0621254ba004 with identifier: DG70282
2026-03-30 07:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a2bf901-6d10-5105-96e6-0621254ba004 with identifier: DG70282
2026-03-30 07:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a2bf901-6d10-5105-96e6-0621254ba004 with identifier: DG70282 to the API
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:19:15Z',
 'fuel_type': 'petrol',
 'id': '7a2bf901-6d10-5105-96e6-0621254ba004',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG70282',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 191678,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-28',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 Acenta 4x4',
 'transmission': 'automatic',
 'trim': 'Acenta 4x4',
 'year': 2011}
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG70282%27 HTTP/1.1" 200 None
2026-03-30 07:48:14 [auto1.de] INFO: Saving data for DG70282: {'auction_closing_time': 1774883955.0, 'created_time': 1774553114.258549, 'last_price_update_time': 1774856894.560199}
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DG70282') HTTP/1.1" 204 0
2026-03-30 07:48:14 [auto1.de] INFO: Found listing with ID: DE85774
2026-03-30 07:48:14 [auto1.de] INFO: Found listing with ID: BR76788
2026-03-30 07:48:14 [auto1.de] INFO: Found listing with ID: PA85998
2026-03-30 07:48:14 [auto1.de] INFO: Found listing with ID: XV50981
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV50981%27 HTTP/1.1" 200 None
2026-03-30 07:48:14 [auto1.de] INFO: Scrape type for XV50981: 0
2026-03-30 07:48:14 [auto1.de] INFO: Found listing with ID: KN98252
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN98252%27 HTTP/1.1" 200 None
2026-03-30 07:48:14 [auto1.de] INFO: Scrape type for KN98252: 2
2026-03-30 07:48:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 569beffa-e0c9-5d56-9dd4-38730caefcf9 with identifier: KN98252
2026-03-30 07:48:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 569beffa-e0c9-5d56-9dd4-38730caefcf9 with scrape type 2
2026-03-30 07:48:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 569beffa-e0c9-5d56-9dd4-38730caefcf9 with scrape type 2
2026-03-30 07:48:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 569beffa-e0c9-5d56-9dd4-38730caefcf9, identifier: KN98252
2026-03-30 07:48:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 569beffa-e0c9-5d56-9dd4-38730caefcf9 with identifier: KN98252
2026-03-30 07:48:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 569beffa-e0c9-5d56-9dd4-38730caefcf9 with identifier: KN98252
2026-03-30 07:48:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 569beffa-e0c9-5d56-9dd4-38730caefcf9 with identifier: KN98252 to the API
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:51:11Z',
 'fuel_type': 'petrol',
 'id': '569beffa-e0c9-5d56-9dd4-38730caefcf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN98252',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 160984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-04-24',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Edition 2000',
 'transmission': 'automatic',
 'trim': 'Edition 2000',
 'year': 2000}
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN98252%27 HTTP/1.1" 200 None
2026-03-30 07:48:14 [auto1.de] INFO: Saving data for KN98252: {'auction_closing_time': 1774885871.0, 'created_time': 1774553235.109407, 'last_price_update_time': 1774856894.982931}
2026-03-30 07:48:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN98252') HTTP/1.1" 204 0
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: ZL76152
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: XC54847
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC54847%27 HTTP/1.1" 200 None
2026-03-30 07:48:15 [auto1.de] INFO: Scrape type for XC54847: 0
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: VT76935
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: SV32169
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV32169%27 HTTP/1.1" 200 None
2026-03-30 07:48:15 [auto1.de] INFO: Scrape type for SV32169: 2
2026-03-30 07:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4c455d2-cdce-5173-8579-7fce77e11dd8 with identifier: SV32169
2026-03-30 07:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4c455d2-cdce-5173-8579-7fce77e11dd8 with scrape type 2
2026-03-30 07:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4c455d2-cdce-5173-8579-7fce77e11dd8 with scrape type 2
2026-03-30 07:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e4c455d2-cdce-5173-8579-7fce77e11dd8, identifier: SV32169
2026-03-30 07:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e4c455d2-cdce-5173-8579-7fce77e11dd8 with identifier: SV32169
2026-03-30 07:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e4c455d2-cdce-5173-8579-7fce77e11dd8 with identifier: SV32169
2026-03-30 07:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e4c455d2-cdce-5173-8579-7fce77e11dd8 with identifier: SV32169 to the API
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 147,
 'expiration_date': '2026-03-30T15:05:22Z',
 'fuel_type': 'diesel',
 'id': 'e4c455d2-cdce-5173-8579-7fce77e11dd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV32169',
 'listing': 'auction',
 'make': 'Subaru',
 'model': 'Forester',
 'odometer': 189317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-29',
 'seller_name': None,
 'title': 'Subaru Forester 2.0 Diesel Exclusive',
 'transmission': 'automatic',
 'trim': 'Exclusive',
 'year': 2015}
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV32169%27 HTTP/1.1" 200 None
2026-03-30 07:48:15 [auto1.de] INFO: Saving data for SV32169: {'auction_closing_time': 1774883122.0, 'created_time': 1774550163.275275, 'last_price_update_time': 1774856895.503917}
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SV32169') HTTP/1.1" 204 0
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: SE32009
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: GY26864
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: BE16908
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: AP07103
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: JH64089
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: RN43410
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN43410%27 HTTP/1.1" 200 None
2026-03-30 07:48:15 [auto1.de] INFO: Scrape type for RN43410: 0
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: HT61440
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: MX47183
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: DG85302
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG85302%27 HTTP/1.1" 200 None
2026-03-30 07:48:15 [auto1.de] INFO: Scrape type for DG85302: 0
2026-03-30 07:48:15 [auto1.de] INFO: Found listing with ID: RE30080
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE30080%27 HTTP/1.1" 200 None
2026-03-30 07:48:15 [auto1.de] INFO: Scrape type for RE30080: 2
2026-03-30 07:48:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 387eaf3e-7506-5d44-bde3-18ccb6b7b770 with identifier: RE30080
2026-03-30 07:48:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 387eaf3e-7506-5d44-bde3-18ccb6b7b770 with scrape type 2
2026-03-30 07:48:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 387eaf3e-7506-5d44-bde3-18ccb6b7b770 with scrape type 2
2026-03-30 07:48:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 387eaf3e-7506-5d44-bde3-18ccb6b7b770, identifier: RE30080
2026-03-30 07:48:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 387eaf3e-7506-5d44-bde3-18ccb6b7b770 with identifier: RE30080
2026-03-30 07:48:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 387eaf3e-7506-5d44-bde3-18ccb6b7b770 with identifier: RE30080
2026-03-30 07:48:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 387eaf3e-7506-5d44-bde3-18ccb6b7b770 with identifier: RE30080 to the API
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:44Z',
 'fuel_type': 'diesel',
 'id': '387eaf3e-7506-5d44-bde3-18ccb6b7b770',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE30080',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 205608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-17',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE30080%27 HTTP/1.1" 200 None
2026-03-30 07:48:16 [auto1.de] INFO: Saving data for RE30080: {'auction_closing_time': 1774885124.0, 'created_time': 1773831089.542608, 'last_price_update_time': 1774856896.112656}
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RE30080') HTTP/1.1" 204 0
2026-03-30 07:48:16 [auto1.de] INFO: Found listing with ID: ZM37202
2026-03-30 07:48:16 [auto1.de] INFO: Found listing with ID: FZ98450
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ98450%27 HTTP/1.1" 200 None
2026-03-30 07:48:16 [auto1.de] INFO: Scrape type for FZ98450: 0
2026-03-30 07:48:16 [auto1.de] INFO: Found listing with ID: VW61170
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW61170%27 HTTP/1.1" 200 None
2026-03-30 07:48:16 [auto1.de] INFO: Scrape type for VW61170: 2
2026-03-30 07:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f65d2c38-864b-5e49-b67e-bd2fbfe9ff7a with identifier: VW61170
2026-03-30 07:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f65d2c38-864b-5e49-b67e-bd2fbfe9ff7a with scrape type 2
2026-03-30 07:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f65d2c38-864b-5e49-b67e-bd2fbfe9ff7a with scrape type 2
2026-03-30 07:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f65d2c38-864b-5e49-b67e-bd2fbfe9ff7a, identifier: VW61170
2026-03-30 07:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f65d2c38-864b-5e49-b67e-bd2fbfe9ff7a with identifier: VW61170
2026-03-30 07:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f65d2c38-864b-5e49-b67e-bd2fbfe9ff7a with identifier: VW61170
2026-03-30 07:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f65d2c38-864b-5e49-b67e-bd2fbfe9ff7a with identifier: VW61170 to the API
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:50:48Z',
 'fuel_type': 'petrol',
 'id': 'f65d2c38-864b-5e49-b67e-bd2fbfe9ff7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW61170',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 116855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-08',
 'seller_name': None,
 'title': 'Audi A4 40 TFSI Mild-Hybrid S line',
 'transmission': 'automatic',
 'trim': 'S line',
 'year': 2019}
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW61170%27 HTTP/1.1" 200 None
2026-03-30 07:48:16 [auto1.de] INFO: Saving data for VW61170: {'auction_closing_time': 1774885848.0, 'created_time': 1774639442.105371, 'last_price_update_time': 1774856896.69566}
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW61170') HTTP/1.1" 204 0
2026-03-30 07:48:16 [auto1.de] INFO: Found listing with ID: TM90896
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM90896%27 HTTP/1.1" 200 None
2026-03-30 07:48:16 [auto1.de] INFO: Scrape type for TM90896: 0
2026-03-30 07:48:16 [auto1.de] INFO: Found listing with ID: XY25128
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY25128%27 HTTP/1.1" 200 None
2026-03-30 07:48:16 [auto1.de] INFO: Scrape type for XY25128: 2
2026-03-30 07:48:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fadb8330-8377-5d16-b16e-2cb8fdaad055 with identifier: XY25128
2026-03-30 07:48:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fadb8330-8377-5d16-b16e-2cb8fdaad055 with scrape type 2
2026-03-30 07:48:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fadb8330-8377-5d16-b16e-2cb8fdaad055 with scrape type 2
2026-03-30 07:48:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fadb8330-8377-5d16-b16e-2cb8fdaad055, identifier: XY25128
2026-03-30 07:48:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fadb8330-8377-5d16-b16e-2cb8fdaad055 with identifier: XY25128
2026-03-30 07:48:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fadb8330-8377-5d16-b16e-2cb8fdaad055 with identifier: XY25128
2026-03-30 07:48:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fadb8330-8377-5d16-b16e-2cb8fdaad055 with identifier: XY25128 to the API
2026-03-30 07:48:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:38:41Z',
 'fuel_type': 'diesel',
 'id': 'fadb8330-8377-5d16-b16e-2cb8fdaad055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY25128',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 167418,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-15',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.2 CRDi Premium blue 4WD',
 'transmission': 'automatic',
 'trim': 'Premium blue 4WD',
 'year': 2017}
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY25128%27 HTTP/1.1" 200 None
2026-03-30 07:48:17 [auto1.de] INFO: Saving data for XY25128: {'auction_closing_time': 1774885121.0, 'created_time': 1774550657.378972, 'last_price_update_time': 1774856897.124148}
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XY25128') HTTP/1.1" 204 0
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: RX47602
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX47602%27 HTTP/1.1" 200 None
2026-03-30 07:48:17 [auto1.de] INFO: Scrape type for RX47602: 2
2026-03-30 07:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 086d3423-5ba0-5b8c-8e0b-cbe786dd8839 with identifier: RX47602
2026-03-30 07:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 086d3423-5ba0-5b8c-8e0b-cbe786dd8839 with scrape type 2
2026-03-30 07:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 086d3423-5ba0-5b8c-8e0b-cbe786dd8839 with scrape type 2
2026-03-30 07:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 086d3423-5ba0-5b8c-8e0b-cbe786dd8839, identifier: RX47602
2026-03-30 07:48:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 086d3423-5ba0-5b8c-8e0b-cbe786dd8839 with identifier: RX47602
2026-03-30 07:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 086d3423-5ba0-5b8c-8e0b-cbe786dd8839 with identifier: RX47602
2026-03-30 07:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 086d3423-5ba0-5b8c-8e0b-cbe786dd8839 with identifier: RX47602 to the API
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:26:06Z',
 'fuel_type': 'hybrid',
 'id': '086d3423-5ba0-5b8c-8e0b-cbe786dd8839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RX47602',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 79851,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seller_name': None,
 'title': 'Ford Kuga 2.5 Plug-in Hybrid Titanium X',
 'transmission': 'automatic',
 'trim': 'Titanium X',
 'year': 2022}
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX47602%27 HTTP/1.1" 200 None
2026-03-30 07:48:17 [auto1.de] INFO: Saving data for RX47602: {'auction_closing_time': 1774884366.0, 'created_time': 1774550132.722146, 'last_price_update_time': 1774856897.522428}
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RX47602') HTTP/1.1" 204 0
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: PF23160
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: CS78773
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: ZX93034
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX93034%27 HTTP/1.1" 200 None
2026-03-30 07:48:17 [auto1.de] INFO: Scrape type for ZX93034: 2
2026-03-30 07:48:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bedc12d7-6347-5d91-8eb1-61027d1178fd with identifier: ZX93034
2026-03-30 07:48:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bedc12d7-6347-5d91-8eb1-61027d1178fd with scrape type 2
2026-03-30 07:48:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bedc12d7-6347-5d91-8eb1-61027d1178fd with scrape type 2
2026-03-30 07:48:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bedc12d7-6347-5d91-8eb1-61027d1178fd, identifier: ZX93034
2026-03-30 07:48:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bedc12d7-6347-5d91-8eb1-61027d1178fd with identifier: ZX93034
2026-03-30 07:48:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bedc12d7-6347-5d91-8eb1-61027d1178fd with identifier: ZX93034
2026-03-30 07:48:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bedc12d7-6347-5d91-8eb1-61027d1178fd with identifier: ZX93034 to the API
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:27:54Z',
 'fuel_type': 'petrol',
 'id': 'bedc12d7-6347-5d91-8eb1-61027d1178fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX93034',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 27206,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSI quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2021}
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZX93034%27 HTTP/1.1" 200 None
2026-03-30 07:48:17 [auto1.de] INFO: Saving data for ZX93034: {'auction_closing_time': 1774884474.0, 'created_time': 1774034892.123388, 'last_price_update_time': 1774856897.934703}
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZX93034') HTTP/1.1" 204 0
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: XC20802
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC20802%27 HTTP/1.1" 200 None
2026-03-30 07:48:17 [auto1.de] INFO: Scrape type for XC20802: 0
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-30 07:48:17 [auto1.de] INFO: Channel: 24h | Page: 144 | totalHits: 8402 | hits on page: 40
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: NY15812
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: UW48203
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: YC00325
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: EB92999
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: LZ76677
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ76677%27 HTTP/1.1" 200 None
2026-03-30 07:48:17 [auto1.de] INFO: Scrape type for LZ76677: 0
2026-03-30 07:48:17 [auto1.de] INFO: Found listing with ID: XF65798
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF65798%27 HTTP/1.1" 200 None
2026-03-30 07:48:18 [auto1.de] INFO: Scrape type for XF65798: 2
2026-03-30 07:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e24263b-75b3-56ad-ad99-2e3d18ded84f with identifier: XF65798
2026-03-30 07:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e24263b-75b3-56ad-ad99-2e3d18ded84f with scrape type 2
2026-03-30 07:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e24263b-75b3-56ad-ad99-2e3d18ded84f with scrape type 2
2026-03-30 07:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e24263b-75b3-56ad-ad99-2e3d18ded84f, identifier: XF65798
2026-03-30 07:48:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e24263b-75b3-56ad-ad99-2e3d18ded84f with identifier: XF65798
2026-03-30 07:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e24263b-75b3-56ad-ad99-2e3d18ded84f with identifier: XF65798
2026-03-30 07:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e24263b-75b3-56ad-ad99-2e3d18ded84f with identifier: XF65798 to the API
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:33:53Z',
 'fuel_type': 'petrol',
 'id': '1e24263b-75b3-56ad-ad99-2e3d18ded84f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF65798',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 161869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-11-30',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 United',
 'transmission': 'manual',
 'trim': 'United',
 'year': 2008}
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF65798%27 HTTP/1.1" 200 None
2026-03-30 07:48:18 [auto1.de] INFO: Saving data for XF65798: {'auction_closing_time': 1774884833.0, 'created_time': 1774637076.899406, 'last_price_update_time': 1774856898.401544}
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF65798') HTTP/1.1" 204 0
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: EY23363
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: HV21869
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: KL53261
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: YJ27680
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: TE58420
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: PG63962
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: TV91582
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV91582%27 HTTP/1.1" 200 None
2026-03-30 07:48:18 [auto1.de] INFO: Scrape type for TV91582: 2
2026-03-30 07:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4182d12e-9788-5601-9279-19858b7d62bd with identifier: TV91582
2026-03-30 07:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4182d12e-9788-5601-9279-19858b7d62bd with scrape type 2
2026-03-30 07:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4182d12e-9788-5601-9279-19858b7d62bd with scrape type 2
2026-03-30 07:48:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4182d12e-9788-5601-9279-19858b7d62bd, identifier: TV91582
2026-03-30 07:48:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4182d12e-9788-5601-9279-19858b7d62bd with identifier: TV91582
2026-03-30 07:48:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4182d12e-9788-5601-9279-19858b7d62bd with identifier: TV91582
2026-03-30 07:48:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4182d12e-9788-5601-9279-19858b7d62bd with identifier: TV91582 to the API
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:17Z',
 'fuel_type': 'petrol',
 'id': '4182d12e-9788-5601-9279-19858b7d62bd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV91582',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Duster',
 'odometer': 61001,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-30',
 'seller_name': None,
 'title': 'Dacia Duster 1.6 SCe Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2018}
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV91582%27 HTTP/1.1" 200 None
2026-03-30 07:48:18 [auto1.de] INFO: Saving data for TV91582: {'auction_closing_time': 1774883357.0, 'created_time': 1773230666.870388, 'last_price_update_time': 1774856898.905602}
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV91582') HTTP/1.1" 204 0
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: LU56386
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: LC77518
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: WK06356
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: DU69800
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: AH07700
2026-03-30 07:48:18 [auto1.de] INFO: Found listing with ID: YS77012
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS77012%27 HTTP/1.1" 200 None
2026-03-30 07:48:18 [auto1.de] INFO: Scrape type for YS77012: 2
2026-03-30 07:48:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with identifier: YS77012
2026-03-30 07:48:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with scrape type 2
2026-03-30 07:48:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with scrape type 2
2026-03-30 07:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7ab5d826-a08f-55aa-848f-98d38dafa3c8, identifier: YS77012
2026-03-30 07:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with identifier: YS77012
2026-03-30 07:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with identifier: YS77012
2026-03-30 07:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7ab5d826-a08f-55aa-848f-98d38dafa3c8 with identifier: YS77012 to the API
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:22:27Z',
 'fuel_type': 'diesel',
 'id': '7ab5d826-a08f-55aa-848f-98d38dafa3c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YS77012',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 131756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'BMW X1 xDrive 18d',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS77012%27 HTTP/1.1" 200 None
2026-03-30 07:48:19 [auto1.de] INFO: Saving data for YS77012: {'auction_closing_time': 1774884147.0, 'created_time': 1774551998.78811, 'last_price_update_time': 1774856899.294007}
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YS77012') HTTP/1.1" 204 0
2026-03-30 07:48:19 [auto1.de] INFO: Found listing with ID: CX98688
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX98688%27 HTTP/1.1" 200 None
2026-03-30 07:48:19 [auto1.de] INFO: Scrape type for CX98688: 2
2026-03-30 07:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf7147c7-3bb3-54b4-bbd0-bf43de197800 with identifier: CX98688
2026-03-30 07:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf7147c7-3bb3-54b4-bbd0-bf43de197800 with scrape type 2
2026-03-30 07:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf7147c7-3bb3-54b4-bbd0-bf43de197800 with scrape type 2
2026-03-30 07:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf7147c7-3bb3-54b4-bbd0-bf43de197800, identifier: CX98688
2026-03-30 07:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf7147c7-3bb3-54b4-bbd0-bf43de197800 with identifier: CX98688
2026-03-30 07:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf7147c7-3bb3-54b4-bbd0-bf43de197800 with identifier: CX98688
2026-03-30 07:48:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf7147c7-3bb3-54b4-bbd0-bf43de197800 with identifier: CX98688 to the API
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:27:58Z',
 'fuel_type': 'diesel',
 'id': 'bf7147c7-3bb3-54b4-bbd0-bf43de197800',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CX98688',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 196620,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-17',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Sport & Style 4Motion BlueMotion Tech',
 'year': 2015}
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CX98688%27 HTTP/1.1" 200 None
2026-03-30 07:48:19 [auto1.de] INFO: Saving data for CX98688: {'auction_closing_time': 1774884478.0, 'created_time': 1773917031.851566, 'last_price_update_time': 1774856899.825457}
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CX98688') HTTP/1.1" 204 0
2026-03-30 07:48:19 [auto1.de] INFO: Found listing with ID: VB21266
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB21266%27 HTTP/1.1" 200 None
2026-03-30 07:48:19 [auto1.de] INFO: Scrape type for VB21266: 2
2026-03-30 07:48:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 783a9e0c-800c-56af-b462-b1a90effa43f with identifier: VB21266
2026-03-30 07:48:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 783a9e0c-800c-56af-b462-b1a90effa43f with scrape type 2
2026-03-30 07:48:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 783a9e0c-800c-56af-b462-b1a90effa43f with scrape type 2
2026-03-30 07:48:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 783a9e0c-800c-56af-b462-b1a90effa43f, identifier: VB21266
2026-03-30 07:48:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 783a9e0c-800c-56af-b462-b1a90effa43f with identifier: VB21266
2026-03-30 07:48:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 783a9e0c-800c-56af-b462-b1a90effa43f with identifier: VB21266
2026-03-30 07:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 783a9e0c-800c-56af-b462-b1a90effa43f with identifier: VB21266 to the API
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:12:17Z',
 'fuel_type': 'petrol',
 'id': '783a9e0c-800c-56af-b462-b1a90effa43f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB21266',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 237228,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB21266%27 HTTP/1.1" 200 None
2026-03-30 07:48:20 [auto1.de] INFO: Saving data for VB21266: {'auction_closing_time': 1774883537.0, 'created_time': 1774639512.970932, 'last_price_update_time': 1774856900.221225}
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB21266') HTTP/1.1" 204 0
2026-03-30 07:48:20 [auto1.de] INFO: Found listing with ID: AU40553
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU40553%27 HTTP/1.1" 200 None
2026-03-30 07:48:20 [auto1.de] INFO: Scrape type for AU40553: 0
2026-03-30 07:48:20 [auto1.de] INFO: Found listing with ID: JP48264
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP48264%27 HTTP/1.1" 200 None
2026-03-30 07:48:20 [auto1.de] INFO: Scrape type for JP48264: 2
2026-03-30 07:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7585792-9cf2-5327-8f87-0f3c1f8f242b with identifier: JP48264
2026-03-30 07:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7585792-9cf2-5327-8f87-0f3c1f8f242b with scrape type 2
2026-03-30 07:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7585792-9cf2-5327-8f87-0f3c1f8f242b with scrape type 2
2026-03-30 07:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7585792-9cf2-5327-8f87-0f3c1f8f242b, identifier: JP48264
2026-03-30 07:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7585792-9cf2-5327-8f87-0f3c1f8f242b with identifier: JP48264
2026-03-30 07:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7585792-9cf2-5327-8f87-0f3c1f8f242b with identifier: JP48264
2026-03-30 07:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7585792-9cf2-5327-8f87-0f3c1f8f242b with identifier: JP48264 to the API
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:49:56Z',
 'fuel_type': 'diesel',
 'id': 'b7585792-9cf2-5327-8f87-0f3c1f8f242b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JP48264',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 207462,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-23',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP48264%27 HTTP/1.1" 200 None
2026-03-30 07:48:20 [auto1.de] INFO: Saving data for JP48264: {'auction_closing_time': 1774885796.0, 'created_time': 1774638658.735616, 'last_price_update_time': 1774856900.614835}
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JP48264') HTTP/1.1" 204 0
2026-03-30 07:48:20 [auto1.de] INFO: Found listing with ID: BZ75769
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ75769%27 HTTP/1.1" 200 None
2026-03-30 07:48:20 [auto1.de] INFO: Scrape type for BZ75769: 0
2026-03-30 07:48:20 [auto1.de] INFO: Found listing with ID: BP72129
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP72129%27 HTTP/1.1" 200 None
2026-03-30 07:48:20 [auto1.de] INFO: Scrape type for BP72129: 2
2026-03-30 07:48:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb81b8d5-7dec-5486-bd0d-d9d9592c3b46 with identifier: BP72129
2026-03-30 07:48:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb81b8d5-7dec-5486-bd0d-d9d9592c3b46 with scrape type 2
2026-03-30 07:48:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb81b8d5-7dec-5486-bd0d-d9d9592c3b46 with scrape type 2
2026-03-30 07:48:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bb81b8d5-7dec-5486-bd0d-d9d9592c3b46, identifier: BP72129
2026-03-30 07:48:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bb81b8d5-7dec-5486-bd0d-d9d9592c3b46 with identifier: BP72129
2026-03-30 07:48:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bb81b8d5-7dec-5486-bd0d-d9d9592c3b46 with identifier: BP72129
2026-03-30 07:48:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bb81b8d5-7dec-5486-bd0d-d9d9592c3b46 with identifier: BP72129 to the API
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:26:58Z',
 'fuel_type': 'diesel',
 'id': 'bb81b8d5-7dec-5486-bd0d-d9d9592c3b46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP72129',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 164718,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-15',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2018}
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP72129%27 HTTP/1.1" 200 None
2026-03-30 07:48:21 [auto1.de] INFO: Saving data for BP72129: {'auction_closing_time': 1774884418.0, 'created_time': 1774550130.137664, 'last_price_update_time': 1774856901.044066}
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP72129') HTTP/1.1" 204 0
2026-03-30 07:48:21 [auto1.de] INFO: Found listing with ID: RM05292
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM05292%27 HTTP/1.1" 200 None
2026-03-30 07:48:21 [auto1.de] INFO: Scrape type for RM05292: 2
2026-03-30 07:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 172483cc-02b9-5165-8636-3fb22c9c552d with identifier: RM05292
2026-03-30 07:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 172483cc-02b9-5165-8636-3fb22c9c552d with scrape type 2
2026-03-30 07:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 172483cc-02b9-5165-8636-3fb22c9c552d with scrape type 2
2026-03-30 07:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 172483cc-02b9-5165-8636-3fb22c9c552d, identifier: RM05292
2026-03-30 07:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 172483cc-02b9-5165-8636-3fb22c9c552d with identifier: RM05292
2026-03-30 07:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 172483cc-02b9-5165-8636-3fb22c9c552d with identifier: RM05292
2026-03-30 07:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 172483cc-02b9-5165-8636-3fb22c9c552d with identifier: RM05292 to the API
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:50:32Z',
 'fuel_type': 'diesel',
 'id': '172483cc-02b9-5165-8636-3fb22c9c552d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM05292',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 151941,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion',
 'year': 2018}
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RM05292%27 HTTP/1.1" 200 None
2026-03-30 07:48:21 [auto1.de] INFO: Saving data for RM05292: {'auction_closing_time': 1774885832.0, 'created_time': 1774639018.265325, 'last_price_update_time': 1774856901.557982}
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RM05292') HTTP/1.1" 204 0
2026-03-30 07:48:21 [auto1.de] INFO: Found listing with ID: AF84640
2026-03-30 07:48:21 [auto1.de] INFO: Found listing with ID: KG22409
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG22409%27 HTTP/1.1" 200 None
2026-03-30 07:48:21 [auto1.de] INFO: Scrape type for KG22409: 0
2026-03-30 07:48:21 [auto1.de] INFO: Found listing with ID: HV92794
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV92794%27 HTTP/1.1" 200 None
2026-03-30 07:48:21 [auto1.de] INFO: Scrape type for HV92794: 2
2026-03-30 07:48:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ce3fc18-27d2-543d-95ab-982f5f4df81b with identifier: HV92794
2026-03-30 07:48:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ce3fc18-27d2-543d-95ab-982f5f4df81b with scrape type 2
2026-03-30 07:48:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ce3fc18-27d2-543d-95ab-982f5f4df81b with scrape type 2
2026-03-30 07:48:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ce3fc18-27d2-543d-95ab-982f5f4df81b, identifier: HV92794
2026-03-30 07:48:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ce3fc18-27d2-543d-95ab-982f5f4df81b with identifier: HV92794
2026-03-30 07:48:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ce3fc18-27d2-543d-95ab-982f5f4df81b with identifier: HV92794
2026-03-30 07:48:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ce3fc18-27d2-543d-95ab-982f5f4df81b with identifier: HV92794 to the API
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:12:42Z',
 'fuel_type': 'petrol',
 'id': '1ce3fc18-27d2-543d-95ab-982f5f4df81b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV92794',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 126425,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-04',
 'seller_name': None,
 'title': 'Opel Adam 1.4 120 Jahre',
 'transmission': 'manual',
 'trim': '120 Jahre',
 'year': 2018}
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HV92794%27 HTTP/1.1" 200 None
2026-03-30 07:48:22 [auto1.de] INFO: Saving data for HV92794: {'auction_closing_time': 1774883562.0, 'created_time': 1773946003.46556, 'last_price_update_time': 1774856902.036879}
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HV92794') HTTP/1.1" 204 0
2026-03-30 07:48:22 [auto1.de] INFO: Found listing with ID: YG65181
2026-03-30 07:48:22 [auto1.de] INFO: Found listing with ID: BW18754
2026-03-30 07:48:22 [auto1.de] INFO: Found listing with ID: WY87564
2026-03-30 07:48:22 [auto1.de] INFO: Found listing with ID: XP56939
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP56939%27 HTTP/1.1" 200 None
2026-03-30 07:48:22 [auto1.de] INFO: Scrape type for XP56939: 2
2026-03-30 07:48:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ded0a13-4e11-5a5d-bbf4-1362fb492d65 with identifier: XP56939
2026-03-30 07:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ded0a13-4e11-5a5d-bbf4-1362fb492d65 with scrape type 2
2026-03-30 07:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ded0a13-4e11-5a5d-bbf4-1362fb492d65 with scrape type 2
2026-03-30 07:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ded0a13-4e11-5a5d-bbf4-1362fb492d65, identifier: XP56939
2026-03-30 07:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ded0a13-4e11-5a5d-bbf4-1362fb492d65 with identifier: XP56939
2026-03-30 07:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ded0a13-4e11-5a5d-bbf4-1362fb492d65 with identifier: XP56939
2026-03-30 07:48:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ded0a13-4e11-5a5d-bbf4-1362fb492d65 with identifier: XP56939 to the API
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 88,
 'expiration_date': '2026-03-30T15:43:05Z',
 'fuel_type': 'petrol',
 'id': '6ded0a13-4e11-5a5d-bbf4-1362fb492d65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP56939',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Note',
 'odometer': 63590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-11',
 'seller_name': None,
 'title': 'Nissan Note 1.4 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2009}
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP56939%27 HTTP/1.1" 200 None
2026-03-30 07:48:22 [auto1.de] INFO: Saving data for XP56939: {'auction_closing_time': 1774885385.0, 'created_time': 1774639363.597907, 'last_price_update_time': 1774856902.440436}
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP56939') HTTP/1.1" 204 0
2026-03-30 07:48:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:48:22 [auto1.de] INFO: Found listing with ID: GJ83963
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ83963%27 HTTP/1.1" 200 None
2026-03-30 07:48:22 [auto1.de] INFO: Scrape type for GJ83963: 0
2026-03-30 07:48:22 [auto1.de] INFO: Found listing with ID: BP39163
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP39163%27 HTTP/1.1" 200 None
2026-03-30 07:48:22 [auto1.de] INFO: Scrape type for BP39163: 0
2026-03-30 07:48:22 [auto1.de] INFO: Found listing with ID: GP94559
2026-03-30 07:48:22 [auto1.de] INFO: Found listing with ID: YV66765
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV66765%27 HTTP/1.1" 200 None
2026-03-30 07:48:22 [auto1.de] INFO: Scrape type for YV66765: 2
2026-03-30 07:48:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcf761f6-dcf9-5d7f-a59d-588faa441977 with identifier: YV66765
2026-03-30 07:48:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcf761f6-dcf9-5d7f-a59d-588faa441977 with scrape type 2
2026-03-30 07:48:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcf761f6-dcf9-5d7f-a59d-588faa441977 with scrape type 2
2026-03-30 07:48:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fcf761f6-dcf9-5d7f-a59d-588faa441977, identifier: YV66765
2026-03-30 07:48:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fcf761f6-dcf9-5d7f-a59d-588faa441977 with identifier: YV66765
2026-03-30 07:48:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fcf761f6-dcf9-5d7f-a59d-588faa441977 with identifier: YV66765
2026-03-30 07:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fcf761f6-dcf9-5d7f-a59d-588faa441977 with identifier: YV66765 to the API
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:19:38Z',
 'fuel_type': 'petrol',
 'id': 'fcf761f6-dcf9-5d7f-a59d-588faa441977',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV66765',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 42496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-05',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV66765%27 HTTP/1.1" 200 None
2026-03-30 07:48:23 [auto1.de] INFO: Saving data for YV66765: {'auction_closing_time': 1774883978.0, 'created_time': 1774552685.661197, 'last_price_update_time': 1774856903.245145}
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YV66765') HTTP/1.1" 204 0
2026-03-30 07:48:23 [auto1.de] INFO: Found listing with ID: JH89792
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH89792%27 HTTP/1.1" 200 None
2026-03-30 07:48:23 [auto1.de] INFO: Scrape type for JH89792: 2
2026-03-30 07:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50653f69-3960-52be-b0ae-f8c99e802461 with identifier: JH89792
2026-03-30 07:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50653f69-3960-52be-b0ae-f8c99e802461 with scrape type 2
2026-03-30 07:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50653f69-3960-52be-b0ae-f8c99e802461 with scrape type 2
2026-03-30 07:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 50653f69-3960-52be-b0ae-f8c99e802461, identifier: JH89792
2026-03-30 07:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 50653f69-3960-52be-b0ae-f8c99e802461 with identifier: JH89792
2026-03-30 07:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 50653f69-3960-52be-b0ae-f8c99e802461 with identifier: JH89792
2026-03-30 07:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 50653f69-3960-52be-b0ae-f8c99e802461 with identifier: JH89792 to the API
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:07:21Z',
 'fuel_type': 'petrol',
 'id': '50653f69-3960-52be-b0ae-f8c99e802461',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH89792',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 71252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-29',
 'seller_name': None,
 'title': 'Volvo V60 2.0 B5 Mild-Hybrid Inscription',
 'transmission': 'automatic',
 'trim': 'Inscription',
 'year': 2020}
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH89792%27 HTTP/1.1" 200 None
2026-03-30 07:48:23 [auto1.de] INFO: Saving data for JH89792: {'auction_closing_time': 1774883241.0, 'created_time': 1773138532.022184, 'last_price_update_time': 1774856903.669261}
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JH89792') HTTP/1.1" 204 0
2026-03-30 07:48:23 [auto1.de] INFO: Channel: 24h | Page: 145 | totalHits: 8402 | hits on page: 40
2026-03-30 07:48:23 [auto1.de] INFO: Found listing with ID: RT17633
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT17633%27 HTTP/1.1" 200 None
2026-03-30 07:48:23 [auto1.de] INFO: Scrape type for RT17633: 2
2026-03-30 07:48:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70c5db98-ddde-5a92-a750-e853540cb319 with identifier: RT17633
2026-03-30 07:48:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70c5db98-ddde-5a92-a750-e853540cb319 with scrape type 2
2026-03-30 07:48:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70c5db98-ddde-5a92-a750-e853540cb319 with scrape type 2
2026-03-30 07:48:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 70c5db98-ddde-5a92-a750-e853540cb319, identifier: RT17633
2026-03-30 07:48:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 70c5db98-ddde-5a92-a750-e853540cb319 with identifier: RT17633
2026-03-30 07:48:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 70c5db98-ddde-5a92-a750-e853540cb319 with identifier: RT17633
2026-03-30 07:48:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 70c5db98-ddde-5a92-a750-e853540cb319 with identifier: RT17633 to the API
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:24:55Z',
 'fuel_type': 'petrol',
 'id': '70c5db98-ddde-5a92-a750-e853540cb319',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT17633',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 171027,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-26',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Ti-VCT SYNC Edition',
 'transmission': 'automatic',
 'trim': 'SYNC Edition',
 'year': 2014}
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT17633%27 HTTP/1.1" 200 None
2026-03-30 07:48:24 [auto1.de] INFO: Saving data for RT17633: {'auction_closing_time': 1774884295.0, 'created_time': 1774637188.84986, 'last_price_update_time': 1774856904.066637}
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT17633') HTTP/1.1" 204 0
2026-03-30 07:48:24 [auto1.de] INFO: Found listing with ID: GZ21000
2026-03-30 07:48:24 [auto1.de] INFO: Found listing with ID: YM28187
2026-03-30 07:48:24 [auto1.de] INFO: Found listing with ID: ZW99084
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW99084%27 HTTP/1.1" 200 None
2026-03-30 07:48:24 [auto1.de] INFO: Scrape type for ZW99084: 0
2026-03-30 07:48:24 [auto1.de] INFO: Found listing with ID: NY57954
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY57954%27 HTTP/1.1" 200 None
2026-03-30 07:48:24 [auto1.de] INFO: Scrape type for NY57954: 0
2026-03-30 07:48:24 [auto1.de] INFO: Found listing with ID: MZ83474
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ83474%27 HTTP/1.1" 200 None
2026-03-30 07:48:24 [auto1.de] INFO: Scrape type for MZ83474: 2
2026-03-30 07:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af2c23a9-dd47-506a-9c22-5461eb9b3e04 with identifier: MZ83474
2026-03-30 07:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af2c23a9-dd47-506a-9c22-5461eb9b3e04 with scrape type 2
2026-03-30 07:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af2c23a9-dd47-506a-9c22-5461eb9b3e04 with scrape type 2
2026-03-30 07:48:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: af2c23a9-dd47-506a-9c22-5461eb9b3e04, identifier: MZ83474
2026-03-30 07:48:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:48:24 [auto1.de] INFO: Found listing with ID: ZT23330
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT23330%27 HTTP/1.1" 200 None
2026-03-30 07:48:24 [auto1.de] INFO: Scrape type for ZT23330: 2
2026-03-30 07:48:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0dfd6db-1e8b-5956-8811-45aa9f6e9443 with identifier: ZT23330
2026-03-30 07:48:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0dfd6db-1e8b-5956-8811-45aa9f6e9443 with scrape type 2
2026-03-30 07:48:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0dfd6db-1e8b-5956-8811-45aa9f6e9443 with scrape type 2
2026-03-30 07:48:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b0dfd6db-1e8b-5956-8811-45aa9f6e9443, identifier: ZT23330
2026-03-30 07:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: af2c23a9-dd47-506a-9c22-5461eb9b3e04 with identifier: MZ83474
2026-03-30 07:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: af2c23a9-dd47-506a-9c22-5461eb9b3e04 with identifier: MZ83474
2026-03-30 07:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: af2c23a9-dd47-506a-9c22-5461eb9b3e04 with identifier: MZ83474 to the API
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:28:45Z',
 'fuel_type': 'diesel',
 'id': 'af2c23a9-dd47-506a-9c22-5461eb9b3e04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ83474',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 186603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-07-21',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'L1H1 2,7t',
 'year': 2011}
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ83474%27 HTTP/1.1" 200 None
2026-03-30 07:48:24 [auto1.de] INFO: Saving data for MZ83474: {'auction_closing_time': 1774884525.0, 'created_time': 1774552908.155593, 'last_price_update_time': 1774856904.652613}
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ83474') HTTP/1.1" 204 0
2026-03-30 07:48:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b0dfd6db-1e8b-5956-8811-45aa9f6e9443 with identifier: ZT23330
2026-03-30 07:48:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b0dfd6db-1e8b-5956-8811-45aa9f6e9443 with identifier: ZT23330
2026-03-30 07:48:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b0dfd6db-1e8b-5956-8811-45aa9f6e9443 with identifier: ZT23330 to the API
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:28:46Z',
 'fuel_type': 'diesel',
 'id': 'b0dfd6db-1e8b-5956-8811-45aa9f6e9443',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT23330',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 383420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-16',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Trendline',
 'transmission': 'automatic',
 'trim': 'Trendline',
 'year': 2010}
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT23330%27 HTTP/1.1" 200 None
2026-03-30 07:48:25 [auto1.de] INFO: Saving data for ZT23330: {'auction_closing_time': 1774884526.0, 'created_time': 1774639633.202773, 'last_price_update_time': 1774856905.060863}
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZT23330') HTTP/1.1" 204 0
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: VX14818
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: ZE75344
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: WP02035
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: GA26329
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: PA30689
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA30689%27 HTTP/1.1" 200 None
2026-03-30 07:48:25 [auto1.de] INFO: Scrape type for PA30689: 0
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: AY81223
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: BR02529
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR02529%27 HTTP/1.1" 200 None
2026-03-30 07:48:25 [auto1.de] INFO: Scrape type for BR02529: 0
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: FW15462
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: UA03321
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA03321%27 HTTP/1.1" 200 None
2026-03-30 07:48:25 [auto1.de] INFO: Scrape type for UA03321: 0
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: DW82351
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: AH97983
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: CE50485
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE50485%27 HTTP/1.1" 200 None
2026-03-30 07:48:25 [auto1.de] INFO: Scrape type for CE50485: 2
2026-03-30 07:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75aa9a17-f92a-5320-ba19-5d8ec63a9022 with identifier: CE50485
2026-03-30 07:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75aa9a17-f92a-5320-ba19-5d8ec63a9022 with scrape type 2
2026-03-30 07:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 75aa9a17-f92a-5320-ba19-5d8ec63a9022 with scrape type 2
2026-03-30 07:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 75aa9a17-f92a-5320-ba19-5d8ec63a9022, identifier: CE50485
2026-03-30 07:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 75aa9a17-f92a-5320-ba19-5d8ec63a9022 with identifier: CE50485
2026-03-30 07:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 75aa9a17-f92a-5320-ba19-5d8ec63a9022 with identifier: CE50485
2026-03-30 07:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 75aa9a17-f92a-5320-ba19-5d8ec63a9022 with identifier: CE50485 to the API
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:28:30Z',
 'fuel_type': 'petrol',
 'id': '75aa9a17-f92a-5320-ba19-5d8ec63a9022',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE50485',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 82781,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-18',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2010}
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE50485%27 HTTP/1.1" 200 None
2026-03-30 07:48:25 [auto1.de] INFO: Saving data for CE50485: {'auction_closing_time': 1774884510.0, 'created_time': 1774640154.859034, 'last_price_update_time': 1774856905.540461}
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE50485') HTTP/1.1" 204 0
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: BR69139
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR69139%27 HTTP/1.1" 200 None
2026-03-30 07:48:25 [auto1.de] INFO: Scrape type for BR69139: 0
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: PG58570
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG58570%27 HTTP/1.1" 200 None
2026-03-30 07:48:25 [auto1.de] INFO: Scrape type for PG58570: 0
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: RW33443
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: ZK16564
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: SM20101
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM20101%27 HTTP/1.1" 200 None
2026-03-30 07:48:25 [auto1.de] INFO: Scrape type for SM20101: 0
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: NP64585
2026-03-30 07:48:25 [auto1.de] INFO: Found listing with ID: ZE45367
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45367%27 HTTP/1.1" 200 None
2026-03-30 07:48:25 [auto1.de] INFO: Scrape type for ZE45367: 2
2026-03-30 07:48:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6caadd32-5738-53f7-b07c-9423dd216f4a with identifier: ZE45367
2026-03-30 07:48:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6caadd32-5738-53f7-b07c-9423dd216f4a with scrape type 2
2026-03-30 07:48:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6caadd32-5738-53f7-b07c-9423dd216f4a with scrape type 2
2026-03-30 07:48:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6caadd32-5738-53f7-b07c-9423dd216f4a, identifier: ZE45367
2026-03-30 07:48:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6caadd32-5738-53f7-b07c-9423dd216f4a with identifier: ZE45367
2026-03-30 07:48:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6caadd32-5738-53f7-b07c-9423dd216f4a with identifier: ZE45367
2026-03-30 07:48:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6caadd32-5738-53f7-b07c-9423dd216f4a with identifier: ZE45367 to the API
2026-03-30 07:48:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:57:56Z',
 'fuel_type': 'petrol',
 'id': '6caadd32-5738-53f7-b07c-9423dd216f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE45367',
 'listing': 'auction',
 'make': 'Mitsubishi',
 'model': 'Space Star',
 'odometer': 173558,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Mitsubishi Space Star 1.0 Diamant Edition',
 'transmission': 'manual',
 'trim': 'Diamant Edition',
 'year': 2016}
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE45367%27 HTTP/1.1" 200 None
2026-03-30 07:48:26 [auto1.de] INFO: Saving data for ZE45367: {'auction_closing_time': 1774886276.0, 'created_time': 1773992120.801251, 'last_price_update_time': 1774856906.136328}
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZE45367') HTTP/1.1" 204 0
2026-03-30 07:48:26 [auto1.de] INFO: Found listing with ID: AF24484
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF24484%27 HTTP/1.1" 200 None
2026-03-30 07:48:26 [auto1.de] INFO: Scrape type for AF24484: 2
2026-03-30 07:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c58bb474-f66c-5199-9f1f-9f4eca4b2208 with identifier: AF24484
2026-03-30 07:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c58bb474-f66c-5199-9f1f-9f4eca4b2208 with scrape type 2
2026-03-30 07:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c58bb474-f66c-5199-9f1f-9f4eca4b2208 with scrape type 2
2026-03-30 07:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c58bb474-f66c-5199-9f1f-9f4eca4b2208, identifier: AF24484
2026-03-30 07:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c58bb474-f66c-5199-9f1f-9f4eca4b2208 with identifier: AF24484
2026-03-30 07:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c58bb474-f66c-5199-9f1f-9f4eca4b2208 with identifier: AF24484
2026-03-30 07:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c58bb474-f66c-5199-9f1f-9f4eca4b2208 with identifier: AF24484 to the API
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:07Z',
 'fuel_type': 'diesel',
 'id': 'c58bb474-f66c-5199-9f1f-9f4eca4b2208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF24484',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 90091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 2.0 TDI Move',
 'transmission': 'automatic',
 'trim': 'Move',
 'year': 2023}
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF24484%27 HTTP/1.1" 200 None
2026-03-30 07:48:26 [auto1.de] INFO: Saving data for AF24484: {'auction_closing_time': 1774886047.0, 'created_time': 1774349968.122802, 'last_price_update_time': 1774856906.529626}
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF24484') HTTP/1.1" 204 0
2026-03-30 07:48:26 [auto1.de] INFO: Found listing with ID: AK41294
2026-03-30 07:48:26 [auto1.de] INFO: Found listing with ID: ST81436
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST81436%27 HTTP/1.1" 200 None
2026-03-30 07:48:26 [auto1.de] INFO: Scrape type for ST81436: 2
2026-03-30 07:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1de25c74-8757-5b65-966f-069f3b0ee73d with identifier: ST81436
2026-03-30 07:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1de25c74-8757-5b65-966f-069f3b0ee73d with scrape type 2
2026-03-30 07:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1de25c74-8757-5b65-966f-069f3b0ee73d with scrape type 2
2026-03-30 07:48:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1de25c74-8757-5b65-966f-069f3b0ee73d, identifier: ST81436
2026-03-30 07:48:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1de25c74-8757-5b65-966f-069f3b0ee73d with identifier: ST81436
2026-03-30 07:48:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1de25c74-8757-5b65-966f-069f3b0ee73d with identifier: ST81436
2026-03-30 07:48:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1de25c74-8757-5b65-966f-069f3b0ee73d with identifier: ST81436 to the API
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:54:16Z',
 'fuel_type': 'petrol',
 'id': '1de25c74-8757-5b65-966f-069f3b0ee73d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST81436',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 212182,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-27',
 'seller_name': None,
 'title': 'BMW 3er 325i',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST81436%27 HTTP/1.1" 200 None
2026-03-30 07:48:26 [auto1.de] INFO: Saving data for ST81436: {'auction_closing_time': 1774886056.0, 'created_time': 1774639493.833905, 'last_price_update_time': 1774856906.936463}
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ST81436') HTTP/1.1" 204 0
2026-03-30 07:48:26 [auto1.de] INFO: Found listing with ID: GD52714
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD52714%27 HTTP/1.1" 200 None
2026-03-30 07:48:26 [auto1.de] INFO: Scrape type for GD52714: 2
2026-03-30 07:48:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498851fa-70e5-50a0-8b6d-ab175d1f74be with identifier: GD52714
2026-03-30 07:48:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498851fa-70e5-50a0-8b6d-ab175d1f74be with scrape type 2
2026-03-30 07:48:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 498851fa-70e5-50a0-8b6d-ab175d1f74be with scrape type 2
2026-03-30 07:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 498851fa-70e5-50a0-8b6d-ab175d1f74be, identifier: GD52714
2026-03-30 07:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 498851fa-70e5-50a0-8b6d-ab175d1f74be with identifier: GD52714
2026-03-30 07:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 498851fa-70e5-50a0-8b6d-ab175d1f74be with identifier: GD52714
2026-03-30 07:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 498851fa-70e5-50a0-8b6d-ab175d1f74be with identifier: GD52714 to the API
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:39:57Z',
 'fuel_type': 'petrol',
 'id': '498851fa-70e5-50a0-8b6d-ab175d1f74be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GD52714',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 17282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seller_name': None,
 'title': 'Renault Captur 0.9 TCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD52714%27 HTTP/1.1" 200 None
2026-03-30 07:48:27 [auto1.de] INFO: Saving data for GD52714: {'auction_closing_time': 1774885197.0, 'created_time': 1774636873.184307, 'last_price_update_time': 1774856907.334003}
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GD52714') HTTP/1.1" 204 0
2026-03-30 07:48:27 [auto1.de] INFO: Found listing with ID: EJ25575
2026-03-30 07:48:27 [auto1.de] INFO: Found listing with ID: XE86723
2026-03-30 07:48:27 [auto1.de] INFO: Found listing with ID: ZX31727
2026-03-30 07:48:27 [auto1.de] INFO: Found listing with ID: SA71883
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA71883%27 HTTP/1.1" 200 None
2026-03-30 07:48:27 [auto1.de] INFO: Scrape type for SA71883: 0
2026-03-30 07:48:27 [auto1.de] INFO: Found listing with ID: EG01443
2026-03-30 07:48:27 [auto1.de] INFO: Found listing with ID: ZU04688
2026-03-30 07:48:27 [auto1.de] INFO: Found listing with ID: RT49707
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49707%27 HTTP/1.1" 200 None
2026-03-30 07:48:27 [auto1.de] INFO: Scrape type for RT49707: 2
2026-03-30 07:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69161d6f-e476-57a9-9f20-001d1c4df6f5 with identifier: RT49707
2026-03-30 07:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69161d6f-e476-57a9-9f20-001d1c4df6f5 with scrape type 2
2026-03-30 07:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69161d6f-e476-57a9-9f20-001d1c4df6f5 with scrape type 2
2026-03-30 07:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69161d6f-e476-57a9-9f20-001d1c4df6f5, identifier: RT49707
2026-03-30 07:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69161d6f-e476-57a9-9f20-001d1c4df6f5 with identifier: RT49707
2026-03-30 07:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69161d6f-e476-57a9-9f20-001d1c4df6f5 with identifier: RT49707
2026-03-30 07:48:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69161d6f-e476-57a9-9f20-001d1c4df6f5 with identifier: RT49707 to the API
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:33:27Z',
 'fuel_type': 'petrol',
 'id': '69161d6f-e476-57a9-9f20-001d1c4df6f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT49707',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 81921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-14',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 EX',
 'transmission': 'manual',
 'trim': 'EX',
 'year': 2010}
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT49707%27 HTTP/1.1" 200 None
2026-03-30 07:48:27 [auto1.de] INFO: Saving data for RT49707: {'auction_closing_time': 1774884807.0, 'created_time': 1774637171.673453, 'last_price_update_time': 1774856907.84852}
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT49707') HTTP/1.1" 204 0
2026-03-30 07:48:27 [auto1.de] INFO: Found listing with ID: KG76209
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG76209%27 HTTP/1.1" 200 None
2026-03-30 07:48:27 [auto1.de] INFO: Scrape type for KG76209: 2
2026-03-30 07:48:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d29a8cad-be5d-56ff-823e-87447e7d7f9a with identifier: KG76209
2026-03-30 07:48:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d29a8cad-be5d-56ff-823e-87447e7d7f9a with scrape type 2
2026-03-30 07:48:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d29a8cad-be5d-56ff-823e-87447e7d7f9a with scrape type 2
2026-03-30 07:48:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d29a8cad-be5d-56ff-823e-87447e7d7f9a, identifier: KG76209
2026-03-30 07:48:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d29a8cad-be5d-56ff-823e-87447e7d7f9a with identifier: KG76209
2026-03-30 07:48:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d29a8cad-be5d-56ff-823e-87447e7d7f9a with identifier: KG76209
2026-03-30 07:48:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d29a8cad-be5d-56ff-823e-87447e7d7f9a with identifier: KG76209 to the API
2026-03-30 07:48:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:33:59Z',
 'fuel_type': 'diesel',
 'id': 'd29a8cad-be5d-56ff-823e-87447e7d7f9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG76209',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 108692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-18',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 d T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2019}
2026-03-30 07:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG76209%27 HTTP/1.1" 200 None
2026-03-30 07:48:28 [auto1.de] INFO: Saving data for KG76209: {'auction_closing_time': 1774884839.0, 'created_time': 1774552974.631876, 'last_price_update_time': 1774856908.251645}
2026-03-30 07:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG76209') HTTP/1.1" 204 0
2026-03-30 07:48:28 [auto1.de] INFO: Found listing with ID: JA06342
2026-03-30 07:48:28 [auto1.de] INFO: Found listing with ID: BF09730
2026-03-30 07:48:28 [auto1.de] INFO: Found listing with ID: RC79950
2026-03-30 07:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC79950%27 HTTP/1.1" 200 None
2026-03-30 07:48:28 [auto1.de] INFO: Scrape type for RC79950: 0
2026-03-30 07:48:28 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-30 07:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-30 07:48:28 [auto1.de] INFO: Scrape type for BC36387: 0
2026-03-30 07:48:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:48:29 [auto1.de] INFO: Channel: 24h | Page: 146 | totalHits: 8403 | hits on page: 40
2026-03-30 07:48:29 [auto1.de] INFO: Found listing with ID: BC36387
2026-03-30 07:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC36387%27 HTTP/1.1" 200 None
2026-03-30 07:48:29 [auto1.de] INFO: Scrape type for BC36387: 0
2026-03-30 07:48:29 [auto1.de] INFO: Found listing with ID: ED78349
2026-03-30 07:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED78349%27 HTTP/1.1" 200 None
2026-03-30 07:48:29 [auto1.de] INFO: Scrape type for ED78349: 2
2026-03-30 07:48:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 843a419d-de10-50b7-8762-994e7423caca with identifier: ED78349
2026-03-30 07:48:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 843a419d-de10-50b7-8762-994e7423caca with scrape type 2
2026-03-30 07:48:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 843a419d-de10-50b7-8762-994e7423caca with scrape type 2
2026-03-30 07:48:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 843a419d-de10-50b7-8762-994e7423caca, identifier: ED78349
2026-03-30 07:48:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 843a419d-de10-50b7-8762-994e7423caca with identifier: ED78349
2026-03-30 07:48:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 843a419d-de10-50b7-8762-994e7423caca with identifier: ED78349
2026-03-30 07:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 843a419d-de10-50b7-8762-994e7423caca with identifier: ED78349 to the API
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:59:02Z',
 'fuel_type': 'petrol',
 'id': '843a419d-de10-50b7-8762-994e7423caca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED78349',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 166290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-20',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2014}
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED78349%27 HTTP/1.1" 200 None
2026-03-30 07:48:30 [auto1.de] INFO: Saving data for ED78349: {'auction_closing_time': 1774886342.0, 'created_time': 1774550159.485574, 'last_price_update_time': 1774856910.292071}
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED78349') HTTP/1.1" 204 0
2026-03-30 07:48:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:48:30 [auto1.de] INFO: Found listing with ID: YF85970
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF85970%27 HTTP/1.1" 200 None
2026-03-30 07:48:30 [auto1.de] INFO: Scrape type for YF85970: 0
2026-03-30 07:48:30 [auto1.de] INFO: Found listing with ID: YK39735
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK39735%27 HTTP/1.1" 200 None
2026-03-30 07:48:30 [auto1.de] INFO: Scrape type for YK39735: 2
2026-03-30 07:48:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1eef84a-6d14-5b13-a338-9685d5cfd418 with identifier: YK39735
2026-03-30 07:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1eef84a-6d14-5b13-a338-9685d5cfd418 with scrape type 2
2026-03-30 07:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1eef84a-6d14-5b13-a338-9685d5cfd418 with scrape type 2
2026-03-30 07:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1eef84a-6d14-5b13-a338-9685d5cfd418, identifier: YK39735
2026-03-30 07:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1eef84a-6d14-5b13-a338-9685d5cfd418 with identifier: YK39735
2026-03-30 07:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1eef84a-6d14-5b13-a338-9685d5cfd418 with identifier: YK39735
2026-03-30 07:48:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1eef84a-6d14-5b13-a338-9685d5cfd418 with identifier: YK39735 to the API
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:41:55Z',
 'fuel_type': 'petrol',
 'id': 'b1eef84a-6d14-5b13-a338-9685d5cfd418',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK39735',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 109564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-30',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2006}
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK39735%27 HTTP/1.1" 200 None
2026-03-30 07:48:30 [auto1.de] INFO: Saving data for YK39735: {'auction_closing_time': 1774885315.0, 'created_time': 1774638579.495763, 'last_price_update_time': 1774856910.819328}
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YK39735') HTTP/1.1" 204 0
2026-03-30 07:48:30 [auto1.de] INFO: Found listing with ID: SA20211
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA20211%27 HTTP/1.1" 200 None
2026-03-30 07:48:30 [auto1.de] INFO: Scrape type for SA20211: 2
2026-03-30 07:48:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16c0a48d-157c-57da-ae88-ffc9ab8ec0f7 with identifier: SA20211
2026-03-30 07:48:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16c0a48d-157c-57da-ae88-ffc9ab8ec0f7 with scrape type 2
2026-03-30 07:48:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16c0a48d-157c-57da-ae88-ffc9ab8ec0f7 with scrape type 2
2026-03-30 07:48:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 16c0a48d-157c-57da-ae88-ffc9ab8ec0f7, identifier: SA20211
2026-03-30 07:48:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 16c0a48d-157c-57da-ae88-ffc9ab8ec0f7 with identifier: SA20211
2026-03-30 07:48:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 16c0a48d-157c-57da-ae88-ffc9ab8ec0f7 with identifier: SA20211
2026-03-30 07:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 16c0a48d-157c-57da-ae88-ffc9ab8ec0f7 with identifier: SA20211 to the API
2026-03-30 07:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:41:20Z',
 'fuel_type': 'petrol',
 'id': '16c0a48d-157c-57da-ae88-ffc9ab8ec0f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA20211',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 152259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-11-29',
 'seller_name': None,
 'title': 'Mazda 6 2.3 Top Sport',
 'transmission': 'manual',
 'trim': 'Top Sport',
 'year': 2004}
2026-03-30 07:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA20211%27 HTTP/1.1" 200 None
2026-03-30 07:48:31 [auto1.de] INFO: Saving data for SA20211: {'auction_closing_time': 1774885280.0, 'created_time': 1774638531.840059, 'last_price_update_time': 1774856911.627641}
2026-03-30 07:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA20211') HTTP/1.1" 204 0
2026-03-30 07:48:31 [auto1.de] INFO: Found listing with ID: LZ35604
2026-03-30 07:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ35604%27 HTTP/1.1" 200 None
2026-03-30 07:48:31 [auto1.de] INFO: Scrape type for LZ35604: 2
2026-03-30 07:48:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b40ddeb-5a3b-5c7e-8242-9d66b3e81710 with identifier: LZ35604
2026-03-30 07:48:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b40ddeb-5a3b-5c7e-8242-9d66b3e81710 with scrape type 2
2026-03-30 07:48:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b40ddeb-5a3b-5c7e-8242-9d66b3e81710 with scrape type 2
2026-03-30 07:48:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5b40ddeb-5a3b-5c7e-8242-9d66b3e81710, identifier: LZ35604
2026-03-30 07:48:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5b40ddeb-5a3b-5c7e-8242-9d66b3e81710 with identifier: LZ35604
2026-03-30 07:48:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5b40ddeb-5a3b-5c7e-8242-9d66b3e81710 with identifier: LZ35604
2026-03-30 07:48:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5b40ddeb-5a3b-5c7e-8242-9d66b3e81710 with identifier: LZ35604 to the API
2026-03-30 07:48:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:31:10Z',
 'fuel_type': 'petrol',
 'id': '5b40ddeb-5a3b-5c7e-8242-9d66b3e81710',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ35604',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 200111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-08',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Sound BlueMotion',
 'transmission': 'manual',
 'trim': 'Sound BlueMotion',
 'year': 2018}
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ35604%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Saving data for LZ35604: {'auction_closing_time': 1774884670.0, 'created_time': 1774639611.267182, 'last_price_update_time': 1774856912.04451}
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ35604') HTTP/1.1" 204 0
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: GK53222
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: NU80618
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU80618%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Scrape type for NU80618: 0
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: NB64458
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: ZY22077
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: PR91039
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: BV47016
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: HT24863
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: KL53394
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL53394%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Scrape type for KL53394: 0
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: YC50370
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: AX34994
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34994%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Scrape type for AX34994: 0
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: GA20411
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA20411%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Scrape type for GA20411: 0
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: MZ26894
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: DV57223
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV57223%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Scrape type for DV57223: 0
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: RC04315
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: UH91436
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH91436%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Scrape type for UH91436: 0
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: XF59932
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: XS21978
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: JV29717
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV29717%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Scrape type for JV29717: 0
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: JG70236
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: YL01247
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL01247%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Scrape type for YL01247: 2
2026-03-30 07:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with identifier: YL01247
2026-03-30 07:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with scrape type 2
2026-03-30 07:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with scrape type 2
2026-03-30 07:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9f9e0ad3-b70a-5368-9856-91d8d02b6f52, identifier: YL01247
2026-03-30 07:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with identifier: YL01247
2026-03-30 07:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with identifier: YL01247
2026-03-30 07:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9f9e0ad3-b70a-5368-9856-91d8d02b6f52 with identifier: YL01247 to the API
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:51:28Z',
 'fuel_type': 'petrol',
 'id': '9f9e0ad3-b70a-5368-9856-91d8d02b6f52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL01247',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 23034,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-09-01',
 'seller_name': None,
 'title': "Kia cee'd 1.5 TGDI Spirit",
 'transmission': 'manual',
 'trim': 'Spirit',
 'year': 2025}
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL01247%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Saving data for YL01247: {'auction_closing_time': 1774885888.0, 'created_time': 1774552813.241819, 'last_price_update_time': 1774856912.657598}
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YL01247') HTTP/1.1" 204 0
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: BS14183
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: XT97786
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT97786%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Scrape type for XT97786: 0
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: CP03676
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: BT69693
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: CY07264
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: CM68518
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: FL51955
2026-03-30 07:48:32 [auto1.de] INFO: Found listing with ID: PL91584
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL91584%27 HTTP/1.1" 200 None
2026-03-30 07:48:32 [auto1.de] INFO: Scrape type for PL91584: 2
2026-03-30 07:48:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 00dbf01d-fa27-5818-b57d-8afc38c9b406 with identifier: PL91584
2026-03-30 07:48:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 00dbf01d-fa27-5818-b57d-8afc38c9b406 with scrape type 2
2026-03-30 07:48:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 00dbf01d-fa27-5818-b57d-8afc38c9b406 with scrape type 2
2026-03-30 07:48:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 00dbf01d-fa27-5818-b57d-8afc38c9b406, identifier: PL91584
2026-03-30 07:48:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 00dbf01d-fa27-5818-b57d-8afc38c9b406 with identifier: PL91584
2026-03-30 07:48:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 00dbf01d-fa27-5818-b57d-8afc38c9b406 with identifier: PL91584
2026-03-30 07:48:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 00dbf01d-fa27-5818-b57d-8afc38c9b406 with identifier: PL91584 to the API
2026-03-30 07:48:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 144,
 'expiration_date': '2026-03-30T15:22:36Z',
 'fuel_type': 'diesel',
 'id': '00dbf01d-fa27-5818-b57d-8afc38c9b406',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PL91584',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 46567,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-27',
 'seller_name': None,
 'title': 'Peugeot Expert 2.0 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2022}
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL91584%27 HTTP/1.1" 200 None
2026-03-30 07:48:33 [auto1.de] INFO: Saving data for PL91584: {'auction_closing_time': 1774884156.0, 'created_time': 1773916534.865389, 'last_price_update_time': 1774856913.183918}
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PL91584') HTTP/1.1" 204 0
2026-03-30 07:48:33 [auto1.de] INFO: Found listing with ID: ZJ17739
2026-03-30 07:48:33 [auto1.de] INFO: Found listing with ID: PP77608
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP77608%27 HTTP/1.1" 200 None
2026-03-30 07:48:33 [auto1.de] INFO: Scrape type for PP77608: 2
2026-03-30 07:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d628f5e2-e5a4-54eb-a876-1cc1df08e3d2 with identifier: PP77608
2026-03-30 07:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d628f5e2-e5a4-54eb-a876-1cc1df08e3d2 with scrape type 2
2026-03-30 07:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d628f5e2-e5a4-54eb-a876-1cc1df08e3d2 with scrape type 2
2026-03-30 07:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d628f5e2-e5a4-54eb-a876-1cc1df08e3d2, identifier: PP77608
2026-03-30 07:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d628f5e2-e5a4-54eb-a876-1cc1df08e3d2 with identifier: PP77608
2026-03-30 07:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d628f5e2-e5a4-54eb-a876-1cc1df08e3d2 with identifier: PP77608
2026-03-30 07:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d628f5e2-e5a4-54eb-a876-1cc1df08e3d2 with identifier: PP77608 to the API
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-30T15:19:14Z',
 'fuel_type': 'petrol',
 'id': 'd628f5e2-e5a4-54eb-a876-1cc1df08e3d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP77608',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 106038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-29',
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2006}
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP77608%27 HTTP/1.1" 200 None
2026-03-30 07:48:33 [auto1.de] INFO: Saving data for PP77608: {'auction_closing_time': 1774883954.0, 'created_time': 1774640114.805715, 'last_price_update_time': 1774856913.596597}
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PP77608') HTTP/1.1" 204 0
2026-03-30 07:48:33 [auto1.de] INFO: Found listing with ID: BS79013
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS79013%27 HTTP/1.1" 200 None
2026-03-30 07:48:33 [auto1.de] INFO: Scrape type for BS79013: 2
2026-03-30 07:48:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1e6bc8d-e483-5c37-a2a5-faa26033499d with identifier: BS79013
2026-03-30 07:48:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1e6bc8d-e483-5c37-a2a5-faa26033499d with scrape type 2
2026-03-30 07:48:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1e6bc8d-e483-5c37-a2a5-faa26033499d with scrape type 2
2026-03-30 07:48:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1e6bc8d-e483-5c37-a2a5-faa26033499d, identifier: BS79013
2026-03-30 07:48:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1e6bc8d-e483-5c37-a2a5-faa26033499d with identifier: BS79013
2026-03-30 07:48:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1e6bc8d-e483-5c37-a2a5-faa26033499d with identifier: BS79013
2026-03-30 07:48:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1e6bc8d-e483-5c37-a2a5-faa26033499d with identifier: BS79013 to the API
2026-03-30 07:48:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:39:05Z',
 'fuel_type': 'diesel',
 'id': 'd1e6bc8d-e483-5c37-a2a5-faa26033499d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS79013',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 186128,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-24',
 'seller_name': None,
 'title': 'Seat Ibiza 2.0 TDI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2015}
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS79013%27 HTTP/1.1" 200 None
2026-03-30 07:48:34 [auto1.de] INFO: Saving data for BS79013: {'auction_closing_time': 1774885145.0, 'created_time': 1774639597.745157, 'last_price_update_time': 1774856914.373864}
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS79013') HTTP/1.1" 204 0
2026-03-30 07:48:34 [auto1.de] INFO: Found listing with ID: JD13909
2026-03-30 07:48:34 [auto1.de] INFO: Found listing with ID: CR52623
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR52623%27 HTTP/1.1" 200 None
2026-03-30 07:48:34 [auto1.de] INFO: Scrape type for CR52623: 0
2026-03-30 07:48:34 [auto1.de] INFO: Found listing with ID: DB13775
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB13775%27 HTTP/1.1" 200 None
2026-03-30 07:48:34 [auto1.de] INFO: Scrape type for DB13775: 0
2026-03-30 07:48:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:48:34 [auto1.de] INFO: Channel: 24h | Page: 147 | totalHits: 8403 | hits on page: 40
2026-03-30 07:48:34 [auto1.de] INFO: Found listing with ID: LZ21667
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ21667%27 HTTP/1.1" 200 None
2026-03-30 07:48:34 [auto1.de] INFO: Scrape type for LZ21667: 2
2026-03-30 07:48:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 792326b9-7eff-5dea-8690-079ff99ccbd0 with identifier: LZ21667
2026-03-30 07:48:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 792326b9-7eff-5dea-8690-079ff99ccbd0 with scrape type 2
2026-03-30 07:48:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 792326b9-7eff-5dea-8690-079ff99ccbd0 with scrape type 2
2026-03-30 07:48:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 792326b9-7eff-5dea-8690-079ff99ccbd0, identifier: LZ21667
2026-03-30 07:48:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 792326b9-7eff-5dea-8690-079ff99ccbd0 with identifier: LZ21667
2026-03-30 07:48:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 792326b9-7eff-5dea-8690-079ff99ccbd0 with identifier: LZ21667
2026-03-30 07:48:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 792326b9-7eff-5dea-8690-079ff99ccbd0 with identifier: LZ21667 to the API
2026-03-30 07:48:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:53:55Z',
 'fuel_type': 'diesel',
 'id': '792326b9-7eff-5dea-8690-079ff99ccbd0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ21667',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 98887,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-25',
 'seller_name': None,
 'title': 'Dacia Dokker 1.5 dCi Diesel Laureate',
 'transmission': 'manual',
 'trim': 'Laureate',
 'year': 2017}
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ21667%27 HTTP/1.1" 200 None
2026-03-30 07:48:35 [auto1.de] INFO: Saving data for LZ21667: {'auction_closing_time': 1774886035.0, 'created_time': 1774002400.934827, 'last_price_update_time': 1774856915.153246}
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LZ21667') HTTP/1.1" 204 0
2026-03-30 07:48:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:48:35 [auto1.de] INFO: Found listing with ID: SJ57500
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ57500%27 HTTP/1.1" 200 None
2026-03-30 07:48:35 [auto1.de] INFO: Scrape type for SJ57500: 2
2026-03-30 07:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 877fd754-823f-5ec6-831d-2e8a099de45b with identifier: SJ57500
2026-03-30 07:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 877fd754-823f-5ec6-831d-2e8a099de45b with scrape type 2
2026-03-30 07:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 877fd754-823f-5ec6-831d-2e8a099de45b with scrape type 2
2026-03-30 07:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 877fd754-823f-5ec6-831d-2e8a099de45b, identifier: SJ57500
2026-03-30 07:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 877fd754-823f-5ec6-831d-2e8a099de45b with identifier: SJ57500
2026-03-30 07:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 877fd754-823f-5ec6-831d-2e8a099de45b with identifier: SJ57500
2026-03-30 07:48:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 877fd754-823f-5ec6-831d-2e8a099de45b with identifier: SJ57500 to the API
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:34Z',
 'fuel_type': 'diesel',
 'id': '877fd754-823f-5ec6-831d-2e8a099de45b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ57500',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 194593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-15',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Comfortline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2019}
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SJ57500%27 HTTP/1.1" 200 None
2026-03-30 07:48:35 [auto1.de] INFO: Saving data for SJ57500: {'auction_closing_time': 1774884214.0, 'created_time': 1774639516.135161, 'last_price_update_time': 1774856915.730382}
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SJ57500') HTTP/1.1" 204 0
2026-03-30 07:48:35 [auto1.de] INFO: Found listing with ID: TF11415
2026-03-30 07:48:35 [auto1.de] INFO: Found listing with ID: CU14126
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14126%27 HTTP/1.1" 200 None
2026-03-30 07:48:35 [auto1.de] INFO: Scrape type for CU14126: 2
2026-03-30 07:48:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81f19a75-3083-5e8b-9041-efa634dd7eb2 with identifier: CU14126
2026-03-30 07:48:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81f19a75-3083-5e8b-9041-efa634dd7eb2 with scrape type 2
2026-03-30 07:48:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81f19a75-3083-5e8b-9041-efa634dd7eb2 with scrape type 2
2026-03-30 07:48:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81f19a75-3083-5e8b-9041-efa634dd7eb2, identifier: CU14126
2026-03-30 07:48:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81f19a75-3083-5e8b-9041-efa634dd7eb2 with identifier: CU14126
2026-03-30 07:48:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81f19a75-3083-5e8b-9041-efa634dd7eb2 with identifier: CU14126
2026-03-30 07:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81f19a75-3083-5e8b-9041-efa634dd7eb2 with identifier: CU14126 to the API
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:06:53Z',
 'fuel_type': 'diesel',
 'id': '81f19a75-3083-5e8b-9041-efa634dd7eb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU14126',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 277028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-28',
 'seller_name': None,
 'title': 'BMW 5er 530d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU14126%27 HTTP/1.1" 200 None
2026-03-30 07:48:36 [auto1.de] INFO: Saving data for CU14126: {'auction_closing_time': 1774883213.0, 'created_time': 1773946780.507217, 'last_price_update_time': 1774856916.22432}
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU14126') HTTP/1.1" 204 0
2026-03-30 07:48:36 [auto1.de] INFO: Found listing with ID: LG31115
2026-03-30 07:48:36 [auto1.de] INFO: Found listing with ID: KR15708
2026-03-30 07:48:36 [auto1.de] INFO: Found listing with ID: JS62021
2026-03-30 07:48:36 [auto1.de] INFO: Found listing with ID: SP90277
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP90277%27 HTTP/1.1" 200 None
2026-03-30 07:48:36 [auto1.de] INFO: Scrape type for SP90277: 2
2026-03-30 07:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with identifier: SP90277
2026-03-30 07:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with scrape type 2
2026-03-30 07:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with scrape type 2
2026-03-30 07:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80fb2d25-921b-57f0-ac56-1c9aa6dfa885, identifier: SP90277
2026-03-30 07:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with identifier: SP90277
2026-03-30 07:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with identifier: SP90277
2026-03-30 07:48:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80fb2d25-921b-57f0-ac56-1c9aa6dfa885 with identifier: SP90277 to the API
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:02:58Z',
 'fuel_type': 'diesel',
 'id': '80fb2d25-921b-57f0-ac56-1c9aa6dfa885',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP90277',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Kombi',
 'odometer': 322220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-08-12',
 'seller_name': None,
 'title': 'Volkswagen T5 Kombi 1.9 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP90277%27 HTTP/1.1" 200 None
2026-03-30 07:48:36 [auto1.de] INFO: Saving data for SP90277: {'auction_closing_time': 1774882978.0, 'created_time': 1774553185.060257, 'last_price_update_time': 1774856916.662294}
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SP90277') HTTP/1.1" 204 0
2026-03-30 07:48:36 [auto1.de] INFO: Found listing with ID: UX71045
2026-03-30 07:48:36 [auto1.de] INFO: Found listing with ID: DE35783
2026-03-30 07:48:36 [auto1.de] INFO: Found listing with ID: NS47503
2026-03-30 07:48:36 [auto1.de] INFO: Found listing with ID: MS43037
2026-03-30 07:48:36 [auto1.de] INFO: Found listing with ID: VX06445
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX06445%27 HTTP/1.1" 200 None
2026-03-30 07:48:36 [auto1.de] INFO: Scrape type for VX06445: 0
2026-03-30 07:48:36 [auto1.de] INFO: Found listing with ID: RH48062
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH48062%27 HTTP/1.1" 200 None
2026-03-30 07:48:36 [auto1.de] INFO: Scrape type for RH48062: 2
2026-03-30 07:48:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe06f1b7-d8da-577c-87ea-6d00335799d6 with identifier: RH48062
2026-03-30 07:48:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe06f1b7-d8da-577c-87ea-6d00335799d6 with scrape type 2
2026-03-30 07:48:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe06f1b7-d8da-577c-87ea-6d00335799d6 with scrape type 2
2026-03-30 07:48:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fe06f1b7-d8da-577c-87ea-6d00335799d6, identifier: RH48062
2026-03-30 07:48:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fe06f1b7-d8da-577c-87ea-6d00335799d6 with identifier: RH48062
2026-03-30 07:48:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fe06f1b7-d8da-577c-87ea-6d00335799d6 with identifier: RH48062
2026-03-30 07:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fe06f1b7-d8da-577c-87ea-6d00335799d6 with identifier: RH48062 to the API
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:17:16Z',
 'fuel_type': 'diesel',
 'id': 'fe06f1b7-d8da-577c-87ea-6d00335799d6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH48062',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 271893,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-27',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2015}
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH48062%27 HTTP/1.1" 200 None
2026-03-30 07:48:37 [auto1.de] INFO: Saving data for RH48062: {'auction_closing_time': 1774883836.0, 'created_time': 1774639242.56424, 'last_price_update_time': 1774856917.182058}
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH48062') HTTP/1.1" 204 0
2026-03-30 07:48:37 [auto1.de] INFO: Found listing with ID: KS04135
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS04135%27 HTTP/1.1" 200 None
2026-03-30 07:48:37 [auto1.de] INFO: Scrape type for KS04135: 2
2026-03-30 07:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b093800-c6e8-500b-807e-02f8b77de3c9 with identifier: KS04135
2026-03-30 07:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b093800-c6e8-500b-807e-02f8b77de3c9 with scrape type 2
2026-03-30 07:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b093800-c6e8-500b-807e-02f8b77de3c9 with scrape type 2
2026-03-30 07:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b093800-c6e8-500b-807e-02f8b77de3c9, identifier: KS04135
2026-03-30 07:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b093800-c6e8-500b-807e-02f8b77de3c9 with identifier: KS04135
2026-03-30 07:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b093800-c6e8-500b-807e-02f8b77de3c9 with identifier: KS04135
2026-03-30 07:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b093800-c6e8-500b-807e-02f8b77de3c9 with identifier: KS04135 to the API
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:10:06Z',
 'fuel_type': 'petrol',
 'id': '9b093800-c6e8-500b-807e-02f8b77de3c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS04135',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 83802,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-09-29',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 VTi Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2013}
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS04135%27 HTTP/1.1" 200 None
2026-03-30 07:48:37 [auto1.de] INFO: Saving data for KS04135: {'auction_closing_time': 1774883406.0, 'created_time': 1774639453.766013, 'last_price_update_time': 1774856917.593}
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS04135') HTTP/1.1" 204 0
2026-03-30 07:48:37 [auto1.de] INFO: Found listing with ID: CV42130
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV42130%27 HTTP/1.1" 200 None
2026-03-30 07:48:37 [auto1.de] INFO: Scrape type for CV42130: 2
2026-03-30 07:48:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d83799-6f91-53a7-90a9-4bf5bf24e31e with identifier: CV42130
2026-03-30 07:48:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d83799-6f91-53a7-90a9-4bf5bf24e31e with scrape type 2
2026-03-30 07:48:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66d83799-6f91-53a7-90a9-4bf5bf24e31e with scrape type 2
2026-03-30 07:48:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 66d83799-6f91-53a7-90a9-4bf5bf24e31e, identifier: CV42130
2026-03-30 07:48:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 66d83799-6f91-53a7-90a9-4bf5bf24e31e with identifier: CV42130
2026-03-30 07:48:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 66d83799-6f91-53a7-90a9-4bf5bf24e31e with identifier: CV42130
2026-03-30 07:48:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 66d83799-6f91-53a7-90a9-4bf5bf24e31e with identifier: CV42130 to the API
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:33Z',
 'fuel_type': 'petrol',
 'id': '66d83799-6f91-53a7-90a9-4bf5bf24e31e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV42130',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 123078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-27',
 'seller_name': None,
 'title': 'Renault Megane 1.3 TCe Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2019}
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV42130%27 HTTP/1.1" 200 None
2026-03-30 07:48:38 [auto1.de] INFO: Saving data for CV42130: {'auction_closing_time': 1774886193.0, 'created_time': 1773229184.886588, 'last_price_update_time': 1774856918.018042}
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV42130') HTTP/1.1" 204 0
2026-03-30 07:48:38 [auto1.de] INFO: Found listing with ID: BD42318
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD42318%27 HTTP/1.1" 200 None
2026-03-30 07:48:38 [auto1.de] INFO: Scrape type for BD42318: 0
2026-03-30 07:48:38 [auto1.de] INFO: Found listing with ID: WS30363
2026-03-30 07:48:38 [auto1.de] INFO: Found listing with ID: HB69443
2026-03-30 07:48:38 [auto1.de] INFO: Found listing with ID: ZY94421
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY94421%27 HTTP/1.1" 200 None
2026-03-30 07:48:38 [auto1.de] INFO: Scrape type for ZY94421: 0
2026-03-30 07:48:38 [auto1.de] INFO: Found listing with ID: BU63404
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU63404%27 HTTP/1.1" 200 None
2026-03-30 07:48:38 [auto1.de] INFO: Scrape type for BU63404: 0
2026-03-30 07:48:38 [auto1.de] INFO: Found listing with ID: VE85293
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE85293%27 HTTP/1.1" 200 None
2026-03-30 07:48:38 [auto1.de] INFO: Scrape type for VE85293: 2
2026-03-30 07:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 773b7077-8ca4-5e06-b6bb-1722b33d7c42 with identifier: VE85293
2026-03-30 07:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 773b7077-8ca4-5e06-b6bb-1722b33d7c42 with scrape type 2
2026-03-30 07:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 773b7077-8ca4-5e06-b6bb-1722b33d7c42 with scrape type 2
2026-03-30 07:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 773b7077-8ca4-5e06-b6bb-1722b33d7c42, identifier: VE85293
2026-03-30 07:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 773b7077-8ca4-5e06-b6bb-1722b33d7c42 with identifier: VE85293
2026-03-30 07:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 773b7077-8ca4-5e06-b6bb-1722b33d7c42 with identifier: VE85293
2026-03-30 07:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 773b7077-8ca4-5e06-b6bb-1722b33d7c42 with identifier: VE85293 to the API
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:12:47Z',
 'fuel_type': 'diesel',
 'id': '773b7077-8ca4-5e06-b6bb-1722b33d7c42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE85293',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 195035,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-16',
 'seller_name': None,
 'title': 'Audi A1 Sportback 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2014}
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE85293%27 HTTP/1.1" 200 None
2026-03-30 07:48:38 [auto1.de] INFO: Saving data for VE85293: {'auction_closing_time': 1774883567.0, 'created_time': 1774639395.469204, 'last_price_update_time': 1774856918.473974}
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE85293') HTTP/1.1" 204 0
2026-03-30 07:48:38 [auto1.de] INFO: Found listing with ID: HT41484
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT41484%27 HTTP/1.1" 200 None
2026-03-30 07:48:38 [auto1.de] INFO: Scrape type for HT41484: 2
2026-03-30 07:48:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58ae0e5c-66dd-5669-afee-f48e75c51117 with identifier: HT41484
2026-03-30 07:48:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58ae0e5c-66dd-5669-afee-f48e75c51117 with scrape type 2
2026-03-30 07:48:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58ae0e5c-66dd-5669-afee-f48e75c51117 with scrape type 2
2026-03-30 07:48:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 58ae0e5c-66dd-5669-afee-f48e75c51117, identifier: HT41484
2026-03-30 07:48:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:48:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 58ae0e5c-66dd-5669-afee-f48e75c51117 with identifier: HT41484
2026-03-30 07:48:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 58ae0e5c-66dd-5669-afee-f48e75c51117 with identifier: HT41484
2026-03-30 07:48:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 58ae0e5c-66dd-5669-afee-f48e75c51117 with identifier: HT41484 to the API
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:22:55Z',
 'fuel_type': 'petrol',
 'id': '58ae0e5c-66dd-5669-afee-f48e75c51117',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT41484',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 67708,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-17',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Select',
 'transmission': 'manual',
 'trim': 'Select',
 'year': 2020}
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HT41484%27 HTTP/1.1" 200 None
2026-03-30 07:48:38 [auto1.de] INFO: Saving data for HT41484: {'auction_closing_time': 1774884175.0, 'created_time': 1774552956.286337, 'last_price_update_time': 1774856918.974047}
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HT41484') HTTP/1.1" 204 0
2026-03-30 07:48:38 [auto1.de] INFO: Found listing with ID: HU97464
2026-03-30 07:48:38 [auto1.de] INFO: Found listing with ID: FS23827
2026-03-30 07:48:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS23827%27 HTTP/1.1" 200 None
2026-03-30 07:48:39 [auto1.de] INFO: Scrape type for FS23827: 2
2026-03-30 07:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07091025-91c3-5f9c-836c-9d6f4facf9cf with identifier: FS23827
2026-03-30 07:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07091025-91c3-5f9c-836c-9d6f4facf9cf with scrape type 2
2026-03-30 07:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07091025-91c3-5f9c-836c-9d6f4facf9cf with scrape type 2
2026-03-30 07:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 07091025-91c3-5f9c-836c-9d6f4facf9cf, identifier: FS23827
2026-03-30 07:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 07091025-91c3-5f9c-836c-9d6f4facf9cf with identifier: FS23827
2026-03-30 07:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 07091025-91c3-5f9c-836c-9d6f4facf9cf with identifier: FS23827
2026-03-30 07:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 07091025-91c3-5f9c-836c-9d6f4facf9cf with identifier: FS23827 to the API
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 116,
 'expiration_date': '2026-03-30T15:40:09Z',
 'fuel_type': 'petrol',
 'id': '07091025-91c3-5f9c-836c-9d6f4facf9cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS23827',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 75488,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-13',
 'seller_name': None,
 'title': 'Audi A1 Sportback 30 TFSI Advanced',
 'transmission': 'manual',
 'trim': 'Advanced',
 'year': 2020}
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS23827%27 HTTP/1.1" 200 None
2026-03-30 07:48:39 [auto1.de] INFO: Saving data for FS23827: {'auction_closing_time': 1774885209.0, 'created_time': 1774638928.902774, 'last_price_update_time': 1774856919.368495}
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FS23827') HTTP/1.1" 204 0
2026-03-30 07:48:39 [auto1.de] INFO: Found listing with ID: EB16360
2026-03-30 07:48:39 [auto1.de] INFO: Found listing with ID: FW07623
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW07623%27 HTTP/1.1" 200 None
2026-03-30 07:48:39 [auto1.de] INFO: Scrape type for FW07623: 0
2026-03-30 07:48:39 [auto1.de] INFO: Found listing with ID: XS31792
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS31792%27 HTTP/1.1" 200 None
2026-03-30 07:48:39 [auto1.de] INFO: Scrape type for XS31792: 0
2026-03-30 07:48:39 [auto1.de] INFO: Found listing with ID: MH67874
2026-03-30 07:48:39 [auto1.de] INFO: Found listing with ID: TP43988
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP43988%27 HTTP/1.1" 200 None
2026-03-30 07:48:39 [auto1.de] INFO: Scrape type for TP43988: 2
2026-03-30 07:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d931e49c-1b26-517e-b376-2036f229a43b with identifier: TP43988
2026-03-30 07:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d931e49c-1b26-517e-b376-2036f229a43b with scrape type 2
2026-03-30 07:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d931e49c-1b26-517e-b376-2036f229a43b with scrape type 2
2026-03-30 07:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d931e49c-1b26-517e-b376-2036f229a43b, identifier: TP43988
2026-03-30 07:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d931e49c-1b26-517e-b376-2036f229a43b with identifier: TP43988
2026-03-30 07:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d931e49c-1b26-517e-b376-2036f229a43b with identifier: TP43988
2026-03-30 07:48:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d931e49c-1b26-517e-b376-2036f229a43b with identifier: TP43988 to the API
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:11:20Z',
 'fuel_type': 'diesel',
 'id': 'd931e49c-1b26-517e-b376-2036f229a43b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TP43988',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 141657,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-18',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 CDTI Kasten L1H1 2,7t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,7t',
 'year': 2016}
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TP43988%27 HTTP/1.1" 200 None
2026-03-30 07:48:39 [auto1.de] INFO: Saving data for TP43988: {'auction_closing_time': 1774883480.0, 'created_time': 1773946220.613811, 'last_price_update_time': 1774856919.799194}
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TP43988') HTTP/1.1" 204 0
2026-03-30 07:48:39 [auto1.de] INFO: Channel: 24h | Page: 148 | totalHits: 8403 | hits on page: 40
2026-03-30 07:48:39 [auto1.de] INFO: Found listing with ID: ZV59345
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV59345%27 HTTP/1.1" 200 None
2026-03-30 07:48:39 [auto1.de] INFO: Scrape type for ZV59345: 2
2026-03-30 07:48:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ba70f68-0f60-51f1-b1e5-6abab0ae5d12 with identifier: ZV59345
2026-03-30 07:48:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ba70f68-0f60-51f1-b1e5-6abab0ae5d12 with scrape type 2
2026-03-30 07:48:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ba70f68-0f60-51f1-b1e5-6abab0ae5d12 with scrape type 2
2026-03-30 07:48:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ba70f68-0f60-51f1-b1e5-6abab0ae5d12, identifier: ZV59345
2026-03-30 07:48:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ba70f68-0f60-51f1-b1e5-6abab0ae5d12 with identifier: ZV59345
2026-03-30 07:48:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ba70f68-0f60-51f1-b1e5-6abab0ae5d12 with identifier: ZV59345
2026-03-30 07:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ba70f68-0f60-51f1-b1e5-6abab0ae5d12 with identifier: ZV59345 to the API
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 195,
 'expiration_date': '2026-03-30T15:27:53Z',
 'fuel_type': 'diesel',
 'id': '8ba70f68-0f60-51f1-b1e5-6abab0ae5d12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV59345',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 136077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-23',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 d Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2017}
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV59345%27 HTTP/1.1" 200 None
2026-03-30 07:48:40 [auto1.de] INFO: Saving data for ZV59345: {'auction_closing_time': 1774884473.0, 'created_time': 1774636928.311163, 'last_price_update_time': 1774856920.220788}
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZV59345') HTTP/1.1" 204 0
2026-03-30 07:48:40 [auto1.de] INFO: Found listing with ID: RC37998
2026-03-30 07:48:40 [auto1.de] INFO: Found listing with ID: XT54020
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT54020%27 HTTP/1.1" 200 None
2026-03-30 07:48:40 [auto1.de] INFO: Scrape type for XT54020: 2
2026-03-30 07:48:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d08b5941-36c8-5e68-8b74-0f32ebe7b3db with identifier: XT54020
2026-03-30 07:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d08b5941-36c8-5e68-8b74-0f32ebe7b3db with scrape type 2
2026-03-30 07:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d08b5941-36c8-5e68-8b74-0f32ebe7b3db with scrape type 2
2026-03-30 07:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d08b5941-36c8-5e68-8b74-0f32ebe7b3db, identifier: XT54020
2026-03-30 07:48:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:48:40 [auto1.de] INFO: Found listing with ID: SC05662
2026-03-30 07:48:40 [auto1.de] INFO: Found listing with ID: FY91638
2026-03-30 07:48:40 [auto1.de] INFO: Found listing with ID: DZ95000
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ95000%27 HTTP/1.1" 200 None
2026-03-30 07:48:40 [auto1.de] INFO: Scrape type for DZ95000: 2
2026-03-30 07:48:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with identifier: DZ95000
2026-03-30 07:48:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with scrape type 2
2026-03-30 07:48:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with scrape type 2
2026-03-30 07:48:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5c271874-6ef0-5da4-a69e-2bdf29a77a93, identifier: DZ95000
2026-03-30 07:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d08b5941-36c8-5e68-8b74-0f32ebe7b3db with identifier: XT54020
2026-03-30 07:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d08b5941-36c8-5e68-8b74-0f32ebe7b3db with identifier: XT54020
2026-03-30 07:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d08b5941-36c8-5e68-8b74-0f32ebe7b3db with identifier: XT54020 to the API
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:22:53Z',
 'fuel_type': 'petrol',
 'id': 'd08b5941-36c8-5e68-8b74-0f32ebe7b3db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT54020',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf IV',
 'odometer': 210184,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-01-23',
 'seller_name': None,
 'title': 'Volkswagen Golf IV 1.4 Ocean',
 'transmission': 'manual',
 'trim': 'Ocean',
 'year': 2005}
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT54020%27 HTTP/1.1" 200 None
2026-03-30 07:48:40 [auto1.de] INFO: Saving data for XT54020: {'auction_closing_time': 1774884173.0, 'created_time': 1774676134.389799, 'last_price_update_time': 1774856920.755132}
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XT54020') HTTP/1.1" 204 0
2026-03-30 07:48:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with identifier: DZ95000
2026-03-30 07:48:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with identifier: DZ95000
2026-03-30 07:48:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5c271874-6ef0-5da4-a69e-2bdf29a77a93 with identifier: DZ95000 to the API
2026-03-30 07:48:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:53:41Z',
 'fuel_type': 'petrol',
 'id': '5c271874-6ef0-5da4-a69e-2bdf29a77a93',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ95000',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 83552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-03',
 'seller_name': None,
 'title': 'BMW 2er 225i Active Tourer Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2014}
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ95000%27 HTTP/1.1" 200 None
2026-03-30 07:48:41 [auto1.de] INFO: Saving data for DZ95000: {'auction_closing_time': 1774886021.0, 'created_time': 1774550599.040566, 'last_price_update_time': 1774856921.15353}
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ95000') HTTP/1.1" 204 0
2026-03-30 07:48:41 [auto1.de] INFO: Found listing with ID: CS21396
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS21396%27 HTTP/1.1" 200 None
2026-03-30 07:48:41 [auto1.de] INFO: Scrape type for CS21396: 2
2026-03-30 07:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 990a6c3f-133e-50f8-a0f5-e262683e6b3e with identifier: CS21396
2026-03-30 07:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 990a6c3f-133e-50f8-a0f5-e262683e6b3e with scrape type 2
2026-03-30 07:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 990a6c3f-133e-50f8-a0f5-e262683e6b3e with scrape type 2
2026-03-30 07:48:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 990a6c3f-133e-50f8-a0f5-e262683e6b3e, identifier: CS21396
2026-03-30 07:48:41 [auto1.de] INFO: Found listing with ID: TS65125
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS65125%27 HTTP/1.1" 200 None
2026-03-30 07:48:41 [auto1.de] INFO: Scrape type for TS65125: 0
2026-03-30 07:48:41 [auto1.de] INFO: Found listing with ID: KL31894
2026-03-30 07:48:41 [auto1.de] INFO: Found listing with ID: MH02928
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH02928%27 HTTP/1.1" 200 None
2026-03-30 07:48:41 [auto1.de] INFO: Scrape type for MH02928: 2
2026-03-30 07:48:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5870688-6f3a-5ff1-af10-7230d4e1edb1 with identifier: MH02928
2026-03-30 07:48:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5870688-6f3a-5ff1-af10-7230d4e1edb1 with scrape type 2
2026-03-30 07:48:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d5870688-6f3a-5ff1-af10-7230d4e1edb1 with scrape type 2
2026-03-30 07:48:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d5870688-6f3a-5ff1-af10-7230d4e1edb1, identifier: MH02928
2026-03-30 07:48:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 990a6c3f-133e-50f8-a0f5-e262683e6b3e with identifier: CS21396
2026-03-30 07:48:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 990a6c3f-133e-50f8-a0f5-e262683e6b3e with identifier: CS21396
2026-03-30 07:48:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 990a6c3f-133e-50f8-a0f5-e262683e6b3e with identifier: CS21396 to the API
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:13:24Z',
 'fuel_type': 'petrol',
 'id': '990a6c3f-133e-50f8-a0f5-e262683e6b3e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CS21396',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 55195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-27',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2022}
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS21396%27 HTTP/1.1" 200 None
2026-03-30 07:48:41 [auto1.de] INFO: Saving data for CS21396: {'auction_closing_time': 1774883604.0, 'created_time': 1774639542.972901, 'last_price_update_time': 1774856921.669831}
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CS21396') HTTP/1.1" 204 0
2026-03-30 07:48:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d5870688-6f3a-5ff1-af10-7230d4e1edb1 with identifier: MH02928
2026-03-30 07:48:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d5870688-6f3a-5ff1-af10-7230d4e1edb1 with identifier: MH02928
2026-03-30 07:48:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d5870688-6f3a-5ff1-af10-7230d4e1edb1 with identifier: MH02928 to the API
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:14:16Z',
 'fuel_type': 'diesel',
 'id': 'd5870688-6f3a-5ff1-af10-7230d4e1edb1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH02928',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 108273,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-09',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2019}
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH02928%27 HTTP/1.1" 200 None
2026-03-30 07:48:41 [auto1.de] INFO: Saving data for MH02928: {'auction_closing_time': 1774883656.0, 'created_time': 1774639261.342861, 'last_price_update_time': 1774856921.981814}
2026-03-30 07:48:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH02928') HTTP/1.1" 204 0
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: RV91936
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: HA98136
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA98136%27 HTTP/1.1" 200 None
2026-03-30 07:48:42 [auto1.de] INFO: Scrape type for HA98136: 0
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: XX95177
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX95177%27 HTTP/1.1" 200 None
2026-03-30 07:48:42 [auto1.de] INFO: Scrape type for XX95177: 2
2026-03-30 07:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eeb8005b-2b60-5864-af17-1dde15eaa73f with identifier: XX95177
2026-03-30 07:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eeb8005b-2b60-5864-af17-1dde15eaa73f with scrape type 2
2026-03-30 07:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eeb8005b-2b60-5864-af17-1dde15eaa73f with scrape type 2
2026-03-30 07:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eeb8005b-2b60-5864-af17-1dde15eaa73f, identifier: XX95177
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: LJ25483
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: LF03511
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: WR03810
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR03810%27 HTTP/1.1" 200 None
2026-03-30 07:48:42 [auto1.de] INFO: Scrape type for WR03810: 0
2026-03-30 07:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eeb8005b-2b60-5864-af17-1dde15eaa73f with identifier: XX95177
2026-03-30 07:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eeb8005b-2b60-5864-af17-1dde15eaa73f with identifier: XX95177
2026-03-30 07:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eeb8005b-2b60-5864-af17-1dde15eaa73f with identifier: XX95177 to the API
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:30:21Z',
 'fuel_type': 'diesel',
 'id': 'eeb8005b-2b60-5864-af17-1dde15eaa73f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX95177',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Movano',
 'odometer': 51713,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-10',
 'seller_name': None,
 'title': 'Opel Movano 2.2 Blue-HDi 35+ L4 (verstärkt)',
 'transmission': 'manual',
 'trim': '35+ L4 (verstärkt)',
 'year': 2024}
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX95177%27 HTTP/1.1" 200 None
2026-03-30 07:48:42 [auto1.de] INFO: Saving data for XX95177: {'auction_closing_time': 1774884621.0, 'created_time': 1773917312.553003, 'last_price_update_time': 1774856922.442911}
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX95177') HTTP/1.1" 204 0
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: BV72825
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: FY17492
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: KA91193
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA91193%27 HTTP/1.1" 200 None
2026-03-30 07:48:42 [auto1.de] INFO: Scrape type for KA91193: 0
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: GU64592
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: CF22867
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF22867%27 HTTP/1.1" 200 None
2026-03-30 07:48:42 [auto1.de] INFO: Scrape type for CF22867: 0
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: UH14154
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH14154%27 HTTP/1.1" 200 None
2026-03-30 07:48:42 [auto1.de] INFO: Scrape type for UH14154: 0
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: RX78682
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: SV69696
2026-03-30 07:48:42 [auto1.de] INFO: Found listing with ID: XJ83535
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ83535%27 HTTP/1.1" 200 None
2026-03-30 07:48:42 [auto1.de] INFO: Scrape type for XJ83535: 2
2026-03-30 07:48:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9048bbb9-6815-52fe-8a84-6971ef5d3de3 with identifier: XJ83535
2026-03-30 07:48:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9048bbb9-6815-52fe-8a84-6971ef5d3de3 with scrape type 2
2026-03-30 07:48:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9048bbb9-6815-52fe-8a84-6971ef5d3de3 with scrape type 2
2026-03-30 07:48:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9048bbb9-6815-52fe-8a84-6971ef5d3de3, identifier: XJ83535
2026-03-30 07:48:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9048bbb9-6815-52fe-8a84-6971ef5d3de3 with identifier: XJ83535
2026-03-30 07:48:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9048bbb9-6815-52fe-8a84-6971ef5d3de3 with identifier: XJ83535
2026-03-30 07:48:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9048bbb9-6815-52fe-8a84-6971ef5d3de3 with identifier: XJ83535 to the API
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:23:27Z',
 'fuel_type': 'petrol',
 'id': '9048bbb9-6815-52fe-8a84-6971ef5d3de3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ83535',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 226981,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Opel Astra 1.2 Turbo 120 Jahre Start/Stop',
 'transmission': 'manual',
 'trim': '120 Jahre Start/Stop',
 'year': 2019}
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ83535%27 HTTP/1.1" 200 None
2026-03-30 07:48:42 [auto1.de] INFO: Saving data for XJ83535: {'auction_closing_time': 1774884207.0, 'created_time': 1773946634.156359, 'last_price_update_time': 1774856922.894741}
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ83535') HTTP/1.1" 204 0
2026-03-30 07:48:43 [auto1.de] INFO: Found listing with ID: NN79660
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN79660%27 HTTP/1.1" 200 None
2026-03-30 07:48:43 [auto1.de] INFO: Scrape type for NN79660: 0
2026-03-30 07:48:43 [auto1.de] INFO: Found listing with ID: UP35116
2026-03-30 07:48:43 [auto1.de] INFO: Found listing with ID: SV37503
2026-03-30 07:48:43 [auto1.de] INFO: Found listing with ID: FK58652
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK58652%27 HTTP/1.1" 200 None
2026-03-30 07:48:43 [auto1.de] INFO: Scrape type for FK58652: 2
2026-03-30 07:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 534f7929-e438-5df9-9314-44412f1653bf with identifier: FK58652
2026-03-30 07:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 534f7929-e438-5df9-9314-44412f1653bf with scrape type 2
2026-03-30 07:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 534f7929-e438-5df9-9314-44412f1653bf with scrape type 2
2026-03-30 07:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 534f7929-e438-5df9-9314-44412f1653bf, identifier: FK58652
2026-03-30 07:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 534f7929-e438-5df9-9314-44412f1653bf with identifier: FK58652
2026-03-30 07:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 534f7929-e438-5df9-9314-44412f1653bf with identifier: FK58652
2026-03-30 07:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 534f7929-e438-5df9-9314-44412f1653bf with identifier: FK58652 to the API
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:47:08Z',
 'fuel_type': 'petrol',
 'id': '534f7929-e438-5df9-9314-44412f1653bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK58652',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 10891,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-14',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.5 TSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2024}
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK58652%27 HTTP/1.1" 200 None
2026-03-30 07:48:43 [auto1.de] INFO: Saving data for FK58652: {'auction_closing_time': 1774885628.0, 'created_time': 1773132324.215615, 'last_price_update_time': 1774856923.411313}
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FK58652') HTTP/1.1" 204 0
2026-03-30 07:48:43 [auto1.de] INFO: Found listing with ID: FB02409
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02409%27 HTTP/1.1" 200 None
2026-03-30 07:48:43 [auto1.de] INFO: Scrape type for FB02409: 2
2026-03-30 07:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 395a4b3d-efad-5e4a-80e5-d5edee3a72f8 with identifier: FB02409
2026-03-30 07:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 395a4b3d-efad-5e4a-80e5-d5edee3a72f8 with scrape type 2
2026-03-30 07:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 395a4b3d-efad-5e4a-80e5-d5edee3a72f8 with scrape type 2
2026-03-30 07:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 395a4b3d-efad-5e4a-80e5-d5edee3a72f8, identifier: FB02409
2026-03-30 07:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 395a4b3d-efad-5e4a-80e5-d5edee3a72f8 with identifier: FB02409
2026-03-30 07:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 395a4b3d-efad-5e4a-80e5-d5edee3a72f8 with identifier: FB02409
2026-03-30 07:48:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 395a4b3d-efad-5e4a-80e5-d5edee3a72f8 with identifier: FB02409 to the API
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:20:19Z',
 'fuel_type': 'diesel',
 'id': '395a4b3d-efad-5e4a-80e5-d5edee3a72f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB02409',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'XF',
 'odometer': 147693,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': None,
 'title': 'Jaguar XF 20d R-Sport',
 'transmission': 'automatic',
 'trim': 'R-Sport',
 'year': 2016}
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB02409%27 HTTP/1.1" 200 None
2026-03-30 07:48:43 [auto1.de] INFO: Saving data for FB02409: {'auction_closing_time': 1774884019.0, 'created_time': 1774550499.289027, 'last_price_update_time': 1774856923.829352}
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB02409') HTTP/1.1" 204 0
2026-03-30 07:48:43 [auto1.de] INFO: Found listing with ID: MB08927
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB08927%27 HTTP/1.1" 200 None
2026-03-30 07:48:43 [auto1.de] INFO: Scrape type for MB08927: 0
2026-03-30 07:48:43 [auto1.de] INFO: Found listing with ID: AU13367
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU13367%27 HTTP/1.1" 200 None
2026-03-30 07:48:43 [auto1.de] INFO: Scrape type for AU13367: 0
2026-03-30 07:48:43 [auto1.de] INFO: Found listing with ID: BA36034
2026-03-30 07:48:43 [auto1.de] INFO: Found listing with ID: GT54130
2026-03-30 07:48:43 [auto1.de] INFO: Found listing with ID: RV14336
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV14336%27 HTTP/1.1" 200 None
2026-03-30 07:48:43 [auto1.de] INFO: Scrape type for RV14336: 2
2026-03-30 07:48:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8e86bc0-9ee9-5363-be31-21388a0e456c with identifier: RV14336
2026-03-30 07:48:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8e86bc0-9ee9-5363-be31-21388a0e456c with scrape type 2
2026-03-30 07:48:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8e86bc0-9ee9-5363-be31-21388a0e456c with scrape type 2
2026-03-30 07:48:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8e86bc0-9ee9-5363-be31-21388a0e456c, identifier: RV14336
2026-03-30 07:48:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8e86bc0-9ee9-5363-be31-21388a0e456c with identifier: RV14336
2026-03-30 07:48:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8e86bc0-9ee9-5363-be31-21388a0e456c with identifier: RV14336
2026-03-30 07:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8e86bc0-9ee9-5363-be31-21388a0e456c with identifier: RV14336 to the API
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:44Z',
 'fuel_type': 'diesel',
 'id': 'f8e86bc0-9ee9-5363-be31-21388a0e456c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RV14336',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Limousine',
 'odometer': 154545,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-09',
 'seller_name': None,
 'title': 'Audi A3 Limousine 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV14336%27 HTTP/1.1" 200 None
2026-03-30 07:48:44 [auto1.de] INFO: Saving data for RV14336: {'auction_closing_time': 1774884824.0, 'created_time': 1774553018.367042, 'last_price_update_time': 1774856924.278383}
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RV14336') HTTP/1.1" 204 0
2026-03-30 07:48:44 [auto1.de] INFO: Found listing with ID: HS09512
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS09512%27 HTTP/1.1" 200 None
2026-03-30 07:48:44 [auto1.de] INFO: Scrape type for HS09512: 2
2026-03-30 07:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd8b0342-24e9-5f59-ba4c-387602982586 with identifier: HS09512
2026-03-30 07:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd8b0342-24e9-5f59-ba4c-387602982586 with scrape type 2
2026-03-30 07:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd8b0342-24e9-5f59-ba4c-387602982586 with scrape type 2
2026-03-30 07:48:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd8b0342-24e9-5f59-ba4c-387602982586, identifier: HS09512
2026-03-30 07:48:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd8b0342-24e9-5f59-ba4c-387602982586 with identifier: HS09512
2026-03-30 07:48:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd8b0342-24e9-5f59-ba4c-387602982586 with identifier: HS09512
2026-03-30 07:48:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd8b0342-24e9-5f59-ba4c-387602982586 with identifier: HS09512 to the API
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:06:25Z',
 'fuel_type': 'petrol',
 'id': 'dd8b0342-24e9-5f59-ba4c-387602982586',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS09512',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 146570,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-07',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS09512%27 HTTP/1.1" 200 None
2026-03-30 07:48:44 [auto1.de] INFO: Saving data for HS09512: {'auction_closing_time': 1774883185.0, 'created_time': 1774552701.338276, 'last_price_update_time': 1774856924.745574}
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HS09512') HTTP/1.1" 204 0
2026-03-30 07:48:44 [auto1.de] INFO: Found listing with ID: YZ03964
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ03964%27 HTTP/1.1" 200 None
2026-03-30 07:48:44 [auto1.de] INFO: Scrape type for YZ03964: 0
2026-03-30 07:48:44 [auto1.de] INFO: Found listing with ID: GY64031
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY64031%27 HTTP/1.1" 200 None
2026-03-30 07:48:44 [auto1.de] INFO: Scrape type for GY64031: 2
2026-03-30 07:48:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab467636-af51-5ff1-a0de-a982eb0b0791 with identifier: GY64031
2026-03-30 07:48:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab467636-af51-5ff1-a0de-a982eb0b0791 with scrape type 2
2026-03-30 07:48:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab467636-af51-5ff1-a0de-a982eb0b0791 with scrape type 2
2026-03-30 07:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ab467636-af51-5ff1-a0de-a982eb0b0791, identifier: GY64031
2026-03-30 07:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ab467636-af51-5ff1-a0de-a982eb0b0791 with identifier: GY64031
2026-03-30 07:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ab467636-af51-5ff1-a0de-a982eb0b0791 with identifier: GY64031
2026-03-30 07:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ab467636-af51-5ff1-a0de-a982eb0b0791 with identifier: GY64031 to the API
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 440,
 'expiration_date': '2026-03-30T15:46:35Z',
 'fuel_type': 'petrol',
 'id': 'ab467636-af51-5ff1-a0de-a982eb0b0791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY64031',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 114959,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seller_name': None,
 'title': 'Porsche Panamera 4S',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY64031%27 HTTP/1.1" 200 None
2026-03-30 07:48:45 [auto1.de] INFO: Saving data for GY64031: {'auction_closing_time': 1774885595.0, 'created_time': 1773228212.376678, 'last_price_update_time': 1774856925.282969}
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY64031') HTTP/1.1" 204 0
2026-03-30 07:48:45 [auto1.de] INFO: Found listing with ID: BM71162
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM71162%27 HTTP/1.1" 200 None
2026-03-30 07:48:45 [auto1.de] INFO: Scrape type for BM71162: 2
2026-03-30 07:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f1e6bf0-9ce5-59d2-822f-b153df792015 with identifier: BM71162
2026-03-30 07:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f1e6bf0-9ce5-59d2-822f-b153df792015 with scrape type 2
2026-03-30 07:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f1e6bf0-9ce5-59d2-822f-b153df792015 with scrape type 2
2026-03-30 07:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f1e6bf0-9ce5-59d2-822f-b153df792015, identifier: BM71162
2026-03-30 07:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f1e6bf0-9ce5-59d2-822f-b153df792015 with identifier: BM71162
2026-03-30 07:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f1e6bf0-9ce5-59d2-822f-b153df792015 with identifier: BM71162
2026-03-30 07:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f1e6bf0-9ce5-59d2-822f-b153df792015 with identifier: BM71162 to the API
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:31:32Z',
 'fuel_type': 'petrol',
 'id': '6f1e6bf0-9ce5-59d2-822f-b153df792015',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM71162',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 122584,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-18',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI S line Sportpaket',
 'transmission': 'manual',
 'trim': 'S line Sportpaket',
 'year': 2013}
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM71162%27 HTTP/1.1" 200 None
2026-03-30 07:48:45 [auto1.de] INFO: Saving data for BM71162: {'auction_closing_time': 1774884692.0, 'created_time': 1774002237.362185, 'last_price_update_time': 1774856925.684317}
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM71162') HTTP/1.1" 204 0
2026-03-30 07:48:45 [auto1.de] INFO: Found listing with ID: TB33384
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB33384%27 HTTP/1.1" 200 None
2026-03-30 07:48:45 [auto1.de] INFO: Scrape type for TB33384: 0
2026-03-30 07:48:45 [auto1.de] INFO: Found listing with ID: ZD80559
2026-03-30 07:48:45 [auto1.de] INFO: Found listing with ID: BX38798
2026-03-30 07:48:45 [auto1.de] INFO: Found listing with ID: KS78216
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS78216%27 HTTP/1.1" 200 None
2026-03-30 07:48:45 [auto1.de] INFO: Scrape type for KS78216: 0
2026-03-30 07:48:45 [auto1.de] INFO: Found listing with ID: RF27065
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF27065%27 HTTP/1.1" 200 None
2026-03-30 07:48:45 [auto1.de] INFO: Scrape type for RF27065: 0
2026-03-30 07:48:45 [auto1.de] INFO: Found listing with ID: ZD36450
2026-03-30 07:48:45 [auto1.de] INFO: Found listing with ID: DJ74321
2026-03-30 07:48:45 [auto1.de] INFO: Found listing with ID: ZS85810
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85810%27 HTTP/1.1" 200 None
2026-03-30 07:48:45 [auto1.de] INFO: Scrape type for ZS85810: 2
2026-03-30 07:48:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 458ac8f3-e4c3-521e-acea-e3d619f91d8c with identifier: ZS85810
2026-03-30 07:48:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 458ac8f3-e4c3-521e-acea-e3d619f91d8c with scrape type 2
2026-03-30 07:48:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 458ac8f3-e4c3-521e-acea-e3d619f91d8c with scrape type 2
2026-03-30 07:48:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 458ac8f3-e4c3-521e-acea-e3d619f91d8c, identifier: ZS85810
2026-03-30 07:48:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 458ac8f3-e4c3-521e-acea-e3d619f91d8c with identifier: ZS85810
2026-03-30 07:48:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 458ac8f3-e4c3-521e-acea-e3d619f91d8c with identifier: ZS85810
2026-03-30 07:48:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 458ac8f3-e4c3-521e-acea-e3d619f91d8c with identifier: ZS85810 to the API
2026-03-30 07:48:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:51:51Z',
 'fuel_type': 'petrol',
 'id': '458ac8f3-e4c3-521e-acea-e3d619f91d8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS85810',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 142955,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-28',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2010}
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85810%27 HTTP/1.1" 200 None
2026-03-30 07:48:46 [auto1.de] INFO: Saving data for ZS85810: {'auction_closing_time': 1774885911.0, 'created_time': 1774550168.676276, 'last_price_update_time': 1774856926.197393}
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS85810') HTTP/1.1" 204 0
2026-03-30 07:48:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:48:46 [auto1.de] INFO: Found listing with ID: EU72034
2026-03-30 07:48:46 [auto1.de] INFO: Found listing with ID: AY25775
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY25775%27 HTTP/1.1" 200 None
2026-03-30 07:48:46 [auto1.de] INFO: Scrape type for AY25775: 2
2026-03-30 07:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90b436ec-7ff9-5ad6-af48-540feca470ce with identifier: AY25775
2026-03-30 07:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90b436ec-7ff9-5ad6-af48-540feca470ce with scrape type 2
2026-03-30 07:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90b436ec-7ff9-5ad6-af48-540feca470ce with scrape type 2
2026-03-30 07:48:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 90b436ec-7ff9-5ad6-af48-540feca470ce, identifier: AY25775
2026-03-30 07:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 90b436ec-7ff9-5ad6-af48-540feca470ce with identifier: AY25775
2026-03-30 07:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 90b436ec-7ff9-5ad6-af48-540feca470ce with identifier: AY25775
2026-03-30 07:48:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 90b436ec-7ff9-5ad6-af48-540feca470ce with identifier: AY25775 to the API
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-30T15:53:12Z',
 'fuel_type': 'petrol',
 'id': '90b436ec-7ff9-5ad6-af48-540feca470ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY25775',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 62595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 200 Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY25775%27 HTTP/1.1" 200 None
2026-03-30 07:48:46 [auto1.de] INFO: Saving data for AY25775: {'auction_closing_time': 1774885992.0, 'created_time': 1774553211.838748, 'last_price_update_time': 1774856926.69867}
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY25775') HTTP/1.1" 204 0
2026-03-30 07:48:46 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-30 07:48:46 [auto1.de] INFO: Channel: 24h | Page: 149 | totalHits: 8404 | hits on page: 40
2026-03-30 07:48:46 [auto1.de] INFO: Found listing with ID: PK18306
2026-03-30 07:48:46 [auto1.de] INFO: Found listing with ID: YF32306
2026-03-30 07:48:46 [auto1.de] INFO: Found listing with ID: UK63230
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63230%27 HTTP/1.1" 200 None
2026-03-30 07:48:46 [auto1.de] INFO: Scrape type for UK63230: 2
2026-03-30 07:48:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4b39c12-8ca9-554f-acef-e5c36e14f845 with identifier: UK63230
2026-03-30 07:48:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4b39c12-8ca9-554f-acef-e5c36e14f845 with scrape type 2
2026-03-30 07:48:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4b39c12-8ca9-554f-acef-e5c36e14f845 with scrape type 2
2026-03-30 07:48:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4b39c12-8ca9-554f-acef-e5c36e14f845, identifier: UK63230
2026-03-30 07:48:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:48:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4b39c12-8ca9-554f-acef-e5c36e14f845 with identifier: UK63230
2026-03-30 07:48:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4b39c12-8ca9-554f-acef-e5c36e14f845 with identifier: UK63230
2026-03-30 07:48:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4b39c12-8ca9-554f-acef-e5c36e14f845 with identifier: UK63230 to the API
2026-03-30 07:48:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:06:38Z',
 'fuel_type': 'diesel',
 'id': 'a4b39c12-8ca9-554f-acef-e5c36e14f845',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK63230',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 295014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-17',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK63230%27 HTTP/1.1" 200 None
2026-03-30 07:48:47 [auto1.de] INFO: Saving data for UK63230: {'auction_closing_time': 1774883198.0, 'created_time': 1773307379.847908, 'last_price_update_time': 1774856927.116598}
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK63230') HTTP/1.1" 204 0
2026-03-30 07:48:47 [auto1.de] INFO: Found listing with ID: XP68837
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68837%27 HTTP/1.1" 200 None
2026-03-30 07:48:47 [auto1.de] INFO: Scrape type for XP68837: 2
2026-03-30 07:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with identifier: XP68837
2026-03-30 07:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with scrape type 2
2026-03-30 07:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with scrape type 2
2026-03-30 07:48:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2fe13f3e-934d-5adc-88e0-9add93d8d2f1, identifier: XP68837
2026-03-30 07:48:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with identifier: XP68837
2026-03-30 07:48:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with identifier: XP68837
2026-03-30 07:48:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2fe13f3e-934d-5adc-88e0-9add93d8d2f1 with identifier: XP68837 to the API
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:48:13Z',
 'fuel_type': 'diesel',
 'id': '2fe13f3e-934d-5adc-88e0-9add93d8d2f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP68837',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 113780,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-03',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2018}
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP68837%27 HTTP/1.1" 200 None
2026-03-30 07:48:47 [auto1.de] INFO: Saving data for XP68837: {'auction_closing_time': 1774885693.0, 'created_time': 1774551859.747393, 'last_price_update_time': 1774856927.523999}
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP68837') HTTP/1.1" 204 0
2026-03-30 07:48:47 [auto1.de] INFO: Found listing with ID: NX37466
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX37466%27 HTTP/1.1" 200 None
2026-03-30 07:48:47 [auto1.de] INFO: Scrape type for NX37466: 2
2026-03-30 07:48:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6138ebb-9f34-5609-815d-50e0cde77341 with identifier: NX37466
2026-03-30 07:48:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6138ebb-9f34-5609-815d-50e0cde77341 with scrape type 2
2026-03-30 07:48:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6138ebb-9f34-5609-815d-50e0cde77341 with scrape type 2
2026-03-30 07:48:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6138ebb-9f34-5609-815d-50e0cde77341, identifier: NX37466
2026-03-30 07:48:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6138ebb-9f34-5609-815d-50e0cde77341 with identifier: NX37466
2026-03-30 07:48:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6138ebb-9f34-5609-815d-50e0cde77341 with identifier: NX37466
2026-03-30 07:48:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6138ebb-9f34-5609-815d-50e0cde77341 with identifier: NX37466 to the API
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:12:46Z',
 'fuel_type': 'petrol',
 'id': 'c6138ebb-9f34-5609-815d-50e0cde77341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX37466',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 111060,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-30',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2015}
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX37466%27 HTTP/1.1" 200 None
2026-03-30 07:48:47 [auto1.de] INFO: Saving data for NX37466: {'auction_closing_time': 1774883566.0, 'created_time': 1774550166.906922, 'last_price_update_time': 1774856927.961693}
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NX37466') HTTP/1.1" 204 0
2026-03-30 07:48:47 [auto1.de] INFO: Found listing with ID: PK39186
2026-03-30 07:48:47 [auto1.de] INFO: Found listing with ID: WH66881
2026-03-30 07:48:47 [auto1.de] INFO: Found listing with ID: RG82987
2026-03-30 07:48:47 [auto1.de] INFO: Found listing with ID: XN11461
2026-03-30 07:48:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN11461%27 HTTP/1.1" 200 None
2026-03-30 07:48:48 [auto1.de] INFO: Scrape type for XN11461: 0
2026-03-30 07:48:48 [auto1.de] INFO: Found listing with ID: EL53532
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL53532%27 HTTP/1.1" 200 None
2026-03-30 07:48:48 [auto1.de] INFO: Scrape type for EL53532: 2
2026-03-30 07:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1452076-a771-5491-99e3-8f5b32f10c86 with identifier: EL53532
2026-03-30 07:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1452076-a771-5491-99e3-8f5b32f10c86 with scrape type 2
2026-03-30 07:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1452076-a771-5491-99e3-8f5b32f10c86 with scrape type 2
2026-03-30 07:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d1452076-a771-5491-99e3-8f5b32f10c86, identifier: EL53532
2026-03-30 07:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d1452076-a771-5491-99e3-8f5b32f10c86 with identifier: EL53532
2026-03-30 07:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d1452076-a771-5491-99e3-8f5b32f10c86 with identifier: EL53532
2026-03-30 07:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d1452076-a771-5491-99e3-8f5b32f10c86 with identifier: EL53532 to the API
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 199,
 'expiration_date': '2026-03-30T15:02:56Z',
 'fuel_type': 'diesel',
 'id': 'd1452076-a771-5491-99e3-8f5b32f10c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL53532',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 141857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI PanAmericana 4Motion',
 'transmission': 'automatic',
 'trim': 'PanAmericana 4Motion',
 'year': 2019}
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL53532%27 HTTP/1.1" 200 None
2026-03-30 07:48:48 [auto1.de] INFO: Saving data for EL53532: {'auction_closing_time': 1774882976.0, 'created_time': 1774551117.734145, 'last_price_update_time': 1774856928.399451}
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL53532') HTTP/1.1" 204 0
2026-03-30 07:48:48 [auto1.de] INFO: Found listing with ID: LA48706
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA48706%27 HTTP/1.1" 200 None
2026-03-30 07:48:48 [auto1.de] INFO: Scrape type for LA48706: 0
2026-03-30 07:48:48 [auto1.de] INFO: Found listing with ID: ND02727
2026-03-30 07:48:48 [auto1.de] INFO: Found listing with ID: WJ18132
2026-03-30 07:48:48 [auto1.de] INFO: Found listing with ID: PS90319
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS90319%27 HTTP/1.1" 200 None
2026-03-30 07:48:48 [auto1.de] INFO: Scrape type for PS90319: 0
2026-03-30 07:48:48 [auto1.de] INFO: Found listing with ID: RJ18784
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ18784%27 HTTP/1.1" 200 None
2026-03-30 07:48:48 [auto1.de] INFO: Scrape type for RJ18784: 2
2026-03-30 07:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with identifier: RJ18784
2026-03-30 07:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with scrape type 2
2026-03-30 07:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with scrape type 2
2026-03-30 07:48:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9, identifier: RJ18784
2026-03-30 07:48:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with identifier: RJ18784
2026-03-30 07:48:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with identifier: RJ18784
2026-03-30 07:48:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 06f2b599-c4ba-547b-bbe4-b73f25e7c0c9 with identifier: RJ18784 to the API
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 179,
 'expiration_date': '2026-03-30T15:59:48Z',
 'fuel_type': 'petrol',
 'id': '06f2b599-c4ba-547b-bbe4-b73f25e7c0c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ18784',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 26077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-26',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid Trend 4WD',
 'transmission': 'automatic',
 'trim': 'Trend 4WD',
 'year': 2023}
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RJ18784%27 HTTP/1.1" 200 None
2026-03-30 07:48:48 [auto1.de] INFO: Saving data for RJ18784: {'auction_closing_time': 1774886388.0, 'created_time': 1774552802.270755, 'last_price_update_time': 1774856928.933896}
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RJ18784') HTTP/1.1" 204 0
2026-03-30 07:48:48 [auto1.de] INFO: Found listing with ID: YT31718
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT31718%27 HTTP/1.1" 200 None
2026-03-30 07:48:48 [auto1.de] INFO: Scrape type for YT31718: 0
2026-03-30 07:48:48 [auto1.de] INFO: Found listing with ID: HW74456
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW74456%27 HTTP/1.1" 200 None
2026-03-30 07:48:48 [auto1.de] INFO: Scrape type for HW74456: 2
2026-03-30 07:48:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0907eb4-77cf-5ff7-9681-1b9b5c8eaafa with identifier: HW74456
2026-03-30 07:48:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0907eb4-77cf-5ff7-9681-1b9b5c8eaafa with scrape type 2
2026-03-30 07:48:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0907eb4-77cf-5ff7-9681-1b9b5c8eaafa with scrape type 2
2026-03-30 07:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0907eb4-77cf-5ff7-9681-1b9b5c8eaafa, identifier: HW74456
2026-03-30 07:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0907eb4-77cf-5ff7-9681-1b9b5c8eaafa with identifier: HW74456
2026-03-30 07:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0907eb4-77cf-5ff7-9681-1b9b5c8eaafa with identifier: HW74456
2026-03-30 07:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0907eb4-77cf-5ff7-9681-1b9b5c8eaafa with identifier: HW74456 to the API
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:43:02Z',
 'fuel_type': 'petrol',
 'id': 'a0907eb4-77cf-5ff7-9681-1b9b5c8eaafa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW74456',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 163986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-30',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.6 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2005}
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW74456%27 HTTP/1.1" 200 None
2026-03-30 07:48:49 [auto1.de] INFO: Saving data for HW74456: {'auction_closing_time': 1774885382.0, 'created_time': 1774638933.005655, 'last_price_update_time': 1774856929.5678}
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW74456') HTTP/1.1" 204 0
2026-03-30 07:48:49 [auto1.de] INFO: Found listing with ID: JR30174
2026-03-30 07:48:49 [auto1.de] INFO: Found listing with ID: YJ23133
2026-03-30 07:48:49 [auto1.de] INFO: Found listing with ID: MX79326
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX79326%27 HTTP/1.1" 200 None
2026-03-30 07:48:49 [auto1.de] INFO: Scrape type for MX79326: 0
2026-03-30 07:48:49 [auto1.de] INFO: Found listing with ID: BA02242
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA02242%27 HTTP/1.1" 200 None
2026-03-30 07:48:49 [auto1.de] INFO: Scrape type for BA02242: 0
2026-03-30 07:48:49 [auto1.de] INFO: Found listing with ID: XR37106
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR37106%27 HTTP/1.1" 200 None
2026-03-30 07:48:49 [auto1.de] INFO: Scrape type for XR37106: 0
2026-03-30 07:48:49 [auto1.de] INFO: Found listing with ID: SX51992
2026-03-30 07:48:49 [auto1.de] INFO: Found listing with ID: XP57282
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP57282%27 HTTP/1.1" 200 None
2026-03-30 07:48:49 [auto1.de] INFO: Scrape type for XP57282: 0
2026-03-30 07:48:49 [auto1.de] INFO: Found listing with ID: CZ08846
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ08846%27 HTTP/1.1" 200 None
2026-03-30 07:48:49 [auto1.de] INFO: Scrape type for CZ08846: 0
2026-03-30 07:48:49 [auto1.de] INFO: Found listing with ID: XU09743
2026-03-30 07:48:49 [auto1.de] INFO: Found listing with ID: MR02811
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR02811%27 HTTP/1.1" 200 None
2026-03-30 07:48:49 [auto1.de] INFO: Scrape type for MR02811: 2
2026-03-30 07:48:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cecc06b9-2411-5cb3-b00d-1dbd985baa4b with identifier: MR02811
2026-03-30 07:48:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cecc06b9-2411-5cb3-b00d-1dbd985baa4b with scrape type 2
2026-03-30 07:48:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cecc06b9-2411-5cb3-b00d-1dbd985baa4b with scrape type 2
2026-03-30 07:48:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cecc06b9-2411-5cb3-b00d-1dbd985baa4b, identifier: MR02811
2026-03-30 07:48:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cecc06b9-2411-5cb3-b00d-1dbd985baa4b with identifier: MR02811
2026-03-30 07:48:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cecc06b9-2411-5cb3-b00d-1dbd985baa4b with identifier: MR02811
2026-03-30 07:48:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cecc06b9-2411-5cb3-b00d-1dbd985baa4b with identifier: MR02811 to the API
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 193,
 'expiration_date': '2026-03-30T15:31:56Z',
 'fuel_type': 'petrol',
 'id': 'cecc06b9-2411-5cb3-b00d-1dbd985baa4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR02811',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Camaro',
 'odometer': 63552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-07-09',
 'seller_name': None,
 'title': 'Chevrolet Camaro 3.8 V6 Cabrio',
 'transmission': 'automatic',
 'trim': 'Cabrio',
 'year': 2000}
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR02811%27 HTTP/1.1" 200 None
2026-03-30 07:48:50 [auto1.de] INFO: Saving data for MR02811: {'auction_closing_time': 1774884716.0, 'created_time': 1774552461.454304, 'last_price_update_time': 1774856930.084036}
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR02811') HTTP/1.1" 204 0
2026-03-30 07:48:50 [auto1.de] INFO: Found listing with ID: KT07926
2026-03-30 07:48:50 [auto1.de] INFO: Found listing with ID: MC50567
2026-03-30 07:48:50 [auto1.de] INFO: Found listing with ID: SS68419
2026-03-30 07:48:50 [auto1.de] INFO: Found listing with ID: VX83538
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX83538%27 HTTP/1.1" 200 None
2026-03-30 07:48:50 [auto1.de] INFO: Scrape type for VX83538: 2
2026-03-30 07:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e830605b-8649-5321-818e-f1ecb6f47a11 with identifier: VX83538
2026-03-30 07:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e830605b-8649-5321-818e-f1ecb6f47a11 with scrape type 2
2026-03-30 07:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e830605b-8649-5321-818e-f1ecb6f47a11 with scrape type 2
2026-03-30 07:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e830605b-8649-5321-818e-f1ecb6f47a11, identifier: VX83538
2026-03-30 07:48:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e830605b-8649-5321-818e-f1ecb6f47a11 with identifier: VX83538
2026-03-30 07:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e830605b-8649-5321-818e-f1ecb6f47a11 with identifier: VX83538
2026-03-30 07:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e830605b-8649-5321-818e-f1ecb6f47a11 with identifier: VX83538 to the API
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:13:24Z',
 'fuel_type': 'diesel',
 'id': 'e830605b-8649-5321-818e-f1ecb6f47a11',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX83538',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumpy',
 'odometer': 136738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-26',
 'seller_name': None,
 'title': 'Citroen Jumpy 1.6 Blue-HDi Profi M',
 'transmission': 'manual',
 'trim': 'Profi M',
 'year': 2017}
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VX83538%27 HTTP/1.1" 200 None
2026-03-30 07:48:50 [auto1.de] INFO: Saving data for VX83538: {'auction_closing_time': 1774883604.0, 'created_time': 1774676129.052727, 'last_price_update_time': 1774856930.590132}
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VX83538') HTTP/1.1" 204 0
2026-03-30 07:48:50 [auto1.de] INFO: Found listing with ID: JG67628
2026-03-30 07:48:50 [auto1.de] INFO: Found listing with ID: SG68469
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG68469%27 HTTP/1.1" 200 None
2026-03-30 07:48:50 [auto1.de] INFO: Scrape type for SG68469: 2
2026-03-30 07:48:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae7375a-3a06-5815-b8ee-a41071a75e9c with identifier: SG68469
2026-03-30 07:48:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae7375a-3a06-5815-b8ee-a41071a75e9c with scrape type 2
2026-03-30 07:48:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ae7375a-3a06-5815-b8ee-a41071a75e9c with scrape type 2
2026-03-30 07:48:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ae7375a-3a06-5815-b8ee-a41071a75e9c, identifier: SG68469
2026-03-30 07:48:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ae7375a-3a06-5815-b8ee-a41071a75e9c with identifier: SG68469
2026-03-30 07:48:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ae7375a-3a06-5815-b8ee-a41071a75e9c with identifier: SG68469
2026-03-30 07:48:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ae7375a-3a06-5815-b8ee-a41071a75e9c with identifier: SG68469 to the API
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:03:01Z',
 'fuel_type': 'diesel',
 'id': '8ae7375a-3a06-5815-b8ee-a41071a75e9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG68469',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 239220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-07',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 220 CDI T BlueEfficiency',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency',
 'year': 2010}
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG68469%27 HTTP/1.1" 200 None
2026-03-30 07:48:50 [auto1.de] INFO: Saving data for SG68469: {'auction_closing_time': 1774882981.0, 'created_time': 1774552921.087814, 'last_price_update_time': 1774856930.977902}
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG68469') HTTP/1.1" 204 0
2026-03-30 07:48:50 [auto1.de] INFO: Found listing with ID: KW63428
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW63428%27 HTTP/1.1" 200 None
2026-03-30 07:48:51 [auto1.de] INFO: Scrape type for KW63428: 2
2026-03-30 07:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85220b28-4582-5f57-a262-b64d7de427b0 with identifier: KW63428
2026-03-30 07:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85220b28-4582-5f57-a262-b64d7de427b0 with scrape type 2
2026-03-30 07:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85220b28-4582-5f57-a262-b64d7de427b0 with scrape type 2
2026-03-30 07:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85220b28-4582-5f57-a262-b64d7de427b0, identifier: KW63428
2026-03-30 07:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85220b28-4582-5f57-a262-b64d7de427b0 with identifier: KW63428
2026-03-30 07:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85220b28-4582-5f57-a262-b64d7de427b0 with identifier: KW63428
2026-03-30 07:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85220b28-4582-5f57-a262-b64d7de427b0 with identifier: KW63428 to the API
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:36:03Z',
 'fuel_type': 'petrol',
 'id': '85220b28-4582-5f57-a262-b64d7de427b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW63428',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 38476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-29',
 'seller_name': None,
 'title': 'BMW 4er 440i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW63428%27 HTTP/1.1" 200 None
2026-03-30 07:48:51 [auto1.de] INFO: Saving data for KW63428: {'auction_closing_time': 1774884963.0, 'created_time': 1774639388.607448, 'last_price_update_time': 1774856931.40292}
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW63428') HTTP/1.1" 204 0
2026-03-30 07:48:51 [auto1.de] INFO: Channel: 24h | Page: 150 | totalHits: 8404 | hits on page: 40
2026-03-30 07:48:51 [auto1.de] INFO: Found listing with ID: NY75190
2026-03-30 07:48:51 [auto1.de] INFO: Found listing with ID: TD91904
2026-03-30 07:48:51 [auto1.de] INFO: Found listing with ID: CU12004
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU12004%27 HTTP/1.1" 200 None
2026-03-30 07:48:51 [auto1.de] INFO: Scrape type for CU12004: 2
2026-03-30 07:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41ee128e-98e0-59a3-ab6a-d7710d50e583 with identifier: CU12004
2026-03-30 07:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41ee128e-98e0-59a3-ab6a-d7710d50e583 with scrape type 2
2026-03-30 07:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41ee128e-98e0-59a3-ab6a-d7710d50e583 with scrape type 2
2026-03-30 07:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41ee128e-98e0-59a3-ab6a-d7710d50e583, identifier: CU12004
2026-03-30 07:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41ee128e-98e0-59a3-ab6a-d7710d50e583 with identifier: CU12004
2026-03-30 07:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41ee128e-98e0-59a3-ab6a-d7710d50e583 with identifier: CU12004
2026-03-30 07:48:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41ee128e-98e0-59a3-ab6a-d7710d50e583 with identifier: CU12004 to the API
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:40:46Z',
 'fuel_type': 'diesel',
 'id': '41ee128e-98e0-59a3-ab6a-d7710d50e583',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU12004',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Arteon Shooting Brake',
 'odometer': 83472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-01',
 'seller_name': None,
 'title': 'Volkswagen Arteon Shooting Brake 2.0 TDI R-Line 4Motion',
 'transmission': 'automatic',
 'trim': 'R-Line 4Motion',
 'year': 2021}
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU12004%27 HTTP/1.1" 200 None
2026-03-30 07:48:51 [auto1.de] INFO: Saving data for CU12004: {'auction_closing_time': 1774885246.0, 'created_time': 1774639845.758981, 'last_price_update_time': 1774856931.792733}
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CU12004') HTTP/1.1" 204 0
2026-03-30 07:48:51 [auto1.de] INFO: Found listing with ID: FB09525
2026-03-30 07:48:51 [auto1.de] INFO: Found listing with ID: MB29022
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB29022%27 HTTP/1.1" 200 None
2026-03-30 07:48:51 [auto1.de] INFO: Scrape type for MB29022: 2
2026-03-30 07:48:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6e70ccc-f8b0-5fb8-ab3b-d0b48bdd3376 with identifier: MB29022
2026-03-30 07:48:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6e70ccc-f8b0-5fb8-ab3b-d0b48bdd3376 with scrape type 2
2026-03-30 07:48:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6e70ccc-f8b0-5fb8-ab3b-d0b48bdd3376 with scrape type 2
2026-03-30 07:48:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6e70ccc-f8b0-5fb8-ab3b-d0b48bdd3376, identifier: MB29022
2026-03-30 07:48:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:48:51 [auto1.de] INFO: Found listing with ID: WZ46352
2026-03-30 07:48:51 [auto1.de] INFO: Found listing with ID: FP97739
2026-03-30 07:48:51 [auto1.de] INFO: Found listing with ID: JK39186
2026-03-30 07:48:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6e70ccc-f8b0-5fb8-ab3b-d0b48bdd3376 with identifier: MB29022
2026-03-30 07:48:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6e70ccc-f8b0-5fb8-ab3b-d0b48bdd3376 with identifier: MB29022
2026-03-30 07:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6e70ccc-f8b0-5fb8-ab3b-d0b48bdd3376 with identifier: MB29022 to the API
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:25:45Z',
 'fuel_type': 'petrol',
 'id': 'f6e70ccc-f8b0-5fb8-ab3b-d0b48bdd3376',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB29022',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 144155,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-08-01',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB29022%27 HTTP/1.1" 200 None
2026-03-30 07:48:52 [auto1.de] INFO: Saving data for MB29022: {'auction_closing_time': 1774884345.0, 'created_time': 1774638533.321643, 'last_price_update_time': 1774856932.214051}
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MB29022') HTTP/1.1" 204 0
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: LM29335
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM29335%27 HTTP/1.1" 200 None
2026-03-30 07:48:52 [auto1.de] INFO: Scrape type for LM29335: 0
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: KX42000
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: KF96570
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KF96570%27 HTTP/1.1" 200 None
2026-03-30 07:48:52 [auto1.de] INFO: Scrape type for KF96570: 0
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: HG82543
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: YH85992
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: TS36559
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS36559%27 HTTP/1.1" 200 None
2026-03-30 07:48:52 [auto1.de] INFO: Scrape type for TS36559: 0
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: KY48204
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: GG07111
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: HL48230
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: UY59901
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: PS42902
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: NR01003
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: JG35901
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG35901%27 HTTP/1.1" 200 None
2026-03-30 07:48:52 [auto1.de] INFO: Scrape type for JG35901: 0
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: TJ52471
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: LB47051
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: BB05749
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: MM26865
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM26865%27 HTTP/1.1" 200 None
2026-03-30 07:48:52 [auto1.de] INFO: Scrape type for MM26865: 0
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: BV96040
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: BS47149
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS47149%27 HTTP/1.1" 200 None
2026-03-30 07:48:52 [auto1.de] INFO: Scrape type for BS47149: 2
2026-03-30 07:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39167ba7-cef0-58de-99af-ec0c91fb70a3 with identifier: BS47149
2026-03-30 07:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39167ba7-cef0-58de-99af-ec0c91fb70a3 with scrape type 2
2026-03-30 07:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39167ba7-cef0-58de-99af-ec0c91fb70a3 with scrape type 2
2026-03-30 07:48:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39167ba7-cef0-58de-99af-ec0c91fb70a3, identifier: BS47149
2026-03-30 07:48:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39167ba7-cef0-58de-99af-ec0c91fb70a3 with identifier: BS47149
2026-03-30 07:48:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39167ba7-cef0-58de-99af-ec0c91fb70a3 with identifier: BS47149
2026-03-30 07:48:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39167ba7-cef0-58de-99af-ec0c91fb70a3 with identifier: BS47149 to the API
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:01:02Z',
 'fuel_type': 'petrol',
 'id': '39167ba7-cef0-58de-99af-ec0c91fb70a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS47149',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 193924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-18',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2006}
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS47149%27 HTTP/1.1" 200 None
2026-03-30 07:48:52 [auto1.de] INFO: Saving data for BS47149: {'auction_closing_time': 1774882862.0, 'created_time': 1774638548.894314, 'last_price_update_time': 1774856932.823089}
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS47149') HTTP/1.1" 204 0
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: DG62846
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG62846%27 HTTP/1.1" 200 None
2026-03-30 07:48:52 [auto1.de] INFO: Scrape type for DG62846: 0
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: AS09440
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS09440%27 HTTP/1.1" 200 None
2026-03-30 07:48:52 [auto1.de] INFO: Scrape type for AS09440: 0
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: AU38078
2026-03-30 07:48:52 [auto1.de] INFO: Found listing with ID: KX86126
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX86126%27 HTTP/1.1" 200 None
2026-03-30 07:48:52 [auto1.de] INFO: Scrape type for KX86126: 2
2026-03-30 07:48:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5256bb1-0811-52a3-b002-f4111b03f2f3 with identifier: KX86126
2026-03-30 07:48:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5256bb1-0811-52a3-b002-f4111b03f2f3 with scrape type 2
2026-03-30 07:48:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5256bb1-0811-52a3-b002-f4111b03f2f3 with scrape type 2
2026-03-30 07:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a5256bb1-0811-52a3-b002-f4111b03f2f3, identifier: KX86126
2026-03-30 07:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a5256bb1-0811-52a3-b002-f4111b03f2f3 with identifier: KX86126
2026-03-30 07:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a5256bb1-0811-52a3-b002-f4111b03f2f3 with identifier: KX86126
2026-03-30 07:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a5256bb1-0811-52a3-b002-f4111b03f2f3 with identifier: KX86126 to the API
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:42:54Z',
 'fuel_type': 'diesel',
 'id': 'a5256bb1-0811-52a3-b002-f4111b03f2f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX86126',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 233790,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-09',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 1.6 CDTI DPF Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX86126%27 HTTP/1.1" 200 None
2026-03-30 07:48:53 [auto1.de] INFO: Saving data for KX86126: {'auction_closing_time': 1774885374.0, 'created_time': 1774639986.224706, 'last_price_update_time': 1774856933.364648}
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX86126') HTTP/1.1" 204 0
2026-03-30 07:48:53 [auto1.de] INFO: Found listing with ID: SW86673
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW86673%27 HTTP/1.1" 200 None
2026-03-30 07:48:53 [auto1.de] INFO: Scrape type for SW86673: 0
2026-03-30 07:48:53 [auto1.de] INFO: Found listing with ID: KZ05104
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ05104%27 HTTP/1.1" 200 None
2026-03-30 07:48:53 [auto1.de] INFO: Scrape type for KZ05104: 0
2026-03-30 07:48:53 [auto1.de] INFO: Found listing with ID: ND74491
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND74491%27 HTTP/1.1" 200 None
2026-03-30 07:48:53 [auto1.de] INFO: Scrape type for ND74491: 2
2026-03-30 07:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdd18455-0234-5ae9-bc59-7e883ae3059d with identifier: ND74491
2026-03-30 07:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdd18455-0234-5ae9-bc59-7e883ae3059d with scrape type 2
2026-03-30 07:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdd18455-0234-5ae9-bc59-7e883ae3059d with scrape type 2
2026-03-30 07:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bdd18455-0234-5ae9-bc59-7e883ae3059d, identifier: ND74491
2026-03-30 07:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bdd18455-0234-5ae9-bc59-7e883ae3059d with identifier: ND74491
2026-03-30 07:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bdd18455-0234-5ae9-bc59-7e883ae3059d with identifier: ND74491
2026-03-30 07:48:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bdd18455-0234-5ae9-bc59-7e883ae3059d with identifier: ND74491 to the API
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:37:49Z',
 'fuel_type': 'petrol',
 'id': 'bdd18455-0234-5ae9-bc59-7e883ae3059d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND74491',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 171950,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-22',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Selective',
 'transmission': 'manual',
 'trim': 'Selective',
 'year': 2012}
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND74491%27 HTTP/1.1" 200 None
2026-03-30 07:48:53 [auto1.de] INFO: Saving data for ND74491: {'auction_closing_time': 1774885069.0, 'created_time': 1774637512.962981, 'last_price_update_time': 1774856933.821891}
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND74491') HTTP/1.1" 204 0
2026-03-30 07:48:53 [auto1.de] INFO: Found listing with ID: KM26302
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM26302%27 HTTP/1.1" 200 None
2026-03-30 07:48:53 [auto1.de] INFO: Scrape type for KM26302: 2
2026-03-30 07:48:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52574c79-a952-5580-9764-5023950006b1 with identifier: KM26302
2026-03-30 07:48:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52574c79-a952-5580-9764-5023950006b1 with scrape type 2
2026-03-30 07:48:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52574c79-a952-5580-9764-5023950006b1 with scrape type 2
2026-03-30 07:48:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 52574c79-a952-5580-9764-5023950006b1, identifier: KM26302
2026-03-30 07:48:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 52574c79-a952-5580-9764-5023950006b1 with identifier: KM26302
2026-03-30 07:48:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 52574c79-a952-5580-9764-5023950006b1 with identifier: KM26302
2026-03-30 07:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 52574c79-a952-5580-9764-5023950006b1 with identifier: KM26302 to the API
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:09:58Z',
 'fuel_type': 'petrol',
 'id': '52574c79-a952-5580-9764-5023950006b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM26302',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 106692,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2018}
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KM26302%27 HTTP/1.1" 200 None
2026-03-30 07:48:54 [auto1.de] INFO: Saving data for KM26302: {'auction_closing_time': 1774883398.0, 'created_time': 1774551628.213805, 'last_price_update_time': 1774856934.217817}
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KM26302') HTTP/1.1" 204 0
2026-03-30 07:48:54 [auto1.de] INFO: Found listing with ID: FW84065
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW84065%27 HTTP/1.1" 200 None
2026-03-30 07:48:54 [auto1.de] INFO: Scrape type for FW84065: 0
2026-03-30 07:48:54 [auto1.de] INFO: Found listing with ID: FK93583
2026-03-30 07:48:54 [auto1.de] INFO: Found listing with ID: MF11383
2026-03-30 07:48:54 [auto1.de] INFO: Found listing with ID: LV55762
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55762%27 HTTP/1.1" 200 None
2026-03-30 07:48:54 [auto1.de] INFO: Scrape type for LV55762: 2
2026-03-30 07:48:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13e5b392-ff1d-5694-ad63-10603a22bf1a with identifier: LV55762
2026-03-30 07:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13e5b392-ff1d-5694-ad63-10603a22bf1a with scrape type 2
2026-03-30 07:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13e5b392-ff1d-5694-ad63-10603a22bf1a with scrape type 2
2026-03-30 07:48:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13e5b392-ff1d-5694-ad63-10603a22bf1a, identifier: LV55762
2026-03-30 07:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13e5b392-ff1d-5694-ad63-10603a22bf1a with identifier: LV55762
2026-03-30 07:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13e5b392-ff1d-5694-ad63-10603a22bf1a with identifier: LV55762
2026-03-30 07:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13e5b392-ff1d-5694-ad63-10603a22bf1a with identifier: LV55762 to the API
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:09:18Z',
 'fuel_type': 'diesel',
 'id': '13e5b392-ff1d-5694-ad63-10603a22bf1a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV55762',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 252331,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-27',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 TDI Executive',
 'transmission': 'automatic',
 'trim': 'Executive',
 'year': 2018}
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV55762%27 HTTP/1.1" 200 None
2026-03-30 07:48:54 [auto1.de] INFO: Saving data for LV55762: {'auction_closing_time': 1774883358.0, 'created_time': 1774464594.545083, 'last_price_update_time': 1774856934.648549}
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV55762') HTTP/1.1" 204 0
2026-03-30 07:48:54 [auto1.de] INFO: Found listing with ID: RC52895
2026-03-30 07:48:54 [auto1.de] INFO: Found listing with ID: FB70760
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB70760%27 HTTP/1.1" 200 None
2026-03-30 07:48:54 [auto1.de] INFO: Scrape type for FB70760: 2
2026-03-30 07:48:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b099de4-e592-53c1-81c4-2c4e50089693 with identifier: FB70760
2026-03-30 07:48:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b099de4-e592-53c1-81c4-2c4e50089693 with scrape type 2
2026-03-30 07:48:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b099de4-e592-53c1-81c4-2c4e50089693 with scrape type 2
2026-03-30 07:48:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8b099de4-e592-53c1-81c4-2c4e50089693, identifier: FB70760
2026-03-30 07:48:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8b099de4-e592-53c1-81c4-2c4e50089693 with identifier: FB70760
2026-03-30 07:48:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8b099de4-e592-53c1-81c4-2c4e50089693 with identifier: FB70760
2026-03-30 07:48:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8b099de4-e592-53c1-81c4-2c4e50089693 with identifier: FB70760 to the API
2026-03-30 07:48:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:23:35Z',
 'fuel_type': 'diesel',
 'id': '8b099de4-e592-53c1-81c4-2c4e50089693',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB70760',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 272380,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-22',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2016}
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB70760%27 HTTP/1.1" 200 None
2026-03-30 07:48:55 [auto1.de] INFO: Saving data for FB70760: {'auction_closing_time': 1774884215.0, 'created_time': 1774034459.75717, 'last_price_update_time': 1774856935.157215}
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB70760') HTTP/1.1" 204 0
2026-03-30 07:48:55 [auto1.de] INFO: Found listing with ID: TV20692
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV20692%27 HTTP/1.1" 200 None
2026-03-30 07:48:55 [auto1.de] INFO: Scrape type for TV20692: 2
2026-03-30 07:48:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with identifier: TV20692
2026-03-30 07:48:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with scrape type 2
2026-03-30 07:48:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with scrape type 2
2026-03-30 07:48:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4, identifier: TV20692
2026-03-30 07:48:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with identifier: TV20692
2026-03-30 07:48:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with identifier: TV20692
2026-03-30 07:48:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4 with identifier: TV20692 to the API
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:06:20Z',
 'fuel_type': 'petrol',
 'id': 'f2f6fb0c-d088-51b5-9bb3-895c25ffa3b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV20692',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 83405,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-04',
 'seller_name': None,
 'title': 'Peugeot 5008 1.2 PureTech Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2020}
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV20692%27 HTTP/1.1" 200 None
2026-03-30 07:48:55 [auto1.de] INFO: Saving data for TV20692: {'auction_closing_time': 1774883180.0, 'created_time': 1774034936.843896, 'last_price_update_time': 1774856935.557337}
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TV20692') HTTP/1.1" 204 0
2026-03-30 07:48:55 [auto1.de] INFO: Found listing with ID: CA11296
2026-03-30 07:48:55 [auto1.de] INFO: Found listing with ID: SK36887
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK36887%27 HTTP/1.1" 200 None
2026-03-30 07:48:55 [auto1.de] INFO: Scrape type for SK36887: 0
2026-03-30 07:48:55 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-30 07:48:55 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-30 07:48:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:48:56 [auto1.de] INFO: Channel: 24h | Page: 151 | totalHits: 8406 | hits on page: 40
2026-03-30 07:48:56 [auto1.de] INFO: Found listing with ID: HT64251
2026-03-30 07:48:56 [auto1.de] INFO: Found listing with ID: CV64840
2026-03-30 07:48:56 [auto1.de] INFO: Found listing with ID: LT46739
2026-03-30 07:48:56 [auto1.de] INFO: Found listing with ID: KH49369
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49369%27 HTTP/1.1" 200 None
2026-03-30 07:48:56 [auto1.de] INFO: Scrape type for KH49369: 2
2026-03-30 07:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecca9cb0-03df-5b30-bd33-299a6c96eb56 with identifier: KH49369
2026-03-30 07:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecca9cb0-03df-5b30-bd33-299a6c96eb56 with scrape type 2
2026-03-30 07:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecca9cb0-03df-5b30-bd33-299a6c96eb56 with scrape type 2
2026-03-30 07:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecca9cb0-03df-5b30-bd33-299a6c96eb56, identifier: KH49369
2026-03-30 07:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecca9cb0-03df-5b30-bd33-299a6c96eb56 with identifier: KH49369
2026-03-30 07:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecca9cb0-03df-5b30-bd33-299a6c96eb56 with identifier: KH49369
2026-03-30 07:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecca9cb0-03df-5b30-bd33-299a6c96eb56 with identifier: KH49369 to the API
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:05:23Z',
 'fuel_type': 'petrol',
 'id': 'ecca9cb0-03df-5b30-bd33-299a6c96eb56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH49369',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 80764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-25',
 'seller_name': None,
 'title': 'Mazda 2 1.5 Kizoku',
 'transmission': 'manual',
 'trim': 'Kizoku',
 'year': 2019}
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH49369%27 HTTP/1.1" 200 None
2026-03-30 07:48:56 [auto1.de] INFO: Saving data for KH49369: {'auction_closing_time': 1774883123.0, 'created_time': 1774552875.162266, 'last_price_update_time': 1774856936.574827}
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH49369') HTTP/1.1" 204 0
2026-03-30 07:48:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:48:56 [auto1.de] INFO: Found listing with ID: FY57679
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY57679%27 HTTP/1.1" 200 None
2026-03-30 07:48:56 [auto1.de] INFO: Scrape type for FY57679: 0
2026-03-30 07:48:56 [auto1.de] INFO: Found listing with ID: YK97708
2026-03-30 07:48:56 [auto1.de] INFO: Found listing with ID: AS68475
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AS68475%27 HTTP/1.1" 200 None
2026-03-30 07:48:56 [auto1.de] INFO: Scrape type for AS68475: 0
2026-03-30 07:48:56 [auto1.de] INFO: Found listing with ID: EL15513
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL15513%27 HTTP/1.1" 200 None
2026-03-30 07:48:56 [auto1.de] INFO: Scrape type for EL15513: 0
2026-03-30 07:48:56 [auto1.de] INFO: Found listing with ID: WR45011
2026-03-30 07:48:56 [auto1.de] INFO: Found listing with ID: YR50974
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR50974%27 HTTP/1.1" 200 None
2026-03-30 07:48:56 [auto1.de] INFO: Scrape type for YR50974: 2
2026-03-30 07:48:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4c56f2c-c057-589e-832f-e764ca9a974a with identifier: YR50974
2026-03-30 07:48:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4c56f2c-c057-589e-832f-e764ca9a974a with scrape type 2
2026-03-30 07:48:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4c56f2c-c057-589e-832f-e764ca9a974a with scrape type 2
2026-03-30 07:48:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f4c56f2c-c057-589e-832f-e764ca9a974a, identifier: YR50974
2026-03-30 07:48:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f4c56f2c-c057-589e-832f-e764ca9a974a with identifier: YR50974
2026-03-30 07:48:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f4c56f2c-c057-589e-832f-e764ca9a974a with identifier: YR50974
2026-03-30 07:48:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f4c56f2c-c057-589e-832f-e764ca9a974a with identifier: YR50974 to the API
2026-03-30 07:48:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:56:15Z',
 'fuel_type': 'petrol',
 'id': 'f4c56f2c-c057-589e-832f-e764ca9a974a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR50974',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 95952,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-28',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2015}
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR50974%27 HTTP/1.1" 200 None
2026-03-30 07:48:57 [auto1.de] INFO: Saving data for YR50974: {'auction_closing_time': 1774886175.0, 'created_time': 1774638510.878008, 'last_price_update_time': 1774856937.119044}
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YR50974') HTTP/1.1" 204 0
2026-03-30 07:48:57 [auto1.de] INFO: Found listing with ID: AU97741
2026-03-30 07:48:57 [auto1.de] INFO: Found listing with ID: BB57132
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB57132%27 HTTP/1.1" 200 None
2026-03-30 07:48:57 [auto1.de] INFO: Scrape type for BB57132: 0
2026-03-30 07:48:57 [auto1.de] INFO: Found listing with ID: HX44464
2026-03-30 07:48:57 [auto1.de] INFO: Found listing with ID: XE57640
2026-03-30 07:48:57 [auto1.de] INFO: Found listing with ID: EH89058
2026-03-30 07:48:57 [auto1.de] INFO: Found listing with ID: DR63212
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR63212%27 HTTP/1.1" 200 None
2026-03-30 07:48:57 [auto1.de] INFO: Scrape type for DR63212: 2
2026-03-30 07:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0855fcf9-d424-5889-ac6d-088dfe008231 with identifier: DR63212
2026-03-30 07:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0855fcf9-d424-5889-ac6d-088dfe008231 with scrape type 2
2026-03-30 07:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0855fcf9-d424-5889-ac6d-088dfe008231 with scrape type 2
2026-03-30 07:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0855fcf9-d424-5889-ac6d-088dfe008231, identifier: DR63212
2026-03-30 07:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0855fcf9-d424-5889-ac6d-088dfe008231 with identifier: DR63212
2026-03-30 07:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0855fcf9-d424-5889-ac6d-088dfe008231 with identifier: DR63212
2026-03-30 07:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0855fcf9-d424-5889-ac6d-088dfe008231 with identifier: DR63212 to the API
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:54:59Z',
 'fuel_type': 'petrol',
 'id': '0855fcf9-d424-5889-ac6d-088dfe008231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR63212',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 131057,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-29',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'manual',
 'trim': 'ST-Line X',
 'year': 2020}
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR63212%27 HTTP/1.1" 200 None
2026-03-30 07:48:57 [auto1.de] INFO: Saving data for DR63212: {'auction_closing_time': 1774886099.0, 'created_time': 1773227859.843465, 'last_price_update_time': 1774856937.552734}
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR63212') HTTP/1.1" 204 0
2026-03-30 07:48:57 [auto1.de] INFO: Found listing with ID: XH41107
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH41107%27 HTTP/1.1" 200 None
2026-03-30 07:48:57 [auto1.de] INFO: Scrape type for XH41107: 0
2026-03-30 07:48:57 [auto1.de] INFO: Found listing with ID: WD55568
2026-03-30 07:48:57 [auto1.de] INFO: Found listing with ID: TG41026
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG41026%27 HTTP/1.1" 200 None
2026-03-30 07:48:57 [auto1.de] INFO: Scrape type for TG41026: 2
2026-03-30 07:48:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81ab520f-274d-5110-9ffd-07e5254682d2 with identifier: TG41026
2026-03-30 07:48:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81ab520f-274d-5110-9ffd-07e5254682d2 with scrape type 2
2026-03-30 07:48:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81ab520f-274d-5110-9ffd-07e5254682d2 with scrape type 2
2026-03-30 07:48:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81ab520f-274d-5110-9ffd-07e5254682d2, identifier: TG41026
2026-03-30 07:48:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81ab520f-274d-5110-9ffd-07e5254682d2 with identifier: TG41026
2026-03-30 07:48:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81ab520f-274d-5110-9ffd-07e5254682d2 with identifier: TG41026
2026-03-30 07:48:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81ab520f-274d-5110-9ffd-07e5254682d2 with identifier: TG41026 to the API
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:34:05Z',
 'fuel_type': 'petrol',
 'id': '81ab520f-274d-5110-9ffd-07e5254682d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG41026',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 70213,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Cup BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Cup BlueMotion Tech',
 'year': 2014}
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG41026%27 HTTP/1.1" 200 None
2026-03-30 07:48:58 [auto1.de] INFO: Saving data for TG41026: {'auction_closing_time': 1774884845.0, 'created_time': 1774637298.51076, 'last_price_update_time': 1774856938.100651}
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TG41026') HTTP/1.1" 204 0
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: TT11512
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: MA81482
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA81482%27 HTTP/1.1" 200 None
2026-03-30 07:48:58 [auto1.de] INFO: Scrape type for MA81482: 0
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: GV00084
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV00084%27 HTTP/1.1" 200 None
2026-03-30 07:48:58 [auto1.de] INFO: Scrape type for GV00084: 0
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: XA59954
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: YU70640
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: KR59987
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: BS68722
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: UC15982
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC15982%27 HTTP/1.1" 200 None
2026-03-30 07:48:58 [auto1.de] INFO: Scrape type for UC15982: 2
2026-03-30 07:48:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b5f73f1-265b-5941-a936-f267d5647c00 with identifier: UC15982
2026-03-30 07:48:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b5f73f1-265b-5941-a936-f267d5647c00 with scrape type 2
2026-03-30 07:48:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b5f73f1-265b-5941-a936-f267d5647c00 with scrape type 2
2026-03-30 07:48:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b5f73f1-265b-5941-a936-f267d5647c00, identifier: UC15982
2026-03-30 07:48:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b5f73f1-265b-5941-a936-f267d5647c00 with identifier: UC15982
2026-03-30 07:48:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b5f73f1-265b-5941-a936-f267d5647c00 with identifier: UC15982
2026-03-30 07:48:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b5f73f1-265b-5941-a936-f267d5647c00 with identifier: UC15982 to the API
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:48:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:30:48Z',
 'fuel_type': 'diesel',
 'id': '0b5f73f1-265b-5941-a936-f267d5647c00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC15982',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V50',
 'odometer': 196817,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-28',
 'seller_name': None,
 'title': 'Volvo V50 1.6 D2 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2011}
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC15982%27 HTTP/1.1" 200 None
2026-03-30 07:48:58 [auto1.de] INFO: Saving data for UC15982: {'auction_closing_time': 1774884648.0, 'created_time': 1774034857.386289, 'last_price_update_time': 1774856938.537693}
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC15982') HTTP/1.1" 204 0
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: WV53584
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: ZL89302
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: HX82785
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: NV35825
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV35825%27 HTTP/1.1" 200 None
2026-03-30 07:48:58 [auto1.de] INFO: Scrape type for NV35825: 0
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: KP94641
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: XS67256
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS67256%27 HTTP/1.1" 200 None
2026-03-30 07:48:58 [auto1.de] INFO: Scrape type for XS67256: 0
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: TJ54274
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: FK64701
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: GN84809
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: KD99837
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: US02416
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US02416%27 HTTP/1.1" 200 None
2026-03-30 07:48:58 [auto1.de] INFO: Scrape type for US02416: 0
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: BP65975
2026-03-30 07:48:58 [auto1.de] INFO: Found listing with ID: SL77379
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SL77379%27 HTTP/1.1" 200 None
2026-03-30 07:48:58 [auto1.de] INFO: Scrape type for SL77379: 0
2026-03-30 07:48:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:48:59 [auto1.de] INFO: Channel: 24h | Page: 152 | totalHits: 8406 | hits on page: 40
2026-03-30 07:48:59 [auto1.de] INFO: Found listing with ID: GT92909
2026-03-30 07:48:59 [auto1.de] INFO: Found listing with ID: VR69124
2026-03-30 07:48:59 [auto1.de] INFO: Found listing with ID: BJ13428
2026-03-30 07:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ13428%27 HTTP/1.1" 200 None
2026-03-30 07:48:59 [auto1.de] INFO: Scrape type for BJ13428: 0
2026-03-30 07:48:59 [auto1.de] INFO: Found listing with ID: JT79226
2026-03-30 07:48:59 [auto1.de] INFO: Found listing with ID: SP71400
2026-03-30 07:48:59 [auto1.de] INFO: Found listing with ID: WE95129
2026-03-30 07:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:48:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE95129%27 HTTP/1.1" 200 None
2026-03-30 07:48:59 [auto1.de] INFO: Scrape type for WE95129: 2
2026-03-30 07:48:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c1b284f-9511-566d-82a8-f7caaa1626d4 with identifier: WE95129
2026-03-30 07:48:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c1b284f-9511-566d-82a8-f7caaa1626d4 with scrape type 2
2026-03-30 07:48:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c1b284f-9511-566d-82a8-f7caaa1626d4 with scrape type 2
2026-03-30 07:48:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8c1b284f-9511-566d-82a8-f7caaa1626d4, identifier: WE95129
2026-03-30 07:48:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8c1b284f-9511-566d-82a8-f7caaa1626d4 with identifier: WE95129
2026-03-30 07:48:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8c1b284f-9511-566d-82a8-f7caaa1626d4 with identifier: WE95129
2026-03-30 07:48:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8c1b284f-9511-566d-82a8-f7caaa1626d4 with identifier: WE95129 to the API
2026-03-30 07:48:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:48:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:55:52Z',
 'fuel_type': 'petrol',
 'id': '8c1b284f-9511-566d-82a8-f7caaa1626d4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE95129',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 35476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-23',
 'seller_name': None,
 'title': 'Hyundai i20 1.0 T-GDI Mild-Hybrid Select',
 'transmission': 'automatic',
 'trim': 'Select',
 'year': 2021}
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE95129%27 HTTP/1.1" 200 None
2026-03-30 07:49:00 [auto1.de] INFO: Saving data for WE95129: {'auction_closing_time': 1774886152.0, 'created_time': 1773229734.86202, 'last_price_update_time': 1774856940.118554}
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE95129') HTTP/1.1" 204 0
2026-03-30 07:49:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:49:00 [auto1.de] INFO: Found listing with ID: FC27244
2026-03-30 07:49:00 [auto1.de] INFO: Found listing with ID: TB03124
2026-03-30 07:49:00 [auto1.de] INFO: Found listing with ID: CR76399
2026-03-30 07:49:00 [auto1.de] INFO: Found listing with ID: ZS85358
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85358%27 HTTP/1.1" 200 None
2026-03-30 07:49:00 [auto1.de] INFO: Scrape type for ZS85358: 2
2026-03-30 07:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7de2b9f4-9b89-525a-a62b-05afe54becbe with identifier: ZS85358
2026-03-30 07:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7de2b9f4-9b89-525a-a62b-05afe54becbe with scrape type 2
2026-03-30 07:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7de2b9f4-9b89-525a-a62b-05afe54becbe with scrape type 2
2026-03-30 07:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7de2b9f4-9b89-525a-a62b-05afe54becbe, identifier: ZS85358
2026-03-30 07:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7de2b9f4-9b89-525a-a62b-05afe54becbe with identifier: ZS85358
2026-03-30 07:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7de2b9f4-9b89-525a-a62b-05afe54becbe with identifier: ZS85358
2026-03-30 07:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7de2b9f4-9b89-525a-a62b-05afe54becbe with identifier: ZS85358 to the API
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:21:36Z',
 'fuel_type': 'diesel',
 'id': '7de2b9f4-9b89-525a-a62b-05afe54becbe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZS85358',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 169216,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-23',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS85358%27 HTTP/1.1" 200 None
2026-03-30 07:49:00 [auto1.de] INFO: Saving data for ZS85358: {'auction_closing_time': 1774884096.0, 'created_time': 1773346174.686585, 'last_price_update_time': 1774856940.639051}
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZS85358') HTTP/1.1" 204 0
2026-03-30 07:49:00 [auto1.de] INFO: Found listing with ID: EY70159
2026-03-30 07:49:00 [auto1.de] INFO: Found listing with ID: ZN04335
2026-03-30 07:49:00 [auto1.de] INFO: Found listing with ID: SR63884
2026-03-30 07:49:00 [auto1.de] INFO: Found listing with ID: EM38204
2026-03-30 07:49:00 [auto1.de] INFO: Found listing with ID: WV85362
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV85362%27 HTTP/1.1" 200 None
2026-03-30 07:49:00 [auto1.de] INFO: Scrape type for WV85362: 2
2026-03-30 07:49:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfb98296-79ed-56ba-9b48-d14e245e6ce0 with identifier: WV85362
2026-03-30 07:49:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfb98296-79ed-56ba-9b48-d14e245e6ce0 with scrape type 2
2026-03-30 07:49:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfb98296-79ed-56ba-9b48-d14e245e6ce0 with scrape type 2
2026-03-30 07:49:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dfb98296-79ed-56ba-9b48-d14e245e6ce0, identifier: WV85362
2026-03-30 07:49:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dfb98296-79ed-56ba-9b48-d14e245e6ce0 with identifier: WV85362
2026-03-30 07:49:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dfb98296-79ed-56ba-9b48-d14e245e6ce0 with identifier: WV85362
2026-03-30 07:49:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dfb98296-79ed-56ba-9b48-d14e245e6ce0 with identifier: WV85362 to the API
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:11Z',
 'fuel_type': 'petrol',
 'id': 'dfb98296-79ed-56ba-9b48-d14e245e6ce0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV85362',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 135854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-22',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2016}
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV85362%27 HTTP/1.1" 200 None
2026-03-30 07:49:01 [auto1.de] INFO: Saving data for WV85362: {'auction_closing_time': 1774883111.0, 'created_time': 1774552571.712892, 'last_price_update_time': 1774856941.046952}
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WV85362') HTTP/1.1" 204 0
2026-03-30 07:49:01 [auto1.de] INFO: Found listing with ID: YT62931
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT62931%27 HTTP/1.1" 200 None
2026-03-30 07:49:01 [auto1.de] INFO: Scrape type for YT62931: 2
2026-03-30 07:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef22a90f-758b-5733-95f4-ecd50e5b273a with identifier: YT62931
2026-03-30 07:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef22a90f-758b-5733-95f4-ecd50e5b273a with scrape type 2
2026-03-30 07:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef22a90f-758b-5733-95f4-ecd50e5b273a with scrape type 2
2026-03-30 07:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ef22a90f-758b-5733-95f4-ecd50e5b273a, identifier: YT62931
2026-03-30 07:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ef22a90f-758b-5733-95f4-ecd50e5b273a with identifier: YT62931
2026-03-30 07:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ef22a90f-758b-5733-95f4-ecd50e5b273a with identifier: YT62931
2026-03-30 07:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ef22a90f-758b-5733-95f4-ecd50e5b273a with identifier: YT62931 to the API
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:27:48Z',
 'fuel_type': 'diesel',
 'id': 'ef22a90f-758b-5733-95f4-ecd50e5b273a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT62931',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Koleos',
 'odometer': 86980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': None,
 'title': 'Renault Koleos 2.0 BLUE dCi Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Limited 4x4',
 'year': 2019}
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT62931%27 HTTP/1.1" 200 None
2026-03-30 07:49:01 [auto1.de] INFO: Saving data for YT62931: {'auction_closing_time': 1774884468.0, 'created_time': 1773382484.593506, 'last_price_update_time': 1774856941.490575}
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT62931') HTTP/1.1" 204 0
2026-03-30 07:49:01 [auto1.de] INFO: Found listing with ID: ZA74558
2026-03-30 07:49:01 [auto1.de] INFO: Found listing with ID: UL19330
2026-03-30 07:49:01 [auto1.de] INFO: Found listing with ID: LN73181
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN73181%27 HTTP/1.1" 200 None
2026-03-30 07:49:01 [auto1.de] INFO: Scrape type for LN73181: 0
2026-03-30 07:49:01 [auto1.de] INFO: Found listing with ID: DR68264
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68264%27 HTTP/1.1" 200 None
2026-03-30 07:49:01 [auto1.de] INFO: Scrape type for DR68264: 2
2026-03-30 07:49:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d155f651-9e3e-5a89-a4c4-a909f73050f0 with identifier: DR68264
2026-03-30 07:49:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d155f651-9e3e-5a89-a4c4-a909f73050f0 with scrape type 2
2026-03-30 07:49:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d155f651-9e3e-5a89-a4c4-a909f73050f0 with scrape type 2
2026-03-30 07:49:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d155f651-9e3e-5a89-a4c4-a909f73050f0, identifier: DR68264
2026-03-30 07:49:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d155f651-9e3e-5a89-a4c4-a909f73050f0 with identifier: DR68264
2026-03-30 07:49:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d155f651-9e3e-5a89-a4c4-a909f73050f0 with identifier: DR68264
2026-03-30 07:49:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d155f651-9e3e-5a89-a4c4-a909f73050f0 with identifier: DR68264 to the API
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:21:25Z',
 'fuel_type': 'petrol',
 'id': 'd155f651-9e3e-5a89-a4c4-a909f73050f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR68264',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 263254,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-06',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.4 Life Gewinner Caddy',
 'transmission': 'manual',
 'trim': 'Life Gewinner',
 'year': 2009}
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR68264%27 HTTP/1.1" 200 None
2026-03-30 07:49:01 [auto1.de] INFO: Saving data for DR68264: {'auction_closing_time': 1774884085.0, 'created_time': 1774551037.011668, 'last_price_update_time': 1774856941.974274}
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DR68264') HTTP/1.1" 204 0
2026-03-30 07:49:02 [auto1.de] INFO: Found listing with ID: LV98525
2026-03-30 07:49:02 [auto1.de] INFO: Found listing with ID: DH60406
2026-03-30 07:49:02 [auto1.de] INFO: Found listing with ID: MP23640
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP23640%27 HTTP/1.1" 200 None
2026-03-30 07:49:02 [auto1.de] INFO: Scrape type for MP23640: 2
2026-03-30 07:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ea1d49a-50b2-5397-933e-a792e5c5f4f0 with identifier: MP23640
2026-03-30 07:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ea1d49a-50b2-5397-933e-a792e5c5f4f0 with scrape type 2
2026-03-30 07:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ea1d49a-50b2-5397-933e-a792e5c5f4f0 with scrape type 2
2026-03-30 07:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8ea1d49a-50b2-5397-933e-a792e5c5f4f0, identifier: MP23640
2026-03-30 07:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8ea1d49a-50b2-5397-933e-a792e5c5f4f0 with identifier: MP23640
2026-03-30 07:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8ea1d49a-50b2-5397-933e-a792e5c5f4f0 with identifier: MP23640
2026-03-30 07:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8ea1d49a-50b2-5397-933e-a792e5c5f4f0 with identifier: MP23640 to the API
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:29:37Z',
 'fuel_type': 'petrol',
 'id': '8ea1d49a-50b2-5397-933e-a792e5c5f4f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP23640',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 130580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-11',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': '4Matic Avantgarde',
 'year': 2016}
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP23640%27 HTTP/1.1" 200 None
2026-03-30 07:49:02 [auto1.de] INFO: Saving data for MP23640: {'auction_closing_time': 1774884577.0, 'created_time': 1774436441.720733, 'last_price_update_time': 1774856942.467943}
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MP23640') HTTP/1.1" 204 0
2026-03-30 07:49:02 [auto1.de] INFO: Found listing with ID: KK20650
2026-03-30 07:49:02 [auto1.de] INFO: Found listing with ID: FF90181
2026-03-30 07:49:02 [auto1.de] INFO: Found listing with ID: FP07382
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP07382%27 HTTP/1.1" 200 None
2026-03-30 07:49:02 [auto1.de] INFO: Scrape type for FP07382: 2
2026-03-30 07:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d8e9e2b-139e-52dc-ba54-1fd376584b8c with identifier: FP07382
2026-03-30 07:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d8e9e2b-139e-52dc-ba54-1fd376584b8c with scrape type 2
2026-03-30 07:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d8e9e2b-139e-52dc-ba54-1fd376584b8c with scrape type 2
2026-03-30 07:49:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d8e9e2b-139e-52dc-ba54-1fd376584b8c, identifier: FP07382
2026-03-30 07:49:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d8e9e2b-139e-52dc-ba54-1fd376584b8c with identifier: FP07382
2026-03-30 07:49:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d8e9e2b-139e-52dc-ba54-1fd376584b8c with identifier: FP07382
2026-03-30 07:49:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d8e9e2b-139e-52dc-ba54-1fd376584b8c with identifier: FP07382 to the API
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:10:11Z',
 'fuel_type': 'petrol',
 'id': '5d8e9e2b-139e-52dc-ba54-1fd376584b8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP07382',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 155830,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-06',
 'seller_name': None,
 'title': 'Hyundai i20 1.4 Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2015}
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP07382%27 HTTP/1.1" 200 None
2026-03-30 07:49:02 [auto1.de] INFO: Saving data for FP07382: {'auction_closing_time': 1774883411.0, 'created_time': 1773380605.231251, 'last_price_update_time': 1774856942.890086}
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FP07382') HTTP/1.1" 204 0
2026-03-30 07:49:02 [auto1.de] INFO: Found listing with ID: ZT51756
2026-03-30 07:49:02 [auto1.de] INFO: Found listing with ID: AJ08508
2026-03-30 07:49:02 [auto1.de] INFO: Found listing with ID: XL45586
2026-03-30 07:49:02 [auto1.de] INFO: Found listing with ID: JF78286
2026-03-30 07:49:02 [auto1.de] INFO: Found listing with ID: AV64816
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64816%27 HTTP/1.1" 200 None
2026-03-30 07:49:02 [auto1.de] INFO: Scrape type for AV64816: 2
2026-03-30 07:49:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d848566-7d3c-5d7f-a633-61351378115e with identifier: AV64816
2026-03-30 07:49:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d848566-7d3c-5d7f-a633-61351378115e with scrape type 2
2026-03-30 07:49:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d848566-7d3c-5d7f-a633-61351378115e with scrape type 2
2026-03-30 07:49:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8d848566-7d3c-5d7f-a633-61351378115e, identifier: AV64816
2026-03-30 07:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8d848566-7d3c-5d7f-a633-61351378115e with identifier: AV64816
2026-03-30 07:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8d848566-7d3c-5d7f-a633-61351378115e with identifier: AV64816
2026-03-30 07:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8d848566-7d3c-5d7f-a633-61351378115e with identifier: AV64816 to the API
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:25:33Z',
 'fuel_type': 'diesel',
 'id': '8d848566-7d3c-5d7f-a633-61351378115e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV64816',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 185199,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-27',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2019}
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV64816%27 HTTP/1.1" 200 None
2026-03-30 07:49:03 [auto1.de] INFO: Saving data for AV64816: {'auction_closing_time': 1774884333.0, 'created_time': 1774639970.236888, 'last_price_update_time': 1774856943.297189}
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV64816') HTTP/1.1" 204 0
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: JW09174
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: PS26933
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: VG01076
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: WT94690
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: DE42572
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: FX01006
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX01006%27 HTTP/1.1" 200 None
2026-03-30 07:49:03 [auto1.de] INFO: Scrape type for FX01006: 0
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: LU78971
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: NS04983
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-30 07:49:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:49:03 [auto1.de] INFO: Channel: 24h | Page: 153 | totalHits: 8407 | hits on page: 40
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: JH92340
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: MH95503
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH95503%27 HTTP/1.1" 200 None
2026-03-30 07:49:03 [auto1.de] INFO: Scrape type for MH95503: 0
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: MM23773
2026-03-30 07:49:03 [auto1.de] INFO: Found listing with ID: KS07911
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS07911%27 HTTP/1.1" 200 None
2026-03-30 07:49:03 [auto1.de] INFO: Scrape type for KS07911: 2
2026-03-30 07:49:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 069c96c1-ca15-58c5-af70-64d69062b4f4 with identifier: KS07911
2026-03-30 07:49:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 069c96c1-ca15-58c5-af70-64d69062b4f4 with scrape type 2
2026-03-30 07:49:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 069c96c1-ca15-58c5-af70-64d69062b4f4 with scrape type 2
2026-03-30 07:49:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 069c96c1-ca15-58c5-af70-64d69062b4f4, identifier: KS07911
2026-03-30 07:49:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 069c96c1-ca15-58c5-af70-64d69062b4f4 with identifier: KS07911
2026-03-30 07:49:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 069c96c1-ca15-58c5-af70-64d69062b4f4 with identifier: KS07911
2026-03-30 07:49:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 069c96c1-ca15-58c5-af70-64d69062b4f4 with identifier: KS07911 to the API
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:28:57Z',
 'fuel_type': 'diesel',
 'id': '069c96c1-ca15-58c5-af70-64d69062b4f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS07911',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 80579,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2020}
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS07911%27 HTTP/1.1" 200 None
2026-03-30 07:49:03 [auto1.de] INFO: Saving data for KS07911: {'auction_closing_time': 1774884537.0, 'created_time': 1774589794.252643, 'last_price_update_time': 1774856943.944967}
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS07911') HTTP/1.1" 204 0
2026-03-30 07:49:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: FY22177
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: ZS84546
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: JL01177
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: PP80168
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: NG76002
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: BD72910
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: RC80403
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: EY62389
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY62389%27 HTTP/1.1" 200 None
2026-03-30 07:49:04 [auto1.de] INFO: Scrape type for EY62389: 2
2026-03-30 07:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c93e275d-aacd-5940-846a-120393cd2140 with identifier: EY62389
2026-03-30 07:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c93e275d-aacd-5940-846a-120393cd2140 with scrape type 2
2026-03-30 07:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c93e275d-aacd-5940-846a-120393cd2140 with scrape type 2
2026-03-30 07:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c93e275d-aacd-5940-846a-120393cd2140, identifier: EY62389
2026-03-30 07:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c93e275d-aacd-5940-846a-120393cd2140 with identifier: EY62389
2026-03-30 07:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c93e275d-aacd-5940-846a-120393cd2140 with identifier: EY62389
2026-03-30 07:49:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c93e275d-aacd-5940-846a-120393cd2140 with identifier: EY62389 to the API
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:43:08Z',
 'fuel_type': 'petrol',
 'id': 'c93e275d-aacd-5940-846a-120393cd2140',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY62389',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 59091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-07',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2016}
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY62389%27 HTTP/1.1" 200 None
2026-03-30 07:49:04 [auto1.de] INFO: Saving data for EY62389: {'auction_closing_time': 1774885388.0, 'created_time': 1772726652.364602, 'last_price_update_time': 1774856944.489001}
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EY62389') HTTP/1.1" 204 0
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: MV27472
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: AJ71122
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: GB27977
2026-03-30 07:49:04 [auto1.de] INFO: Found listing with ID: NY59732
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY59732%27 HTTP/1.1" 200 None
2026-03-30 07:49:04 [auto1.de] INFO: Scrape type for NY59732: 2
2026-03-30 07:49:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7cfba0c-a32e-50ec-8e26-2e09367ae33b with identifier: NY59732
2026-03-30 07:49:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7cfba0c-a32e-50ec-8e26-2e09367ae33b with scrape type 2
2026-03-30 07:49:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7cfba0c-a32e-50ec-8e26-2e09367ae33b with scrape type 2
2026-03-30 07:49:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b7cfba0c-a32e-50ec-8e26-2e09367ae33b, identifier: NY59732
2026-03-30 07:49:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b7cfba0c-a32e-50ec-8e26-2e09367ae33b with identifier: NY59732
2026-03-30 07:49:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b7cfba0c-a32e-50ec-8e26-2e09367ae33b with identifier: NY59732
2026-03-30 07:49:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b7cfba0c-a32e-50ec-8e26-2e09367ae33b with identifier: NY59732 to the API
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:58:26Z',
 'fuel_type': 'diesel',
 'id': 'b7cfba0c-a32e-50ec-8e26-2e09367ae33b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY59732',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Tipo',
 'odometer': 128028,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-27',
 'seller_name': None,
 'title': 'Fiat Tipo 1.6 JTDM Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2016}
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY59732%27 HTTP/1.1" 200 None
2026-03-30 07:49:04 [auto1.de] INFO: Saving data for NY59732: {'auction_closing_time': 1774886306.0, 'created_time': 1774553154.088329, 'last_price_update_time': 1774856944.908403}
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NY59732') HTTP/1.1" 204 0
2026-03-30 07:49:05 [auto1.de] INFO: Found listing with ID: XR73410
2026-03-30 07:49:05 [auto1.de] INFO: Found listing with ID: CN74001
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN74001%27 HTTP/1.1" 200 None
2026-03-30 07:49:05 [auto1.de] INFO: Scrape type for CN74001: 2
2026-03-30 07:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with identifier: CN74001
2026-03-30 07:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with scrape type 2
2026-03-30 07:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with scrape type 2
2026-03-30 07:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf, identifier: CN74001
2026-03-30 07:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with identifier: CN74001
2026-03-30 07:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with identifier: CN74001
2026-03-30 07:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf with identifier: CN74001 to the API
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:36:03Z',
 'fuel_type': 'petrol',
 'id': '81ddbcb4-88f6-5b58-93f1-7a4b23d4f9cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN74001',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 187120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-25',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TSI Sport & Style 4Motion',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion',
 'year': 2012}
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN74001%27 HTTP/1.1" 200 None
2026-03-30 07:49:05 [auto1.de] INFO: Saving data for CN74001: {'auction_closing_time': 1774884963.0, 'created_time': 1774552852.778087, 'last_price_update_time': 1774856945.411363}
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CN74001') HTTP/1.1" 204 0
2026-03-30 07:49:05 [auto1.de] INFO: Found listing with ID: DM13382
2026-03-30 07:49:05 [auto1.de] INFO: Found listing with ID: FX39792
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX39792%27 HTTP/1.1" 200 None
2026-03-30 07:49:05 [auto1.de] INFO: Scrape type for FX39792: 2
2026-03-30 07:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c003da1-11e8-5f11-9e98-82373b915f1f with identifier: FX39792
2026-03-30 07:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c003da1-11e8-5f11-9e98-82373b915f1f with scrape type 2
2026-03-30 07:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c003da1-11e8-5f11-9e98-82373b915f1f with scrape type 2
2026-03-30 07:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c003da1-11e8-5f11-9e98-82373b915f1f, identifier: FX39792
2026-03-30 07:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c003da1-11e8-5f11-9e98-82373b915f1f with identifier: FX39792
2026-03-30 07:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c003da1-11e8-5f11-9e98-82373b915f1f with identifier: FX39792
2026-03-30 07:49:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c003da1-11e8-5f11-9e98-82373b915f1f with identifier: FX39792 to the API
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:25:07Z',
 'fuel_type': 'petrol',
 'id': '4c003da1-11e8-5f11-9e98-82373b915f1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX39792',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 114942,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-10-21',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2009}
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX39792%27 HTTP/1.1" 200 None
2026-03-30 07:49:05 [auto1.de] INFO: Saving data for FX39792: {'auction_closing_time': 1774884307.0, 'created_time': 1774639383.163034, 'last_price_update_time': 1774856945.817329}
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX39792') HTTP/1.1" 204 0
2026-03-30 07:49:05 [auto1.de] INFO: Found listing with ID: PR32906
2026-03-30 07:49:05 [auto1.de] INFO: Found listing with ID: BG13835
2026-03-30 07:49:05 [auto1.de] INFO: Found listing with ID: GR89322
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR89322%27 HTTP/1.1" 200 None
2026-03-30 07:49:05 [auto1.de] INFO: Scrape type for GR89322: 2
2026-03-30 07:49:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a43afc5f-7f01-5e24-889e-d7ab4e6c0cf1 with identifier: GR89322
2026-03-30 07:49:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a43afc5f-7f01-5e24-889e-d7ab4e6c0cf1 with scrape type 2
2026-03-30 07:49:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a43afc5f-7f01-5e24-889e-d7ab4e6c0cf1 with scrape type 2
2026-03-30 07:49:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a43afc5f-7f01-5e24-889e-d7ab4e6c0cf1, identifier: GR89322
2026-03-30 07:49:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a43afc5f-7f01-5e24-889e-d7ab4e6c0cf1 with identifier: GR89322
2026-03-30 07:49:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a43afc5f-7f01-5e24-889e-d7ab4e6c0cf1 with identifier: GR89322
2026-03-30 07:49:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a43afc5f-7f01-5e24-889e-d7ab4e6c0cf1 with identifier: GR89322 to the API
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:38:09Z',
 'fuel_type': 'diesel',
 'id': 'a43afc5f-7f01-5e24-889e-d7ab4e6c0cf1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR89322',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 231894,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-25',
 'seller_name': None,
 'title': 'Volvo V60 2.0 D4 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2015}
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR89322%27 HTTP/1.1" 200 None
2026-03-30 07:49:06 [auto1.de] INFO: Saving data for GR89322: {'auction_closing_time': 1774885089.0, 'created_time': 1774639400.492184, 'last_price_update_time': 1774856946.230352}
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GR89322') HTTP/1.1" 204 0
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: BJ03907
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: BE52525
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: ZD84444
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: KX79678
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: AR51863
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR51863%27 HTTP/1.1" 200 None
2026-03-30 07:49:06 [auto1.de] INFO: Scrape type for AR51863: 0
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: KY24056
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: AS79616
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: ZP29614
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP29614%27 HTTP/1.1" 200 None
2026-03-30 07:49:06 [auto1.de] INFO: Scrape type for ZP29614: 0
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: RK05347
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: KH41700
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH41700%27 HTTP/1.1" 200 None
2026-03-30 07:49:06 [auto1.de] INFO: Scrape type for KH41700: 2
2026-03-30 07:49:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 807c6e26-7af2-5b94-8acc-97ef0e448a76 with identifier: KH41700
2026-03-30 07:49:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 807c6e26-7af2-5b94-8acc-97ef0e448a76 with scrape type 2
2026-03-30 07:49:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 807c6e26-7af2-5b94-8acc-97ef0e448a76 with scrape type 2
2026-03-30 07:49:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 807c6e26-7af2-5b94-8acc-97ef0e448a76, identifier: KH41700
2026-03-30 07:49:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 807c6e26-7af2-5b94-8acc-97ef0e448a76 with identifier: KH41700
2026-03-30 07:49:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 807c6e26-7af2-5b94-8acc-97ef0e448a76 with identifier: KH41700
2026-03-30 07:49:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 807c6e26-7af2-5b94-8acc-97ef0e448a76 with identifier: KH41700 to the API
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:18:19Z',
 'fuel_type': 'petrol',
 'id': '807c6e26-7af2-5b94-8acc-97ef0e448a76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH41700',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 35310,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-07-22',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Turbo GS Line',
 'transmission': 'automatic',
 'trim': 'GS Line',
 'year': 2020}
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH41700%27 HTTP/1.1" 200 None
2026-03-30 07:49:06 [auto1.de] INFO: Saving data for KH41700: {'auction_closing_time': 1774883899.0, 'created_time': 1774552990.2077, 'last_price_update_time': 1774856946.675897}
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH41700') HTTP/1.1" 204 0
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: CY25945
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY25945%27 HTTP/1.1" 200 None
2026-03-30 07:49:06 [auto1.de] INFO: Scrape type for CY25945: 0
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: XC86778
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: CZ94450
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: WT06572
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06572%27 HTTP/1.1" 200 None
2026-03-30 07:49:06 [auto1.de] INFO: Scrape type for WT06572: 0
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: EU14663
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: MK09620
2026-03-30 07:49:06 [auto1.de] INFO: Found listing with ID: FD07804
2026-03-30 07:49:06 [scrapy.extensions.logstats] INFO: Crawled 349 pages (at 11 pages/min), scraped 1118 items (at 119 items/min)
2026-03-30 07:49:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:49:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:49:08 [auto1.de] INFO: Channel: 24h | Page: 154 | totalHits: 8407 | hits on page: 40
2026-03-30 07:49:08 [auto1.de] INFO: Found listing with ID: FK93420
2026-03-30 07:49:08 [auto1.de] INFO: Found listing with ID: BS96565
2026-03-30 07:49:08 [auto1.de] INFO: Found listing with ID: GH39417
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH39417%27 HTTP/1.1" 200 None
2026-03-30 07:49:08 [auto1.de] INFO: Scrape type for GH39417: 0
2026-03-30 07:49:08 [auto1.de] INFO: Found listing with ID: EU93663
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU93663%27 HTTP/1.1" 200 None
2026-03-30 07:49:08 [auto1.de] INFO: Scrape type for EU93663: 2
2026-03-30 07:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 400148f0-0e7b-5e4e-9732-3df9643caeeb with identifier: EU93663
2026-03-30 07:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 400148f0-0e7b-5e4e-9732-3df9643caeeb with scrape type 2
2026-03-30 07:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 400148f0-0e7b-5e4e-9732-3df9643caeeb with scrape type 2
2026-03-30 07:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 400148f0-0e7b-5e4e-9732-3df9643caeeb, identifier: EU93663
2026-03-30 07:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 400148f0-0e7b-5e4e-9732-3df9643caeeb with identifier: EU93663
2026-03-30 07:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 400148f0-0e7b-5e4e-9732-3df9643caeeb with identifier: EU93663
2026-03-30 07:49:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 400148f0-0e7b-5e4e-9732-3df9643caeeb with identifier: EU93663 to the API
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:20Z',
 'fuel_type': 'diesel',
 'id': '400148f0-0e7b-5e4e-9732-3df9643caeeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU93663',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 261996,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Laurin & Klement',
 'transmission': 'automatic',
 'trim': 'Laurin & Klement',
 'year': 2014}
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU93663%27 HTTP/1.1" 200 None
2026-03-30 07:49:08 [auto1.de] INFO: Saving data for EU93663: {'auction_closing_time': 1774883480.0, 'created_time': 1774639281.440271, 'last_price_update_time': 1774856948.428823}
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU93663') HTTP/1.1" 204 0
2026-03-30 07:49:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:49:08 [auto1.de] INFO: Found listing with ID: AU39005
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU39005%27 HTTP/1.1" 200 None
2026-03-30 07:49:08 [auto1.de] INFO: Scrape type for AU39005: 2
2026-03-30 07:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 121f5c9e-85b8-5670-a8d9-bc51027b5738 with identifier: AU39005
2026-03-30 07:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121f5c9e-85b8-5670-a8d9-bc51027b5738 with scrape type 2
2026-03-30 07:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 121f5c9e-85b8-5670-a8d9-bc51027b5738 with scrape type 2
2026-03-30 07:49:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 121f5c9e-85b8-5670-a8d9-bc51027b5738, identifier: AU39005
2026-03-30 07:49:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 121f5c9e-85b8-5670-a8d9-bc51027b5738 with identifier: AU39005
2026-03-30 07:49:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 121f5c9e-85b8-5670-a8d9-bc51027b5738 with identifier: AU39005
2026-03-30 07:49:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 121f5c9e-85b8-5670-a8d9-bc51027b5738 with identifier: AU39005 to the API
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:46:52Z',
 'fuel_type': 'petrol',
 'id': '121f5c9e-85b8-5670-a8d9-bc51027b5738',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AU39005',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-3',
 'odometer': 180551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-26',
 'seller_name': None,
 'title': 'Mazda CX-3 2.0 Kizoku',
 'transmission': 'manual',
 'trim': 'Kizoku',
 'year': 2017}
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU39005%27 HTTP/1.1" 200 None
2026-03-30 07:49:08 [auto1.de] INFO: Saving data for AU39005: {'auction_closing_time': 1774885612.0, 'created_time': 1774639340.939406, 'last_price_update_time': 1774856948.956395}
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AU39005') HTTP/1.1" 204 0
2026-03-30 07:49:08 [auto1.de] INFO: Found listing with ID: TP67168
2026-03-30 07:49:08 [auto1.de] INFO: Found listing with ID: AL71232
2026-03-30 07:49:08 [auto1.de] INFO: Found listing with ID: CP06535
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06535%27 HTTP/1.1" 200 None
2026-03-30 07:49:08 [auto1.de] INFO: Scrape type for CP06535: 2
2026-03-30 07:49:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c98c604-4807-5efe-ac36-de8e3b960b49 with identifier: CP06535
2026-03-30 07:49:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c98c604-4807-5efe-ac36-de8e3b960b49 with scrape type 2
2026-03-30 07:49:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c98c604-4807-5efe-ac36-de8e3b960b49 with scrape type 2
2026-03-30 07:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6c98c604-4807-5efe-ac36-de8e3b960b49, identifier: CP06535
2026-03-30 07:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6c98c604-4807-5efe-ac36-de8e3b960b49 with identifier: CP06535
2026-03-30 07:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6c98c604-4807-5efe-ac36-de8e3b960b49 with identifier: CP06535
2026-03-30 07:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6c98c604-4807-5efe-ac36-de8e3b960b49 with identifier: CP06535 to the API
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:26:18Z',
 'fuel_type': 'diesel',
 'id': '6c98c604-4807-5efe-ac36-de8e3b960b49',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP06535',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 102788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-13',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP06535%27 HTTP/1.1" 200 None
2026-03-30 07:49:09 [auto1.de] INFO: Saving data for CP06535: {'auction_closing_time': 1774884378.0, 'created_time': 1774033646.464863, 'last_price_update_time': 1774856949.376751}
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP06535') HTTP/1.1" 204 0
2026-03-30 07:49:09 [auto1.de] INFO: Found listing with ID: AZ37362
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ37362%27 HTTP/1.1" 200 None
2026-03-30 07:49:09 [auto1.de] INFO: Scrape type for AZ37362: 0
2026-03-30 07:49:09 [auto1.de] INFO: Found listing with ID: DJ60943
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ60943%27 HTTP/1.1" 200 None
2026-03-30 07:49:09 [auto1.de] INFO: Scrape type for DJ60943: 0
2026-03-30 07:49:09 [auto1.de] INFO: Found listing with ID: YH93335
2026-03-30 07:49:09 [auto1.de] INFO: Found listing with ID: YA08526
2026-03-30 07:49:09 [auto1.de] INFO: Found listing with ID: YD94034
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD94034%27 HTTP/1.1" 200 None
2026-03-30 07:49:09 [auto1.de] INFO: Scrape type for YD94034: 0
2026-03-30 07:49:09 [auto1.de] INFO: Found listing with ID: EE47026
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE47026%27 HTTP/1.1" 200 None
2026-03-30 07:49:09 [auto1.de] INFO: Scrape type for EE47026: 0
2026-03-30 07:49:09 [auto1.de] INFO: Found listing with ID: EJ97789
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ97789%27 HTTP/1.1" 200 None
2026-03-30 07:49:09 [auto1.de] INFO: Scrape type for EJ97789: 0
2026-03-30 07:49:09 [auto1.de] INFO: Found listing with ID: VC89740
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC89740%27 HTTP/1.1" 200 None
2026-03-30 07:49:09 [auto1.de] INFO: Scrape type for VC89740: 2
2026-03-30 07:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2e5bf76-922e-5884-aad2-1ceb50e7c9bc with identifier: VC89740
2026-03-30 07:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2e5bf76-922e-5884-aad2-1ceb50e7c9bc with scrape type 2
2026-03-30 07:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2e5bf76-922e-5884-aad2-1ceb50e7c9bc with scrape type 2
2026-03-30 07:49:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2e5bf76-922e-5884-aad2-1ceb50e7c9bc, identifier: VC89740
2026-03-30 07:49:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2e5bf76-922e-5884-aad2-1ceb50e7c9bc with identifier: VC89740
2026-03-30 07:49:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2e5bf76-922e-5884-aad2-1ceb50e7c9bc with identifier: VC89740
2026-03-30 07:49:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2e5bf76-922e-5884-aad2-1ceb50e7c9bc with identifier: VC89740 to the API
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:39:26Z',
 'fuel_type': 'diesel',
 'id': 'f2e5bf76-922e-5884-aad2-1ceb50e7c9bc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC89740',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 163212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-25',
 'seller_name': None,
 'title': 'Opel Astra 1.5 CDTI Edition Start/Stop',
 'transmission': 'manual',
 'trim': 'Edition Start/Stop',
 'year': 2021}
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC89740%27 HTTP/1.1" 200 None
2026-03-30 07:49:09 [auto1.de] INFO: Saving data for VC89740: {'auction_closing_time': 1774885166.0, 'created_time': 1774639863.074961, 'last_price_update_time': 1774856949.862773}
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VC89740') HTTP/1.1" 204 0
2026-03-30 07:49:09 [auto1.de] INFO: Found listing with ID: ML30380
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML30380%27 HTTP/1.1" 200 None
2026-03-30 07:49:09 [auto1.de] INFO: Scrape type for ML30380: 2
2026-03-30 07:49:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2077493-399d-5876-a70e-9654c20a32c2 with identifier: ML30380
2026-03-30 07:49:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2077493-399d-5876-a70e-9654c20a32c2 with scrape type 2
2026-03-30 07:49:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2077493-399d-5876-a70e-9654c20a32c2 with scrape type 2
2026-03-30 07:49:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2077493-399d-5876-a70e-9654c20a32c2, identifier: ML30380
2026-03-30 07:49:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2077493-399d-5876-a70e-9654c20a32c2 with identifier: ML30380
2026-03-30 07:49:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2077493-399d-5876-a70e-9654c20a32c2 with identifier: ML30380
2026-03-30 07:49:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2077493-399d-5876-a70e-9654c20a32c2 with identifier: ML30380 to the API
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:58:39Z',
 'fuel_type': 'petrol',
 'id': 'f2077493-399d-5876-a70e-9654c20a32c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML30380',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-12-19',
 'seller_name': None,
 'title': 'Opel Astra 1.6 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 1996}
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML30380%27 HTTP/1.1" 200 None
2026-03-30 07:49:10 [auto1.de] INFO: Saving data for ML30380: {'auction_closing_time': 1774886319.0, 'created_time': 1774639658.471994, 'last_price_update_time': 1774856950.571943}
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ML30380') HTTP/1.1" 204 0
2026-03-30 07:49:10 [auto1.de] INFO: Found listing with ID: YM60092
2026-03-30 07:49:10 [auto1.de] INFO: Found listing with ID: NC07165
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07165%27 HTTP/1.1" 200 None
2026-03-30 07:49:10 [auto1.de] INFO: Scrape type for NC07165: 0
2026-03-30 07:49:10 [auto1.de] INFO: Found listing with ID: HA99169
2026-03-30 07:49:10 [auto1.de] INFO: Found listing with ID: GU28360
2026-03-30 07:49:10 [auto1.de] INFO: Found listing with ID: GL23432
2026-03-30 07:49:10 [auto1.de] INFO: Found listing with ID: NY39865
2026-03-30 07:49:10 [auto1.de] INFO: Found listing with ID: RA07752
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA07752%27 HTTP/1.1" 200 None
2026-03-30 07:49:10 [auto1.de] INFO: Scrape type for RA07752: 0
2026-03-30 07:49:10 [auto1.de] INFO: Found listing with ID: YM89123
2026-03-30 07:49:10 [auto1.de] INFO: Found listing with ID: AG84988
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG84988%27 HTTP/1.1" 200 None
2026-03-30 07:49:10 [auto1.de] INFO: Scrape type for AG84988: 0
2026-03-30 07:49:10 [auto1.de] INFO: Found listing with ID: JE20553
2026-03-30 07:49:10 [auto1.de] INFO: Found listing with ID: UY21095
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY21095%27 HTTP/1.1" 200 None
2026-03-30 07:49:10 [auto1.de] INFO: Scrape type for UY21095: 2
2026-03-30 07:49:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9c3e73a-523d-5352-8771-b501c4774348 with identifier: UY21095
2026-03-30 07:49:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9c3e73a-523d-5352-8771-b501c4774348 with scrape type 2
2026-03-30 07:49:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9c3e73a-523d-5352-8771-b501c4774348 with scrape type 2
2026-03-30 07:49:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9c3e73a-523d-5352-8771-b501c4774348, identifier: UY21095
2026-03-30 07:49:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9c3e73a-523d-5352-8771-b501c4774348 with identifier: UY21095
2026-03-30 07:49:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9c3e73a-523d-5352-8771-b501c4774348 with identifier: UY21095
2026-03-30 07:49:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9c3e73a-523d-5352-8771-b501c4774348 with identifier: UY21095 to the API
2026-03-30 07:49:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:37:29Z',
 'fuel_type': 'diesel',
 'id': 'e9c3e73a-523d-5352-8771-b501c4774348',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY21095',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vectra',
 'odometer': 217312,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-11',
 'seller_name': None,
 'title': 'Opel Vectra 3.0 V6 CDTI Cosmo Plus',
 'transmission': 'automatic',
 'trim': 'Cosmo Plus',
 'year': 2008}
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY21095%27 HTTP/1.1" 200 None
2026-03-30 07:49:11 [auto1.de] INFO: Saving data for UY21095: {'auction_closing_time': 1774885049.0, 'created_time': 1774553240.415543, 'last_price_update_time': 1774856951.287054}
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UY21095') HTTP/1.1" 204 0
2026-03-30 07:49:11 [auto1.de] INFO: Found listing with ID: HE95833
2026-03-30 07:49:11 [auto1.de] INFO: Found listing with ID: WG73343
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG73343%27 HTTP/1.1" 200 None
2026-03-30 07:49:11 [auto1.de] INFO: Scrape type for WG73343: 2
2026-03-30 07:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 279541e4-bfa6-51f4-87af-d5acb3dc8df1 with identifier: WG73343
2026-03-30 07:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 279541e4-bfa6-51f4-87af-d5acb3dc8df1 with scrape type 2
2026-03-30 07:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 279541e4-bfa6-51f4-87af-d5acb3dc8df1 with scrape type 2
2026-03-30 07:49:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 279541e4-bfa6-51f4-87af-d5acb3dc8df1, identifier: WG73343
2026-03-30 07:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 279541e4-bfa6-51f4-87af-d5acb3dc8df1 with identifier: WG73343
2026-03-30 07:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 279541e4-bfa6-51f4-87af-d5acb3dc8df1 with identifier: WG73343
2026-03-30 07:49:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 279541e4-bfa6-51f4-87af-d5acb3dc8df1 with identifier: WG73343 to the API
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:34:44Z',
 'fuel_type': 'petrol',
 'id': '279541e4-bfa6-51f4-87af-d5acb3dc8df1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG73343',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 161006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-26',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Joy',
 'transmission': 'manual',
 'trim': 'Joy',
 'year': 2016}
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WG73343%27 HTTP/1.1" 200 None
2026-03-30 07:49:11 [auto1.de] INFO: Saving data for WG73343: {'auction_closing_time': 1774884884.0, 'created_time': 1773224196.092424, 'last_price_update_time': 1774856951.798204}
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WG73343') HTTP/1.1" 204 0
2026-03-30 07:49:11 [auto1.de] INFO: Found listing with ID: SD64601
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD64601%27 HTTP/1.1" 200 None
2026-03-30 07:49:11 [auto1.de] INFO: Scrape type for SD64601: 0
2026-03-30 07:49:11 [auto1.de] INFO: Found listing with ID: VU06993
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU06993%27 HTTP/1.1" 200 None
2026-03-30 07:49:11 [auto1.de] INFO: Scrape type for VU06993: 0
2026-03-30 07:49:11 [auto1.de] INFO: Found listing with ID: BH40486
2026-03-30 07:49:11 [auto1.de] INFO: Found listing with ID: PJ72661
2026-03-30 07:49:11 [auto1.de] INFO: Found listing with ID: ME01390
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME01390%27 HTTP/1.1" 200 None
2026-03-30 07:49:11 [auto1.de] INFO: Scrape type for ME01390: 2
2026-03-30 07:49:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8cf5cc1-6da3-53aa-a112-336a2600474b with identifier: ME01390
2026-03-30 07:49:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8cf5cc1-6da3-53aa-a112-336a2600474b with scrape type 2
2026-03-30 07:49:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8cf5cc1-6da3-53aa-a112-336a2600474b with scrape type 2
2026-03-30 07:49:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f8cf5cc1-6da3-53aa-a112-336a2600474b, identifier: ME01390
2026-03-30 07:49:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:49:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f8cf5cc1-6da3-53aa-a112-336a2600474b with identifier: ME01390
2026-03-30 07:49:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f8cf5cc1-6da3-53aa-a112-336a2600474b with identifier: ME01390
2026-03-30 07:49:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f8cf5cc1-6da3-53aa-a112-336a2600474b with identifier: ME01390 to the API
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:55:05Z',
 'fuel_type': 'petrol',
 'id': 'f8cf5cc1-6da3-53aa-a112-336a2600474b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME01390',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 36063,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.5 TSI ACT Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Comfortline BlueMotion',
 'year': 2023}
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME01390%27 HTTP/1.1" 200 None
2026-03-30 07:49:12 [auto1.de] INFO: Saving data for ME01390: {'auction_closing_time': 1774886105.0, 'created_time': 1774639533.672791, 'last_price_update_time': 1774856952.281949}
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ME01390') HTTP/1.1" 204 0
2026-03-30 07:49:12 [auto1.de] INFO: Found listing with ID: EU55937
2026-03-30 07:49:12 [auto1.de] INFO: Found listing with ID: FC58368
2026-03-30 07:49:12 [auto1.de] INFO: Found listing with ID: TR16166
2026-03-30 07:49:12 [auto1.de] INFO: Found listing with ID: NK37699
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK37699%27 HTTP/1.1" 200 None
2026-03-30 07:49:12 [auto1.de] INFO: Scrape type for NK37699: 2
2026-03-30 07:49:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba37cedc-0681-5c99-865e-5a588f41e654 with identifier: NK37699
2026-03-30 07:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba37cedc-0681-5c99-865e-5a588f41e654 with scrape type 2
2026-03-30 07:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ba37cedc-0681-5c99-865e-5a588f41e654 with scrape type 2
2026-03-30 07:49:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ba37cedc-0681-5c99-865e-5a588f41e654, identifier: NK37699
2026-03-30 07:49:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ba37cedc-0681-5c99-865e-5a588f41e654 with identifier: NK37699
2026-03-30 07:49:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ba37cedc-0681-5c99-865e-5a588f41e654 with identifier: NK37699
2026-03-30 07:49:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ba37cedc-0681-5c99-865e-5a588f41e654 with identifier: NK37699 to the API
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:30:38Z',
 'fuel_type': 'petrol',
 'id': 'ba37cedc-0681-5c99-865e-5a588f41e654',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK37699',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Talisman',
 'odometer': 108322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-30',
 'seller_name': None,
 'title': 'Renault Talisman 1.6 TCe Energy Initiale Paris',
 'transmission': 'automatic',
 'trim': 'Initiale Paris',
 'year': 2017}
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK37699%27 HTTP/1.1" 200 None
2026-03-30 07:49:12 [auto1.de] INFO: Saving data for NK37699: {'auction_closing_time': 1774884638.0, 'created_time': 1774552826.580332, 'last_price_update_time': 1774856952.674122}
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK37699') HTTP/1.1" 204 0
2026-03-30 07:49:12 [auto1.de] INFO: Found listing with ID: TL72428
2026-03-30 07:49:12 [auto1.de] INFO: Channel: 24h | Page: 155 | totalHits: 8407 | hits on page: 40
2026-03-30 07:49:12 [auto1.de] INFO: Found listing with ID: RB67874
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RB67874%27 HTTP/1.1" 200 None
2026-03-30 07:49:12 [auto1.de] INFO: Scrape type for RB67874: 0
2026-03-30 07:49:12 [auto1.de] INFO: Found listing with ID: JR29139
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR29139%27 HTTP/1.1" 200 None
2026-03-30 07:49:12 [auto1.de] INFO: Scrape type for JR29139: 2
2026-03-30 07:49:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bcd22f6-ba5a-50ea-9235-5d563cd17b7e with identifier: JR29139
2026-03-30 07:49:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bcd22f6-ba5a-50ea-9235-5d563cd17b7e with scrape type 2
2026-03-30 07:49:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bcd22f6-ba5a-50ea-9235-5d563cd17b7e with scrape type 2
2026-03-30 07:49:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6bcd22f6-ba5a-50ea-9235-5d563cd17b7e, identifier: JR29139
2026-03-30 07:49:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:49:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6bcd22f6-ba5a-50ea-9235-5d563cd17b7e with identifier: JR29139
2026-03-30 07:49:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6bcd22f6-ba5a-50ea-9235-5d563cd17b7e with identifier: JR29139
2026-03-30 07:49:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6bcd22f6-ba5a-50ea-9235-5d563cd17b7e with identifier: JR29139 to the API
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:39:40Z',
 'fuel_type': 'petrol',
 'id': '6bcd22f6-ba5a-50ea-9235-5d563cd17b7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR29139',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 268205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-07',
 'seller_name': None,
 'title': 'Audi A4 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR29139%27 HTTP/1.1" 200 None
2026-03-30 07:49:13 [auto1.de] INFO: Saving data for JR29139: {'auction_closing_time': 1774885180.0, 'created_time': 1774031862.422426, 'last_price_update_time': 1774856953.247852}
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR29139') HTTP/1.1" 204 0
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: HG88240
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG88240%27 HTTP/1.1" 200 None
2026-03-30 07:49:13 [auto1.de] INFO: Scrape type for HG88240: 0
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: CN22561
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: CT75216
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: NV84142
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: ZH54779
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: WN20430
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: UA34873
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA34873%27 HTTP/1.1" 200 None
2026-03-30 07:49:13 [auto1.de] INFO: Scrape type for UA34873: 0
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: KV75239
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: XA05617
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA05617%27 HTTP/1.1" 200 None
2026-03-30 07:49:13 [auto1.de] INFO: Scrape type for XA05617: 0
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: CP55762
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: CE75609
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE75609%27 HTTP/1.1" 200 None
2026-03-30 07:49:13 [auto1.de] INFO: Scrape type for CE75609: 2
2026-03-30 07:49:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce20ad71-5a1b-53bb-bc99-0cabea4af641 with identifier: CE75609
2026-03-30 07:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce20ad71-5a1b-53bb-bc99-0cabea4af641 with scrape type 2
2026-03-30 07:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ce20ad71-5a1b-53bb-bc99-0cabea4af641 with scrape type 2
2026-03-30 07:49:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ce20ad71-5a1b-53bb-bc99-0cabea4af641, identifier: CE75609
2026-03-30 07:49:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ce20ad71-5a1b-53bb-bc99-0cabea4af641 with identifier: CE75609
2026-03-30 07:49:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ce20ad71-5a1b-53bb-bc99-0cabea4af641 with identifier: CE75609
2026-03-30 07:49:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ce20ad71-5a1b-53bb-bc99-0cabea4af641 with identifier: CE75609 to the API
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:28:39Z',
 'fuel_type': 'diesel',
 'id': 'ce20ad71-5a1b-53bb-bc99-0cabea4af641',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE75609',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 83446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-30',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
 'transmission': 'manual',
 'trim': '350 L3 Trend',
 'year': 2019}
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE75609%27 HTTP/1.1" 200 None
2026-03-30 07:49:13 [auto1.de] INFO: Saving data for CE75609: {'auction_closing_time': 1774884519.0, 'created_time': 1774550615.603596, 'last_price_update_time': 1774856953.729445}
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CE75609') HTTP/1.1" 204 0
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: CF39305
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF39305%27 HTTP/1.1" 200 None
2026-03-30 07:49:13 [auto1.de] INFO: Scrape type for CF39305: 0
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: ES68108
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES68108%27 HTTP/1.1" 200 None
2026-03-30 07:49:13 [auto1.de] INFO: Scrape type for ES68108: 0
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: UE30876
2026-03-30 07:49:13 [auto1.de] INFO: Found listing with ID: MX54402
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX54402%27 HTTP/1.1" 200 None
2026-03-30 07:49:13 [auto1.de] INFO: Scrape type for MX54402: 2
2026-03-30 07:49:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c52ca666-1240-56f7-ae69-10b894230e68 with identifier: MX54402
2026-03-30 07:49:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c52ca666-1240-56f7-ae69-10b894230e68 with scrape type 2
2026-03-30 07:49:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c52ca666-1240-56f7-ae69-10b894230e68 with scrape type 2
2026-03-30 07:49:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c52ca666-1240-56f7-ae69-10b894230e68, identifier: MX54402
2026-03-30 07:49:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c52ca666-1240-56f7-ae69-10b894230e68 with identifier: MX54402
2026-03-30 07:49:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c52ca666-1240-56f7-ae69-10b894230e68 with identifier: MX54402
2026-03-30 07:49:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c52ca666-1240-56f7-ae69-10b894230e68 with identifier: MX54402 to the API
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:59:42Z',
 'fuel_type': 'petrol',
 'id': 'c52ca666-1240-56f7-ae69-10b894230e68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX54402',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 155375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-30',
 'seller_name': None,
 'title': 'Suzuki Swift 1.2 Basic',
 'transmission': 'manual',
 'trim': 'Basic',
 'year': 2011}
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX54402%27 HTTP/1.1" 200 None
2026-03-30 07:49:14 [auto1.de] INFO: Saving data for MX54402: {'auction_closing_time': 1774886382.0, 'created_time': 1774638924.517662, 'last_price_update_time': 1774856954.326512}
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX54402') HTTP/1.1" 204 0
2026-03-30 07:49:14 [auto1.de] INFO: Found listing with ID: HW68760
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW68760%27 HTTP/1.1" 200 None
2026-03-30 07:49:14 [auto1.de] INFO: Scrape type for HW68760: 2
2026-03-30 07:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc6159ce-5606-5fe4-abc0-68ab1539d399 with identifier: HW68760
2026-03-30 07:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc6159ce-5606-5fe4-abc0-68ab1539d399 with scrape type 2
2026-03-30 07:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc6159ce-5606-5fe4-abc0-68ab1539d399 with scrape type 2
2026-03-30 07:49:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bc6159ce-5606-5fe4-abc0-68ab1539d399, identifier: HW68760
2026-03-30 07:49:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bc6159ce-5606-5fe4-abc0-68ab1539d399 with identifier: HW68760
2026-03-30 07:49:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bc6159ce-5606-5fe4-abc0-68ab1539d399 with identifier: HW68760
2026-03-30 07:49:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bc6159ce-5606-5fe4-abc0-68ab1539d399 with identifier: HW68760 to the API
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:23:31Z',
 'fuel_type': 'petrol',
 'id': 'bc6159ce-5606-5fe4-abc0-68ab1539d399',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW68760',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 97553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': None,
 'title': 'BMW 1er 118i Sport Line',
 'transmission': 'manual',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW68760%27 HTTP/1.1" 200 None
2026-03-30 07:49:14 [auto1.de] INFO: Saving data for HW68760: {'auction_closing_time': 1774884211.0, 'created_time': 1774552801.673328, 'last_price_update_time': 1774856954.742779}
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW68760') HTTP/1.1" 204 0
2026-03-30 07:49:14 [auto1.de] INFO: Found listing with ID: EY98011
2026-03-30 07:49:14 [auto1.de] INFO: Found listing with ID: TY32384
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY32384%27 HTTP/1.1" 200 None
2026-03-30 07:49:14 [auto1.de] INFO: Scrape type for TY32384: 0
2026-03-30 07:49:14 [auto1.de] INFO: Found listing with ID: LZ51858
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ51858%27 HTTP/1.1" 200 None
2026-03-30 07:49:14 [auto1.de] INFO: Scrape type for LZ51858: 0
2026-03-30 07:49:14 [auto1.de] INFO: Found listing with ID: MK93259
2026-03-30 07:49:14 [auto1.de] INFO: Found listing with ID: AH85059
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH85059%27 HTTP/1.1" 200 None
2026-03-30 07:49:14 [auto1.de] INFO: Scrape type for AH85059: 0
2026-03-30 07:49:14 [auto1.de] INFO: Found listing with ID: MS39817
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS39817%27 HTTP/1.1" 200 None
2026-03-30 07:49:14 [auto1.de] INFO: Scrape type for MS39817: 2
2026-03-30 07:49:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78b96dda-845e-5836-8f92-ee48754c3dce with identifier: MS39817
2026-03-30 07:49:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78b96dda-845e-5836-8f92-ee48754c3dce with scrape type 2
2026-03-30 07:49:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78b96dda-845e-5836-8f92-ee48754c3dce with scrape type 2
2026-03-30 07:49:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 78b96dda-845e-5836-8f92-ee48754c3dce, identifier: MS39817
2026-03-30 07:49:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 78b96dda-845e-5836-8f92-ee48754c3dce with identifier: MS39817
2026-03-30 07:49:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 78b96dda-845e-5836-8f92-ee48754c3dce with identifier: MS39817
2026-03-30 07:49:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 78b96dda-845e-5836-8f92-ee48754c3dce with identifier: MS39817 to the API
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-30T15:24:46Z',
 'fuel_type': 'petrol',
 'id': '78b96dda-845e-5836-8f92-ee48754c3dce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS39817',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 21024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-03',
 'seller_name': None,
 'title': 'BMW 2er M235i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS39817%27 HTTP/1.1" 200 None
2026-03-30 07:49:15 [auto1.de] INFO: Saving data for MS39817: {'auction_closing_time': 1774884286.0, 'created_time': 1773226347.900555, 'last_price_update_time': 1774856955.227861}
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MS39817') HTTP/1.1" 204 0
2026-03-30 07:49:15 [auto1.de] INFO: Found listing with ID: JT09686
2026-03-30 07:49:15 [auto1.de] INFO: Found listing with ID: NS09930
2026-03-30 07:49:15 [auto1.de] INFO: Found listing with ID: NY21344
2026-03-30 07:49:15 [auto1.de] INFO: Found listing with ID: TD61700
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD61700%27 HTTP/1.1" 200 None
2026-03-30 07:49:15 [auto1.de] INFO: Scrape type for TD61700: 2
2026-03-30 07:49:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3625a135-9961-5329-be46-23e7aaf9d138 with identifier: TD61700
2026-03-30 07:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3625a135-9961-5329-be46-23e7aaf9d138 with scrape type 2
2026-03-30 07:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3625a135-9961-5329-be46-23e7aaf9d138 with scrape type 2
2026-03-30 07:49:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3625a135-9961-5329-be46-23e7aaf9d138, identifier: TD61700
2026-03-30 07:49:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3625a135-9961-5329-be46-23e7aaf9d138 with identifier: TD61700
2026-03-30 07:49:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3625a135-9961-5329-be46-23e7aaf9d138 with identifier: TD61700
2026-03-30 07:49:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3625a135-9961-5329-be46-23e7aaf9d138 with identifier: TD61700 to the API
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:02:58Z',
 'fuel_type': 'diesel',
 'id': '3625a135-9961-5329-be46-23e7aaf9d138',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD61700',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 206948,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-18',
 'seller_name': None,
 'title': 'Renault Scenic 1.6 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD61700%27 HTTP/1.1" 200 None
2026-03-30 07:49:15 [auto1.de] INFO: Saving data for TD61700: {'auction_closing_time': 1774882978.0, 'created_time': 1774550672.793424, 'last_price_update_time': 1774856955.742989}
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TD61700') HTTP/1.1" 204 0
2026-03-30 07:49:15 [auto1.de] INFO: Found listing with ID: YM15583
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YM15583%27 HTTP/1.1" 200 None
2026-03-30 07:49:15 [auto1.de] INFO: Scrape type for YM15583: 0
2026-03-30 07:49:15 [auto1.de] INFO: Found listing with ID: CB40051
2026-03-30 07:49:15 [auto1.de] INFO: Found listing with ID: AD93379
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD93379%27 HTTP/1.1" 200 None
2026-03-30 07:49:15 [auto1.de] INFO: Scrape type for AD93379: 2
2026-03-30 07:49:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 753c98a9-938d-5a84-8acf-f62d9b96841e with identifier: AD93379
2026-03-30 07:49:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 753c98a9-938d-5a84-8acf-f62d9b96841e with scrape type 2
2026-03-30 07:49:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 753c98a9-938d-5a84-8acf-f62d9b96841e with scrape type 2
2026-03-30 07:49:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 753c98a9-938d-5a84-8acf-f62d9b96841e, identifier: AD93379
2026-03-30 07:49:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 753c98a9-938d-5a84-8acf-f62d9b96841e with identifier: AD93379
2026-03-30 07:49:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 753c98a9-938d-5a84-8acf-f62d9b96841e with identifier: AD93379
2026-03-30 07:49:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 753c98a9-938d-5a84-8acf-f62d9b96841e with identifier: AD93379 to the API
2026-03-30 07:49:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:12:02Z',
 'fuel_type': 'diesel',
 'id': '753c98a9-938d-5a84-8acf-f62d9b96841e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD93379',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 188070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-20',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD93379%27 HTTP/1.1" 200 None
2026-03-30 07:49:16 [auto1.de] INFO: Saving data for AD93379: {'auction_closing_time': 1774883522.0, 'created_time': 1774637380.061288, 'last_price_update_time': 1774856956.194339}
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD93379') HTTP/1.1" 204 0
2026-03-30 07:49:16 [auto1.de] INFO: Found listing with ID: HB70808
2026-03-30 07:49:16 [auto1.de] INFO: Found listing with ID: XR43208
2026-03-30 07:49:16 [auto1.de] INFO: Found listing with ID: BR25220
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR25220%27 HTTP/1.1" 200 None
2026-03-30 07:49:16 [auto1.de] INFO: Scrape type for BR25220: 2
2026-03-30 07:49:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9eb727e-1039-5632-a76d-d8febb4b3567 with identifier: BR25220
2026-03-30 07:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9eb727e-1039-5632-a76d-d8febb4b3567 with scrape type 2
2026-03-30 07:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9eb727e-1039-5632-a76d-d8febb4b3567 with scrape type 2
2026-03-30 07:49:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9eb727e-1039-5632-a76d-d8febb4b3567, identifier: BR25220
2026-03-30 07:49:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9eb727e-1039-5632-a76d-d8febb4b3567 with identifier: BR25220
2026-03-30 07:49:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9eb727e-1039-5632-a76d-d8febb4b3567 with identifier: BR25220
2026-03-30 07:49:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9eb727e-1039-5632-a76d-d8febb4b3567 with identifier: BR25220 to the API
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:06Z',
 'fuel_type': 'petrol',
 'id': 'c9eb727e-1039-5632-a76d-d8febb4b3567',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR25220',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 141661,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': None,
 'title': 'Opel Astra 1.4 SIDI Turbo Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2016}
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR25220%27 HTTP/1.1" 200 None
2026-03-30 07:49:16 [auto1.de] INFO: Saving data for BR25220: {'auction_closing_time': 1774885806.0, 'created_time': 1774638643.404143, 'last_price_update_time': 1774856956.878806}
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR25220') HTTP/1.1" 204 0
2026-03-30 07:49:16 [auto1.de] INFO: Found listing with ID: MP24640
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP24640%27 HTTP/1.1" 200 None
2026-03-30 07:49:16 [auto1.de] INFO: Scrape type for MP24640: 0
2026-03-30 07:49:16 [auto1.de] INFO: Found listing with ID: SM54936
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM54936%27 HTTP/1.1" 200 None
2026-03-30 07:49:16 [auto1.de] INFO: Scrape type for SM54936: 0
2026-03-30 07:49:16 [auto1.de] INFO: Found listing with ID: LA11075
2026-03-30 07:49:16 [auto1.de] INFO: Found listing with ID: VN62534
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN62534%27 HTTP/1.1" 200 None
2026-03-30 07:49:16 [auto1.de] INFO: Scrape type for VN62534: 2
2026-03-30 07:49:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 904988d9-40d8-53d8-aa97-b317f0ad570c with identifier: VN62534
2026-03-30 07:49:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 904988d9-40d8-53d8-aa97-b317f0ad570c with scrape type 2
2026-03-30 07:49:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 904988d9-40d8-53d8-aa97-b317f0ad570c with scrape type 2
2026-03-30 07:49:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 904988d9-40d8-53d8-aa97-b317f0ad570c, identifier: VN62534
2026-03-30 07:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 904988d9-40d8-53d8-aa97-b317f0ad570c with identifier: VN62534
2026-03-30 07:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 904988d9-40d8-53d8-aa97-b317f0ad570c with identifier: VN62534
2026-03-30 07:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 904988d9-40d8-53d8-aa97-b317f0ad570c with identifier: VN62534 to the API
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 249,
 'expiration_date': '2026-03-30T15:58:51Z',
 'fuel_type': 'diesel',
 'id': '904988d9-40d8-53d8-aa97-b317f0ad570c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN62534',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 82782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-06',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 B5 Diesel Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2021}
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN62534%27 HTTP/1.1" 200 None
2026-03-30 07:49:17 [auto1.de] INFO: Saving data for VN62534: {'auction_closing_time': 1774886331.0, 'created_time': 1774552342.332474, 'last_price_update_time': 1774856957.309992}
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN62534') HTTP/1.1" 204 0
2026-03-30 07:49:17 [auto1.de] INFO: Found listing with ID: CG81314
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG81314%27 HTTP/1.1" 200 None
2026-03-30 07:49:17 [auto1.de] INFO: Scrape type for CG81314: 2
2026-03-30 07:49:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f714f361-e5b9-5dba-8588-204f8ca90dff with identifier: CG81314
2026-03-30 07:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f714f361-e5b9-5dba-8588-204f8ca90dff with scrape type 2
2026-03-30 07:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f714f361-e5b9-5dba-8588-204f8ca90dff with scrape type 2
2026-03-30 07:49:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f714f361-e5b9-5dba-8588-204f8ca90dff, identifier: CG81314
2026-03-30 07:49:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f714f361-e5b9-5dba-8588-204f8ca90dff with identifier: CG81314
2026-03-30 07:49:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f714f361-e5b9-5dba-8588-204f8ca90dff with identifier: CG81314
2026-03-30 07:49:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f714f361-e5b9-5dba-8588-204f8ca90dff with identifier: CG81314 to the API
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:10:20Z',
 'fuel_type': 'diesel',
 'id': 'f714f361-e5b9-5dba-8588-204f8ca90dff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG81314',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 256847,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Highline 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline 4Motion BlueMotion',
 'year': 2017}
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG81314%27 HTTP/1.1" 200 None
2026-03-30 07:49:17 [auto1.de] INFO: Saving data for CG81314: {'auction_closing_time': 1774883420.0, 'created_time': 1773380500.78142, 'last_price_update_time': 1774856957.830179}
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG81314') HTTP/1.1" 204 0
2026-03-30 07:49:17 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-30 07:49:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:49:17 [auto1.de] INFO: Channel: 24h | Page: 156 | totalHits: 8408 | hits on page: 40
2026-03-30 07:49:17 [auto1.de] INFO: Found listing with ID: BX54451
2026-03-30 07:49:17 [auto1.de] INFO: Found listing with ID: UK08756
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK08756%27 HTTP/1.1" 200 None
2026-03-30 07:49:17 [auto1.de] INFO: Scrape type for UK08756: 2
2026-03-30 07:49:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2685ef13-5a92-5ee8-acf0-1c613ff27ad0 with identifier: UK08756
2026-03-30 07:49:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2685ef13-5a92-5ee8-acf0-1c613ff27ad0 with scrape type 2
2026-03-30 07:49:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2685ef13-5a92-5ee8-acf0-1c613ff27ad0 with scrape type 2
2026-03-30 07:49:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2685ef13-5a92-5ee8-acf0-1c613ff27ad0, identifier: UK08756
2026-03-30 07:49:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2685ef13-5a92-5ee8-acf0-1c613ff27ad0 with identifier: UK08756
2026-03-30 07:49:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2685ef13-5a92-5ee8-acf0-1c613ff27ad0 with identifier: UK08756
2026-03-30 07:49:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2685ef13-5a92-5ee8-acf0-1c613ff27ad0 with identifier: UK08756 to the API
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:26:06Z',
 'fuel_type': 'petrol',
 'id': '2685ef13-5a92-5ee8-acf0-1c613ff27ad0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UK08756',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 85120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-11',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK08756%27 HTTP/1.1" 200 None
2026-03-30 07:49:18 [auto1.de] INFO: Saving data for UK08756: {'auction_closing_time': 1774884366.0, 'created_time': 1774638975.08186, 'last_price_update_time': 1774856958.386518}
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UK08756') HTTP/1.1" 204 0
2026-03-30 07:49:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:49:18 [auto1.de] INFO: Found listing with ID: KN66940
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN66940%27 HTTP/1.1" 200 None
2026-03-30 07:49:18 [auto1.de] INFO: Scrape type for KN66940: 0
2026-03-30 07:49:18 [auto1.de] INFO: Found listing with ID: CZ66164
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ66164%27 HTTP/1.1" 200 None
2026-03-30 07:49:18 [auto1.de] INFO: Scrape type for CZ66164: 0
2026-03-30 07:49:18 [auto1.de] INFO: Found listing with ID: CR88792
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR88792%27 HTTP/1.1" 200 None
2026-03-30 07:49:18 [auto1.de] INFO: Scrape type for CR88792: 0
2026-03-30 07:49:18 [auto1.de] INFO: Found listing with ID: KU93910
2026-03-30 07:49:18 [auto1.de] INFO: Found listing with ID: UB65858
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB65858%27 HTTP/1.1" 200 None
2026-03-30 07:49:18 [auto1.de] INFO: Scrape type for UB65858: 0
2026-03-30 07:49:18 [auto1.de] INFO: Found listing with ID: FU68975
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU68975%27 HTTP/1.1" 200 None
2026-03-30 07:49:18 [auto1.de] INFO: Scrape type for FU68975: 0
2026-03-30 07:49:18 [auto1.de] INFO: Found listing with ID: ZK53162
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK53162%27 HTTP/1.1" 200 None
2026-03-30 07:49:18 [auto1.de] INFO: Scrape type for ZK53162: 2
2026-03-30 07:49:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6d261c4-e929-5979-a2e1-d0f55d6b0af3 with identifier: ZK53162
2026-03-30 07:49:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6d261c4-e929-5979-a2e1-d0f55d6b0af3 with scrape type 2
2026-03-30 07:49:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6d261c4-e929-5979-a2e1-d0f55d6b0af3 with scrape type 2
2026-03-30 07:49:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6d261c4-e929-5979-a2e1-d0f55d6b0af3, identifier: ZK53162
2026-03-30 07:49:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6d261c4-e929-5979-a2e1-d0f55d6b0af3 with identifier: ZK53162
2026-03-30 07:49:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6d261c4-e929-5979-a2e1-d0f55d6b0af3 with identifier: ZK53162
2026-03-30 07:49:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6d261c4-e929-5979-a2e1-d0f55d6b0af3 with identifier: ZK53162 to the API
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:40:42Z',
 'fuel_type': 'petrol',
 'id': 'c6d261c4-e929-5979-a2e1-d0f55d6b0af3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK53162',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 88010,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-09',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2013}
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK53162%27 HTTP/1.1" 200 None
2026-03-30 07:49:18 [auto1.de] INFO: Saving data for ZK53162: {'auction_closing_time': 1774885242.0, 'created_time': 1774035196.631622, 'last_price_update_time': 1774856958.90031}
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZK53162') HTTP/1.1" 204 0
2026-03-30 07:49:19 [auto1.de] INFO: Found listing with ID: EC39473
2026-03-30 07:49:19 [auto1.de] INFO: Found listing with ID: BK24126
2026-03-30 07:49:19 [auto1.de] INFO: Found listing with ID: EJ80176
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EJ80176%27 HTTP/1.1" 200 None
2026-03-30 07:49:19 [auto1.de] INFO: Scrape type for EJ80176: 0
2026-03-30 07:49:19 [auto1.de] INFO: Found listing with ID: VL77051
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL77051%27 HTTP/1.1" 200 None
2026-03-30 07:49:19 [auto1.de] INFO: Scrape type for VL77051: 0
2026-03-30 07:49:19 [auto1.de] INFO: Found listing with ID: YK25344
2026-03-30 07:49:19 [auto1.de] INFO: Found listing with ID: AN36712
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN36712%27 HTTP/1.1" 200 None
2026-03-30 07:49:19 [auto1.de] INFO: Scrape type for AN36712: 0
2026-03-30 07:49:19 [auto1.de] INFO: Found listing with ID: YR07443
2026-03-30 07:49:19 [auto1.de] INFO: Found listing with ID: UG59761
2026-03-30 07:49:19 [auto1.de] INFO: Found listing with ID: SW09087
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW09087%27 HTTP/1.1" 200 None
2026-03-30 07:49:19 [auto1.de] INFO: Scrape type for SW09087: 2
2026-03-30 07:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cd29fc2-4e18-5f15-9894-135d26d12b30 with identifier: SW09087
2026-03-30 07:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cd29fc2-4e18-5f15-9894-135d26d12b30 with scrape type 2
2026-03-30 07:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cd29fc2-4e18-5f15-9894-135d26d12b30 with scrape type 2
2026-03-30 07:49:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3cd29fc2-4e18-5f15-9894-135d26d12b30, identifier: SW09087
2026-03-30 07:49:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3cd29fc2-4e18-5f15-9894-135d26d12b30 with identifier: SW09087
2026-03-30 07:49:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3cd29fc2-4e18-5f15-9894-135d26d12b30 with identifier: SW09087
2026-03-30 07:49:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3cd29fc2-4e18-5f15-9894-135d26d12b30 with identifier: SW09087 to the API
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 222,
 'expiration_date': '2026-03-30T15:45:12Z',
 'fuel_type': 'hybrid',
 'id': '3cd29fc2-4e18-5f15-9894-135d26d12b30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW09087',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 47536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-16',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.5 Hybrid 4x4 Team D',
 'transmission': 'automatic',
 'trim': '4x4 Team D',
 'year': 2021}
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW09087%27 HTTP/1.1" 200 None
2026-03-30 07:49:19 [auto1.de] INFO: Saving data for SW09087: {'auction_closing_time': 1774885512.0, 'created_time': 1774638592.991813, 'last_price_update_time': 1774856959.458692}
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SW09087') HTTP/1.1" 204 0
2026-03-30 07:49:19 [auto1.de] INFO: Found listing with ID: ND18169
2026-03-30 07:49:19 [auto1.de] INFO: Found listing with ID: KX34445
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX34445%27 HTTP/1.1" 200 None
2026-03-30 07:49:19 [auto1.de] INFO: Scrape type for KX34445: 2
2026-03-30 07:49:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86abafea-bba1-55b4-b3af-84d66755558f with identifier: KX34445
2026-03-30 07:49:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 86abafea-bba1-55b4-b3af-84d66755558f with scrape type 2
2026-03-30 07:49:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 86abafea-bba1-55b4-b3af-84d66755558f with scrape type 2
2026-03-30 07:49:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 86abafea-bba1-55b4-b3af-84d66755558f, identifier: KX34445
2026-03-30 07:49:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 86abafea-bba1-55b4-b3af-84d66755558f with identifier: KX34445
2026-03-30 07:49:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 86abafea-bba1-55b4-b3af-84d66755558f with identifier: KX34445
2026-03-30 07:49:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 86abafea-bba1-55b4-b3af-84d66755558f with identifier: KX34445 to the API
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:18:59Z',
 'fuel_type': 'petrol',
 'id': '86abafea-bba1-55b4-b3af-84d66755558f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX34445',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 157122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-26',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2010}
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KX34445%27 HTTP/1.1" 200 None
2026-03-30 07:49:19 [auto1.de] INFO: Saving data for KX34445: {'auction_closing_time': 1774883939.0, 'created_time': 1774350366.606381, 'last_price_update_time': 1774856959.891388}
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KX34445') HTTP/1.1" 204 0
2026-03-30 07:49:20 [auto1.de] INFO: Found listing with ID: FT81385
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT81385%27 HTTP/1.1" 200 None
2026-03-30 07:49:20 [auto1.de] INFO: Scrape type for FT81385: 2
2026-03-30 07:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 596802d5-e024-5dd2-b1df-80ecc31bbcfc with identifier: FT81385
2026-03-30 07:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 596802d5-e024-5dd2-b1df-80ecc31bbcfc with scrape type 2
2026-03-30 07:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 596802d5-e024-5dd2-b1df-80ecc31bbcfc with scrape type 2
2026-03-30 07:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 596802d5-e024-5dd2-b1df-80ecc31bbcfc, identifier: FT81385
2026-03-30 07:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 596802d5-e024-5dd2-b1df-80ecc31bbcfc with identifier: FT81385
2026-03-30 07:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 596802d5-e024-5dd2-b1df-80ecc31bbcfc with identifier: FT81385
2026-03-30 07:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 596802d5-e024-5dd2-b1df-80ecc31bbcfc with identifier: FT81385 to the API
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:10:27Z',
 'fuel_type': 'diesel',
 'id': '596802d5-e024-5dd2-b1df-80ecc31bbcfc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT81385',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 159298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-13',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 TDI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2016}
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT81385%27 HTTP/1.1" 200 None
2026-03-30 07:49:20 [auto1.de] INFO: Saving data for FT81385: {'auction_closing_time': 1774883427.0, 'created_time': 1774639617.447471, 'last_price_update_time': 1774856960.374012}
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT81385') HTTP/1.1" 204 0
2026-03-30 07:49:20 [auto1.de] INFO: Found listing with ID: AN93893
2026-03-30 07:49:20 [auto1.de] INFO: Found listing with ID: VL67140
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL67140%27 HTTP/1.1" 200 None
2026-03-30 07:49:20 [auto1.de] INFO: Scrape type for VL67140: 2
2026-03-30 07:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77362b27-6593-5a46-88b2-8d406803b6d7 with identifier: VL67140
2026-03-30 07:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77362b27-6593-5a46-88b2-8d406803b6d7 with scrape type 2
2026-03-30 07:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77362b27-6593-5a46-88b2-8d406803b6d7 with scrape type 2
2026-03-30 07:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77362b27-6593-5a46-88b2-8d406803b6d7, identifier: VL67140
2026-03-30 07:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77362b27-6593-5a46-88b2-8d406803b6d7 with identifier: VL67140
2026-03-30 07:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77362b27-6593-5a46-88b2-8d406803b6d7 with identifier: VL67140
2026-03-30 07:49:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77362b27-6593-5a46-88b2-8d406803b6d7 with identifier: VL67140 to the API
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:29:47Z',
 'fuel_type': 'petrol',
 'id': '77362b27-6593-5a46-88b2-8d406803b6d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL67140',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 132646,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-27',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2020}
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL67140%27 HTTP/1.1" 200 None
2026-03-30 07:49:20 [auto1.de] INFO: Saving data for VL67140: {'auction_closing_time': 1774884587.0, 'created_time': 1774639739.631609, 'last_price_update_time': 1774856960.768768}
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VL67140') HTTP/1.1" 204 0
2026-03-30 07:49:20 [auto1.de] INFO: Found listing with ID: XU92987
2026-03-30 07:49:20 [auto1.de] INFO: Found listing with ID: AM43166
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM43166%27 HTTP/1.1" 200 None
2026-03-30 07:49:20 [auto1.de] INFO: Scrape type for AM43166: 0
2026-03-30 07:49:20 [auto1.de] INFO: Found listing with ID: MX59150
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX59150%27 HTTP/1.1" 200 None
2026-03-30 07:49:20 [auto1.de] INFO: Scrape type for MX59150: 2
2026-03-30 07:49:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bad8e936-7c12-5b89-aa7f-f9afdf39be55 with identifier: MX59150
2026-03-30 07:49:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bad8e936-7c12-5b89-aa7f-f9afdf39be55 with scrape type 2
2026-03-30 07:49:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bad8e936-7c12-5b89-aa7f-f9afdf39be55 with scrape type 2
2026-03-30 07:49:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bad8e936-7c12-5b89-aa7f-f9afdf39be55, identifier: MX59150
2026-03-30 07:49:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bad8e936-7c12-5b89-aa7f-f9afdf39be55 with identifier: MX59150
2026-03-30 07:49:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bad8e936-7c12-5b89-aa7f-f9afdf39be55 with identifier: MX59150
2026-03-30 07:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bad8e936-7c12-5b89-aa7f-f9afdf39be55 with identifier: MX59150 to the API
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:17:27Z',
 'fuel_type': 'petrol',
 'id': 'bad8e936-7c12-5b89-aa7f-f9afdf39be55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX59150',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 221730,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-12',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX59150%27 HTTP/1.1" 200 None
2026-03-30 07:49:21 [auto1.de] INFO: Saving data for MX59150: {'auction_closing_time': 1774883847.0, 'created_time': 1774636949.121542, 'last_price_update_time': 1774856961.310822}
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX59150') HTTP/1.1" 204 0
2026-03-30 07:49:21 [auto1.de] INFO: Found listing with ID: SE09507
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE09507%27 HTTP/1.1" 200 None
2026-03-30 07:49:21 [auto1.de] INFO: Scrape type for SE09507: 2
2026-03-30 07:49:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with identifier: SE09507
2026-03-30 07:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with scrape type 2
2026-03-30 07:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with scrape type 2
2026-03-30 07:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 14ab2b08-9c63-54fa-a0ab-f5628df18c08, identifier: SE09507
2026-03-30 07:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with identifier: SE09507
2026-03-30 07:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with identifier: SE09507
2026-03-30 07:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 14ab2b08-9c63-54fa-a0ab-f5628df18c08 with identifier: SE09507 to the API
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 50,
 'expiration_date': '2026-03-30T15:34:11Z',
 'fuel_type': 'petrol',
 'id': '14ab2b08-9c63-54fa-a0ab-f5628df18c08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE09507',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Lupo',
 'odometer': 106053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-03-31',
 'seller_name': None,
 'title': 'Volkswagen Lupo 1.0 Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 1999}
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE09507%27 HTTP/1.1" 200 None
2026-03-30 07:49:21 [auto1.de] INFO: Saving data for SE09507: {'auction_closing_time': 1774884851.0, 'created_time': 1774552913.72616, 'last_price_update_time': 1774856961.700385}
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SE09507') HTTP/1.1" 204 0
2026-03-30 07:49:21 [auto1.de] INFO: Found listing with ID: ZY93547
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY93547%27 HTTP/1.1" 200 None
2026-03-30 07:49:21 [auto1.de] INFO: Scrape type for ZY93547: 0
2026-03-30 07:49:21 [auto1.de] INFO: Found listing with ID: MU36572
2026-03-30 07:49:21 [auto1.de] INFO: Found listing with ID: EE74949
2026-03-30 07:49:21 [auto1.de] INFO: Found listing with ID: CP27370
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP27370%27 HTTP/1.1" 200 None
2026-03-30 07:49:21 [auto1.de] INFO: Scrape type for CP27370: 2
2026-03-30 07:49:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93e2ebf7-346a-53eb-90bd-99f8528d9613 with identifier: CP27370
2026-03-30 07:49:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93e2ebf7-346a-53eb-90bd-99f8528d9613 with scrape type 2
2026-03-30 07:49:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93e2ebf7-346a-53eb-90bd-99f8528d9613 with scrape type 2
2026-03-30 07:49:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93e2ebf7-346a-53eb-90bd-99f8528d9613, identifier: CP27370
2026-03-30 07:49:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93e2ebf7-346a-53eb-90bd-99f8528d9613 with identifier: CP27370
2026-03-30 07:49:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93e2ebf7-346a-53eb-90bd-99f8528d9613 with identifier: CP27370
2026-03-30 07:49:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93e2ebf7-346a-53eb-90bd-99f8528d9613 with identifier: CP27370 to the API
2026-03-30 07:49:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:28:59Z',
 'fuel_type': 'diesel',
 'id': '93e2ebf7-346a-53eb-90bd-99f8528d9613',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP27370',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Tourer',
 'odometer': 237203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-26',
 'seller_name': None,
 'title': 'Opel Zafira Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2017}
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP27370%27 HTTP/1.1" 200 None
2026-03-30 07:49:22 [auto1.de] INFO: Saving data for CP27370: {'auction_closing_time': 1774884539.0, 'created_time': 1773382785.206724, 'last_price_update_time': 1774856962.174382}
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP27370') HTTP/1.1" 204 0
2026-03-30 07:49:22 [auto1.de] INFO: Found listing with ID: BH54290
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54290%27 HTTP/1.1" 200 None
2026-03-30 07:49:22 [auto1.de] INFO: Scrape type for BH54290: 2
2026-03-30 07:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a177c78-a34c-50a6-90d9-878cbd1c57d0 with identifier: BH54290
2026-03-30 07:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a177c78-a34c-50a6-90d9-878cbd1c57d0 with scrape type 2
2026-03-30 07:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a177c78-a34c-50a6-90d9-878cbd1c57d0 with scrape type 2
2026-03-30 07:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a177c78-a34c-50a6-90d9-878cbd1c57d0, identifier: BH54290
2026-03-30 07:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a177c78-a34c-50a6-90d9-878cbd1c57d0 with identifier: BH54290
2026-03-30 07:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a177c78-a34c-50a6-90d9-878cbd1c57d0 with identifier: BH54290
2026-03-30 07:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a177c78-a34c-50a6-90d9-878cbd1c57d0 with identifier: BH54290 to the API
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:02:38Z',
 'fuel_type': 'petrol',
 'id': '7a177c78-a34c-50a6-90d9-878cbd1c57d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH54290',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 135984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2014}
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH54290%27 HTTP/1.1" 200 None
2026-03-30 07:49:22 [auto1.de] INFO: Saving data for BH54290: {'auction_closing_time': 1774882958.0, 'created_time': 1774034784.712969, 'last_price_update_time': 1774856962.674981}
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH54290') HTTP/1.1" 204 0
2026-03-30 07:49:22 [auto1.de] INFO: Found listing with ID: AP20693
2026-03-30 07:49:22 [auto1.de] INFO: Found listing with ID: YT56915
2026-03-30 07:49:22 [auto1.de] INFO: Found listing with ID: UK49641
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK49641%27 HTTP/1.1" 200 None
2026-03-30 07:49:22 [auto1.de] INFO: Scrape type for UK49641: 0
2026-03-30 07:49:22 [auto1.de] INFO: Found listing with ID: VX05177
2026-03-30 07:49:22 [auto1.de] INFO: Found listing with ID: HZ93598
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ93598%27 HTTP/1.1" 200 None
2026-03-30 07:49:22 [auto1.de] INFO: Scrape type for HZ93598: 2
2026-03-30 07:49:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 162b2297-8d83-5ef8-9120-e5908819a165 with identifier: HZ93598
2026-03-30 07:49:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 162b2297-8d83-5ef8-9120-e5908819a165 with scrape type 2
2026-03-30 07:49:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 162b2297-8d83-5ef8-9120-e5908819a165 with scrape type 2
2026-03-30 07:49:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 162b2297-8d83-5ef8-9120-e5908819a165, identifier: HZ93598
2026-03-30 07:49:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:49:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 162b2297-8d83-5ef8-9120-e5908819a165 with identifier: HZ93598
2026-03-30 07:49:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 162b2297-8d83-5ef8-9120-e5908819a165 with identifier: HZ93598
2026-03-30 07:49:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 162b2297-8d83-5ef8-9120-e5908819a165 with identifier: HZ93598 to the API
2026-03-30 07:49:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:04:31Z',
 'fuel_type': 'petrol',
 'id': '162b2297-8d83-5ef8-9120-e5908819a165',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ93598',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 123810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-29',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Clever',
 'transmission': 'manual',
 'trim': 'Clever',
 'year': 2018}
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ93598%27 HTTP/1.1" 200 None
2026-03-30 07:49:23 [auto1.de] INFO: Saving data for HZ93598: {'auction_closing_time': 1774883071.0, 'created_time': 1774031869.53448, 'last_price_update_time': 1774856963.155599}
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HZ93598') HTTP/1.1" 204 0
2026-03-30 07:49:23 [auto1.de] INFO: Found listing with ID: ZK07522
2026-03-30 07:49:23 [auto1.de] INFO: Found listing with ID: DL82245
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL82245%27 HTTP/1.1" 200 None
2026-03-30 07:49:23 [auto1.de] INFO: Scrape type for DL82245: 2
2026-03-30 07:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 627e8bd3-176a-569e-adbd-787bfe35f41d with identifier: DL82245
2026-03-30 07:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 627e8bd3-176a-569e-adbd-787bfe35f41d with scrape type 2
2026-03-30 07:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 627e8bd3-176a-569e-adbd-787bfe35f41d with scrape type 2
2026-03-30 07:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 627e8bd3-176a-569e-adbd-787bfe35f41d, identifier: DL82245
2026-03-30 07:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 627e8bd3-176a-569e-adbd-787bfe35f41d with identifier: DL82245
2026-03-30 07:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 627e8bd3-176a-569e-adbd-787bfe35f41d with identifier: DL82245
2026-03-30 07:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 627e8bd3-176a-569e-adbd-787bfe35f41d with identifier: DL82245 to the API
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:59:46Z',
 'fuel_type': 'petrol',
 'id': '627e8bd3-176a-569e-adbd-787bfe35f41d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL82245',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 129907,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-20',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TSI Style 4x4',
 'transmission': 'automatic',
 'trim': 'Style 4x4',
 'year': 2017}
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL82245%27 HTTP/1.1" 200 None
2026-03-30 07:49:23 [auto1.de] INFO: Saving data for DL82245: {'auction_closing_time': 1774886386.0, 'created_time': 1774552872.146059, 'last_price_update_time': 1774856963.587958}
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DL82245') HTTP/1.1" 204 0
2026-03-30 07:49:23 [auto1.de] INFO: Found listing with ID: WT01639
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT01639%27 HTTP/1.1" 200 None
2026-03-30 07:49:23 [auto1.de] INFO: Scrape type for WT01639: 2
2026-03-30 07:49:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 739b0184-0381-5268-b950-5de1b5e0508a with identifier: WT01639
2026-03-30 07:49:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 739b0184-0381-5268-b950-5de1b5e0508a with scrape type 2
2026-03-30 07:49:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 739b0184-0381-5268-b950-5de1b5e0508a with scrape type 2
2026-03-30 07:49:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 739b0184-0381-5268-b950-5de1b5e0508a, identifier: WT01639
2026-03-30 07:49:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 739b0184-0381-5268-b950-5de1b5e0508a with identifier: WT01639
2026-03-30 07:49:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 739b0184-0381-5268-b950-5de1b5e0508a with identifier: WT01639
2026-03-30 07:49:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 739b0184-0381-5268-b950-5de1b5e0508a with identifier: WT01639 to the API
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 309,
 'expiration_date': '2026-03-30T15:11:08Z',
 'fuel_type': 'hybrid',
 'id': '739b0184-0381-5268-b950-5de1b5e0508a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WT01639',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 83833,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-09',
 'seller_name': None,
 'title': 'Land Rover Evoque P300e Hybrid R-Dynamic SE',
 'transmission': 'automatic',
 'trim': 'R-Dynamic SE',
 'year': 2021}
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT01639%27 HTTP/1.1" 200 None
2026-03-30 07:49:24 [auto1.de] INFO: Saving data for WT01639: {'auction_closing_time': 1774883468.0, 'created_time': 1774640040.591811, 'last_price_update_time': 1774856964.044198}
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WT01639') HTTP/1.1" 204 0
2026-03-30 07:49:24 [auto1.de] INFO: Channel: 24h | Page: 157 | totalHits: 8408 | hits on page: 40
2026-03-30 07:49:24 [auto1.de] INFO: Found listing with ID: UG67799
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UG67799%27 HTTP/1.1" 200 None
2026-03-30 07:49:24 [auto1.de] INFO: Scrape type for UG67799: 0
2026-03-30 07:49:24 [auto1.de] INFO: Found listing with ID: CW65482
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW65482%27 HTTP/1.1" 200 None
2026-03-30 07:49:24 [auto1.de] INFO: Scrape type for CW65482: 2
2026-03-30 07:49:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b98869f1-18ac-572f-bb73-485f7bcb5b63 with identifier: CW65482
2026-03-30 07:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b98869f1-18ac-572f-bb73-485f7bcb5b63 with scrape type 2
2026-03-30 07:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b98869f1-18ac-572f-bb73-485f7bcb5b63 with scrape type 2
2026-03-30 07:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b98869f1-18ac-572f-bb73-485f7bcb5b63, identifier: CW65482
2026-03-30 07:49:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b98869f1-18ac-572f-bb73-485f7bcb5b63 with identifier: CW65482
2026-03-30 07:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b98869f1-18ac-572f-bb73-485f7bcb5b63 with identifier: CW65482
2026-03-30 07:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b98869f1-18ac-572f-bb73-485f7bcb5b63 with identifier: CW65482 to the API
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:47:57Z',
 'fuel_type': 'petrol',
 'id': 'b98869f1-18ac-572f-bb73-485f7bcb5b63',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CW65482',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 83892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-26',
 'seller_name': None,
 'title': 'Peugeot 206 1.1 Grand Filou',
 'transmission': 'manual',
 'trim': 'Grand Filou',
 'year': 2003}
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW65482%27 HTTP/1.1" 200 None
2026-03-30 07:49:24 [auto1.de] INFO: Saving data for CW65482: {'auction_closing_time': 1774885677.0, 'created_time': 1774639211.657968, 'last_price_update_time': 1774856964.497674}
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CW65482') HTTP/1.1" 204 0
2026-03-30 07:49:24 [auto1.de] INFO: Found listing with ID: JL91815
2026-03-30 07:49:24 [auto1.de] INFO: Found listing with ID: US61717
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US61717%27 HTTP/1.1" 200 None
2026-03-30 07:49:24 [auto1.de] INFO: Scrape type for US61717: 2
2026-03-30 07:49:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c790e87d-0fad-57d4-8d7c-01ea4f423dee with identifier: US61717
2026-03-30 07:49:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c790e87d-0fad-57d4-8d7c-01ea4f423dee with scrape type 2
2026-03-30 07:49:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c790e87d-0fad-57d4-8d7c-01ea4f423dee with scrape type 2
2026-03-30 07:49:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c790e87d-0fad-57d4-8d7c-01ea4f423dee, identifier: US61717
2026-03-30 07:49:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c790e87d-0fad-57d4-8d7c-01ea4f423dee with identifier: US61717
2026-03-30 07:49:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c790e87d-0fad-57d4-8d7c-01ea4f423dee with identifier: US61717
2026-03-30 07:49:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c790e87d-0fad-57d4-8d7c-01ea4f423dee with identifier: US61717 to the API
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:47:30Z',
 'fuel_type': 'petrol',
 'id': 'c790e87d-0fad-57d4-8d7c-01ea4f423dee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/US61717',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 115173,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-30',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2016}
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27US61717%27 HTTP/1.1" 200 None
2026-03-30 07:49:25 [auto1.de] INFO: Saving data for US61717: {'auction_closing_time': 1774885650.0, 'created_time': 1774638989.525066, 'last_price_update_time': 1774856965.019027}
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='US61717') HTTP/1.1" 204 0
2026-03-30 07:49:25 [auto1.de] INFO: Found listing with ID: WF94997
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF94997%27 HTTP/1.1" 200 None
2026-03-30 07:49:25 [auto1.de] INFO: Scrape type for WF94997: 0
2026-03-30 07:49:25 [auto1.de] INFO: Found listing with ID: SG08144
2026-03-30 07:49:25 [auto1.de] INFO: Found listing with ID: YF55621
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF55621%27 HTTP/1.1" 200 None
2026-03-30 07:49:25 [auto1.de] INFO: Scrape type for YF55621: 0
2026-03-30 07:49:25 [auto1.de] INFO: Found listing with ID: UJ63993
2026-03-30 07:49:25 [auto1.de] INFO: Found listing with ID: MU16772
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU16772%27 HTTP/1.1" 200 None
2026-03-30 07:49:25 [auto1.de] INFO: Scrape type for MU16772: 2
2026-03-30 07:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 676714cb-eb5d-5123-8009-16135702b9b6 with identifier: MU16772
2026-03-30 07:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 676714cb-eb5d-5123-8009-16135702b9b6 with scrape type 2
2026-03-30 07:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 676714cb-eb5d-5123-8009-16135702b9b6 with scrape type 2
2026-03-30 07:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 676714cb-eb5d-5123-8009-16135702b9b6, identifier: MU16772
2026-03-30 07:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 676714cb-eb5d-5123-8009-16135702b9b6 with identifier: MU16772
2026-03-30 07:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 676714cb-eb5d-5123-8009-16135702b9b6 with identifier: MU16772
2026-03-30 07:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 676714cb-eb5d-5123-8009-16135702b9b6 with identifier: MU16772 to the API
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:19:26Z',
 'fuel_type': 'diesel',
 'id': '676714cb-eb5d-5123-8009-16135702b9b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU16772',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 404420,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-31',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU16772%27 HTTP/1.1" 200 None
2026-03-30 07:49:25 [auto1.de] INFO: Saving data for MU16772: {'auction_closing_time': 1774883966.0, 'created_time': 1774071331.387067, 'last_price_update_time': 1774856965.467562}
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU16772') HTTP/1.1" 204 0
2026-03-30 07:49:25 [auto1.de] INFO: Found listing with ID: JV63052
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV63052%27 HTTP/1.1" 200 None
2026-03-30 07:49:25 [auto1.de] INFO: Scrape type for JV63052: 0
2026-03-30 07:49:25 [auto1.de] INFO: Found listing with ID: XP10598
2026-03-30 07:49:25 [auto1.de] INFO: Found listing with ID: UE48673
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE48673%27 HTTP/1.1" 200 None
2026-03-30 07:49:25 [auto1.de] INFO: Scrape type for UE48673: 2
2026-03-30 07:49:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62900634-691a-5034-97b2-d283f72e1a90 with identifier: UE48673
2026-03-30 07:49:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62900634-691a-5034-97b2-d283f72e1a90 with scrape type 2
2026-03-30 07:49:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62900634-691a-5034-97b2-d283f72e1a90 with scrape type 2
2026-03-30 07:49:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 62900634-691a-5034-97b2-d283f72e1a90, identifier: UE48673
2026-03-30 07:49:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 62900634-691a-5034-97b2-d283f72e1a90 with identifier: UE48673
2026-03-30 07:49:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 62900634-691a-5034-97b2-d283f72e1a90 with identifier: UE48673
2026-03-30 07:49:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 62900634-691a-5034-97b2-d283f72e1a90 with identifier: UE48673 to the API
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:49:22Z',
 'fuel_type': 'petrol',
 'id': '62900634-691a-5034-97b2-d283f72e1a90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE48673',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 90494,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-30',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 YAHOO!',
 'transmission': 'manual',
 'trim': 'YAHOO!',
 'year': 2011}
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE48673%27 HTTP/1.1" 200 None
2026-03-30 07:49:26 [auto1.de] INFO: Saving data for UE48673: {'auction_closing_time': 1774885762.0, 'created_time': 1774638409.192034, 'last_price_update_time': 1774856966.170865}
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE48673') HTTP/1.1" 204 0
2026-03-30 07:49:26 [auto1.de] INFO: Found listing with ID: PJ27093
2026-03-30 07:49:26 [auto1.de] INFO: Found listing with ID: WE87101
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87101%27 HTTP/1.1" 200 None
2026-03-30 07:49:26 [auto1.de] INFO: Scrape type for WE87101: 0
2026-03-30 07:49:26 [auto1.de] INFO: Found listing with ID: SG14649
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14649%27 HTTP/1.1" 200 None
2026-03-30 07:49:26 [auto1.de] INFO: Scrape type for SG14649: 0
2026-03-30 07:49:26 [auto1.de] INFO: Found listing with ID: FM49388
2026-03-30 07:49:26 [auto1.de] INFO: Found listing with ID: AM79611
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM79611%27 HTTP/1.1" 200 None
2026-03-30 07:49:26 [auto1.de] INFO: Scrape type for AM79611: 2
2026-03-30 07:49:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c93512a-9e8b-5be3-8763-2eb2d1956f7f with identifier: AM79611
2026-03-30 07:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c93512a-9e8b-5be3-8763-2eb2d1956f7f with scrape type 2
2026-03-30 07:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c93512a-9e8b-5be3-8763-2eb2d1956f7f with scrape type 2
2026-03-30 07:49:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c93512a-9e8b-5be3-8763-2eb2d1956f7f, identifier: AM79611
2026-03-30 07:49:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c93512a-9e8b-5be3-8763-2eb2d1956f7f with identifier: AM79611
2026-03-30 07:49:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c93512a-9e8b-5be3-8763-2eb2d1956f7f with identifier: AM79611
2026-03-30 07:49:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c93512a-9e8b-5be3-8763-2eb2d1956f7f with identifier: AM79611 to the API
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:54:40Z',
 'fuel_type': 'petrol',
 'id': '4c93512a-9e8b-5be3-8763-2eb2d1956f7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AM79611',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 104840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Smart fortwo 0.9 Turbo Basis passion',
 'transmission': 'manual',
 'trim': 'Basis passion',
 'year': 2016}
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AM79611%27 HTTP/1.1" 200 None
2026-03-30 07:49:26 [auto1.de] INFO: Saving data for AM79611: {'auction_closing_time': 1774886080.0, 'created_time': 1774676128.690153, 'last_price_update_time': 1774856966.59615}
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AM79611') HTTP/1.1" 204 0
2026-03-30 07:49:26 [auto1.de] INFO: Found listing with ID: JE71066
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE71066%27 HTTP/1.1" 200 None
2026-03-30 07:49:26 [auto1.de] INFO: Scrape type for JE71066: 0
2026-03-30 07:49:26 [auto1.de] INFO: Found listing with ID: JX17185
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX17185%27 HTTP/1.1" 200 None
2026-03-30 07:49:26 [auto1.de] INFO: Scrape type for JX17185: 0
2026-03-30 07:49:26 [auto1.de] INFO: Found listing with ID: DA76775
2026-03-30 07:49:26 [auto1.de] INFO: Found listing with ID: HW43883
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW43883%27 HTTP/1.1" 200 None
2026-03-30 07:49:26 [auto1.de] INFO: Scrape type for HW43883: 2
2026-03-30 07:49:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43c3f101-d167-5039-8a7c-c2a991e5a94d with identifier: HW43883
2026-03-30 07:49:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43c3f101-d167-5039-8a7c-c2a991e5a94d with scrape type 2
2026-03-30 07:49:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43c3f101-d167-5039-8a7c-c2a991e5a94d with scrape type 2
2026-03-30 07:49:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43c3f101-d167-5039-8a7c-c2a991e5a94d, identifier: HW43883
2026-03-30 07:49:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43c3f101-d167-5039-8a7c-c2a991e5a94d with identifier: HW43883
2026-03-30 07:49:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43c3f101-d167-5039-8a7c-c2a991e5a94d with identifier: HW43883
2026-03-30 07:49:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43c3f101-d167-5039-8a7c-c2a991e5a94d with identifier: HW43883 to the API
2026-03-30 07:49:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:03:05Z',
 'fuel_type': 'petrol',
 'id': '43c3f101-d167-5039-8a7c-c2a991e5a94d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW43883',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 237445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-19',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.8 TFSI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2007}
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW43883%27 HTTP/1.1" 200 None
2026-03-30 07:49:27 [auto1.de] INFO: Saving data for HW43883: {'auction_closing_time': 1774882985.0, 'created_time': 1774552994.47203, 'last_price_update_time': 1774856967.119422}
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW43883') HTTP/1.1" 204 0
2026-03-30 07:49:27 [auto1.de] INFO: Found listing with ID: EK35927
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK35927%27 HTTP/1.1" 200 None
2026-03-30 07:49:27 [auto1.de] INFO: Scrape type for EK35927: 0
2026-03-30 07:49:27 [auto1.de] INFO: Found listing with ID: DV40482
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV40482%27 HTTP/1.1" 200 None
2026-03-30 07:49:27 [auto1.de] INFO: Scrape type for DV40482: 0
2026-03-30 07:49:27 [auto1.de] INFO: Found listing with ID: HT48359
2026-03-30 07:49:27 [auto1.de] INFO: Found listing with ID: BH17233
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH17233%27 HTTP/1.1" 200 None
2026-03-30 07:49:27 [auto1.de] INFO: Scrape type for BH17233: 2
2026-03-30 07:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9107a17-1148-5185-b3ed-1c11371fb824 with identifier: BH17233
2026-03-30 07:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9107a17-1148-5185-b3ed-1c11371fb824 with scrape type 2
2026-03-30 07:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9107a17-1148-5185-b3ed-1c11371fb824 with scrape type 2
2026-03-30 07:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b9107a17-1148-5185-b3ed-1c11371fb824, identifier: BH17233
2026-03-30 07:49:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b9107a17-1148-5185-b3ed-1c11371fb824 with identifier: BH17233
2026-03-30 07:49:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b9107a17-1148-5185-b3ed-1c11371fb824 with identifier: BH17233
2026-03-30 07:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b9107a17-1148-5185-b3ed-1c11371fb824 with identifier: BH17233 to the API
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:37:41Z',
 'fuel_type': 'petrol',
 'id': 'b9107a17-1148-5185-b3ed-1c11371fb824',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH17233',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse Limousine',
 'odometer': 44307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-14',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse Limousine A 200 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH17233%27 HTTP/1.1" 200 None
2026-03-30 07:49:27 [auto1.de] INFO: Saving data for BH17233: {'auction_closing_time': 1774885061.0, 'created_time': 1774639788.859018, 'last_price_update_time': 1774856967.562981}
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH17233') HTTP/1.1" 204 0
2026-03-30 07:49:27 [auto1.de] INFO: Found listing with ID: ZC42699
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZC42699%27 HTTP/1.1" 200 None
2026-03-30 07:49:27 [auto1.de] INFO: Scrape type for ZC42699: 0
2026-03-30 07:49:27 [auto1.de] INFO: Found listing with ID: HU37680
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU37680%27 HTTP/1.1" 200 None
2026-03-30 07:49:27 [auto1.de] INFO: Scrape type for HU37680: 2
2026-03-30 07:49:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27cf1579-c4c1-5ff1-9b45-ee6a1d505cf7 with identifier: HU37680
2026-03-30 07:49:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27cf1579-c4c1-5ff1-9b45-ee6a1d505cf7 with scrape type 2
2026-03-30 07:49:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27cf1579-c4c1-5ff1-9b45-ee6a1d505cf7 with scrape type 2
2026-03-30 07:49:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 27cf1579-c4c1-5ff1-9b45-ee6a1d505cf7, identifier: HU37680
2026-03-30 07:49:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:49:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 27cf1579-c4c1-5ff1-9b45-ee6a1d505cf7 with identifier: HU37680
2026-03-30 07:49:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 27cf1579-c4c1-5ff1-9b45-ee6a1d505cf7 with identifier: HU37680
2026-03-30 07:49:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 27cf1579-c4c1-5ff1-9b45-ee6a1d505cf7 with identifier: HU37680 to the API
2026-03-30 07:49:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:41:08Z',
 'fuel_type': 'petrol',
 'id': '27cf1579-c4c1-5ff1-9b45-ee6a1d505cf7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU37680',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 153133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-03',
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2017}
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU37680%27 HTTP/1.1" 200 None
2026-03-30 07:49:28 [auto1.de] INFO: Saving data for HU37680: {'auction_closing_time': 1774885268.0, 'created_time': 1774639747.040548, 'last_price_update_time': 1774856968.685647}
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU37680') HTTP/1.1" 204 0
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: TB42941
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB42941%27 HTTP/1.1" 200 None
2026-03-30 07:49:28 [auto1.de] INFO: Scrape type for TB42941: 0
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: ET45765
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: XG24427
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XG24427%27 HTTP/1.1" 200 None
2026-03-30 07:49:28 [auto1.de] INFO: Scrape type for XG24427: 0
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: RZ86023
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: RX80532
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: NF75522
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF75522%27 HTTP/1.1" 200 None
2026-03-30 07:49:28 [auto1.de] INFO: Scrape type for NF75522: 0
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: VK80269
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK80269%27 HTTP/1.1" 200 None
2026-03-30 07:49:28 [auto1.de] INFO: Scrape type for VK80269: 0
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: AE19293
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE19293%27 HTTP/1.1" 200 None
2026-03-30 07:49:28 [auto1.de] INFO: Scrape type for AE19293: 0
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: SB35470
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: DM49539
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM49539%27 HTTP/1.1" 200 None
2026-03-30 07:49:28 [auto1.de] INFO: Scrape type for DM49539: 0
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: ZU82600
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU82600%27 HTTP/1.1" 200 None
2026-03-30 07:49:28 [auto1.de] INFO: Scrape type for ZU82600: 0
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: YD09657
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-30 07:49:28 [auto1.de] INFO: Channel: 24h | Page: 158 | totalHits: 8409 | hits on page: 40
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: VN06043
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: FD74109
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: XS48010
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: UF21072
2026-03-30 07:49:28 [auto1.de] INFO: Found listing with ID: WY85656
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY85656%27 HTTP/1.1" 200 None
2026-03-30 07:49:28 [auto1.de] INFO: Scrape type for WY85656: 2
2026-03-30 07:49:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afb4e8b2-2ea0-5848-8131-efc446cb280d with identifier: WY85656
2026-03-30 07:49:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afb4e8b2-2ea0-5848-8131-efc446cb280d with scrape type 2
2026-03-30 07:49:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afb4e8b2-2ea0-5848-8131-efc446cb280d with scrape type 2
2026-03-30 07:49:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afb4e8b2-2ea0-5848-8131-efc446cb280d, identifier: WY85656
2026-03-30 07:49:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afb4e8b2-2ea0-5848-8131-efc446cb280d with identifier: WY85656
2026-03-30 07:49:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afb4e8b2-2ea0-5848-8131-efc446cb280d with identifier: WY85656
2026-03-30 07:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afb4e8b2-2ea0-5848-8131-efc446cb280d with identifier: WY85656 to the API
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-30T15:03:14Z',
 'fuel_type': 'diesel',
 'id': 'afb4e8b2-2ea0-5848-8131-efc446cb280d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY85656',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 285929,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-26',
 'seller_name': None,
 'title': 'BMW 3er 330d GT',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY85656%27 HTTP/1.1" 200 None
2026-03-30 07:49:29 [auto1.de] INFO: Saving data for WY85656: {'auction_closing_time': 1774882994.0, 'created_time': 1774034277.10962, 'last_price_update_time': 1774856969.204833}
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY85656') HTTP/1.1" 204 0
2026-03-30 07:49:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:49:29 [auto1.de] INFO: Found listing with ID: BP61239
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP61239%27 HTTP/1.1" 200 None
2026-03-30 07:49:29 [auto1.de] INFO: Scrape type for BP61239: 2
2026-03-30 07:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c232ff43-8809-562c-b40c-0338dae2ffc7 with identifier: BP61239
2026-03-30 07:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c232ff43-8809-562c-b40c-0338dae2ffc7 with scrape type 2
2026-03-30 07:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c232ff43-8809-562c-b40c-0338dae2ffc7 with scrape type 2
2026-03-30 07:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c232ff43-8809-562c-b40c-0338dae2ffc7, identifier: BP61239
2026-03-30 07:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c232ff43-8809-562c-b40c-0338dae2ffc7 with identifier: BP61239
2026-03-30 07:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c232ff43-8809-562c-b40c-0338dae2ffc7 with identifier: BP61239
2026-03-30 07:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c232ff43-8809-562c-b40c-0338dae2ffc7 with identifier: BP61239 to the API
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:11:43Z',
 'fuel_type': 'diesel',
 'id': 'c232ff43-8809-562c-b40c-0338dae2ffc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP61239',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 206544,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-14',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP61239%27 HTTP/1.1" 200 None
2026-03-30 07:49:29 [auto1.de] INFO: Saving data for BP61239: {'auction_closing_time': 1774883503.0, 'created_time': 1774639985.321267, 'last_price_update_time': 1774856969.712192}
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BP61239') HTTP/1.1" 204 0
2026-03-30 07:49:29 [auto1.de] INFO: Found listing with ID: CC98998
2026-03-30 07:49:29 [auto1.de] INFO: Found listing with ID: XK50877
2026-03-30 07:49:29 [auto1.de] INFO: Found listing with ID: TK89149
2026-03-30 07:49:29 [auto1.de] INFO: Found listing with ID: DS59487
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59487%27 HTTP/1.1" 200 None
2026-03-30 07:49:29 [auto1.de] INFO: Scrape type for DS59487: 2
2026-03-30 07:49:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e32d810-2d93-5885-ab75-6b6df5975b43 with identifier: DS59487
2026-03-30 07:49:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e32d810-2d93-5885-ab75-6b6df5975b43 with scrape type 2
2026-03-30 07:49:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e32d810-2d93-5885-ab75-6b6df5975b43 with scrape type 2
2026-03-30 07:49:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7e32d810-2d93-5885-ab75-6b6df5975b43, identifier: DS59487
2026-03-30 07:49:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7e32d810-2d93-5885-ab75-6b6df5975b43 with identifier: DS59487
2026-03-30 07:49:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7e32d810-2d93-5885-ab75-6b6df5975b43 with identifier: DS59487
2026-03-30 07:49:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7e32d810-2d93-5885-ab75-6b6df5975b43 with identifier: DS59487 to the API
2026-03-30 07:49:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:41:34Z',
 'fuel_type': 'diesel',
 'id': '7e32d810-2d93-5885-ab75-6b6df5975b43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS59487',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 150524,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-16',
 'seller_name': None,
 'title': 'Ford Grand C-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS59487%27 HTTP/1.1" 200 None
2026-03-30 07:49:30 [auto1.de] INFO: Saving data for DS59487: {'auction_closing_time': 1774885294.0, 'created_time': 1773946849.334871, 'last_price_update_time': 1774856970.121469}
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS59487') HTTP/1.1" 204 0
2026-03-30 07:49:30 [auto1.de] INFO: Found listing with ID: TA61960
2026-03-30 07:49:30 [auto1.de] INFO: Found listing with ID: BZ01431
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ01431%27 HTTP/1.1" 200 None
2026-03-30 07:49:30 [auto1.de] INFO: Scrape type for BZ01431: 2
2026-03-30 07:49:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6219b841-33e4-5b8f-8525-7745e6943b16 with identifier: BZ01431
2026-03-30 07:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6219b841-33e4-5b8f-8525-7745e6943b16 with scrape type 2
2026-03-30 07:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6219b841-33e4-5b8f-8525-7745e6943b16 with scrape type 2
2026-03-30 07:49:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6219b841-33e4-5b8f-8525-7745e6943b16, identifier: BZ01431
2026-03-30 07:49:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6219b841-33e4-5b8f-8525-7745e6943b16 with identifier: BZ01431
2026-03-30 07:49:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6219b841-33e4-5b8f-8525-7745e6943b16 with identifier: BZ01431
2026-03-30 07:49:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6219b841-33e4-5b8f-8525-7745e6943b16 with identifier: BZ01431 to the API
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'beige',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:06:00Z',
 'fuel_type': 'diesel',
 'id': '6219b841-33e4-5b8f-8525-7745e6943b16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ01431',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 452898,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-14',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Maxi Comfortline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Maxi Comfortline BlueMotion',
 'year': 2016}
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ01431%27 HTTP/1.1" 200 None
2026-03-30 07:49:30 [auto1.de] INFO: Saving data for BZ01431: {'auction_closing_time': 1774883160.0, 'created_time': 1774637064.204973, 'last_price_update_time': 1774856970.567196}
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ01431') HTTP/1.1" 204 0
2026-03-30 07:49:30 [auto1.de] INFO: Found listing with ID: HE00518
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00518%27 HTTP/1.1" 200 None
2026-03-30 07:49:30 [auto1.de] INFO: Scrape type for HE00518: 2
2026-03-30 07:49:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2fce133-f8c9-5bdf-b9bb-c6f904767c96 with identifier: HE00518
2026-03-30 07:49:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2fce133-f8c9-5bdf-b9bb-c6f904767c96 with scrape type 2
2026-03-30 07:49:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a2fce133-f8c9-5bdf-b9bb-c6f904767c96 with scrape type 2
2026-03-30 07:49:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a2fce133-f8c9-5bdf-b9bb-c6f904767c96, identifier: HE00518
2026-03-30 07:49:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a2fce133-f8c9-5bdf-b9bb-c6f904767c96 with identifier: HE00518
2026-03-30 07:49:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a2fce133-f8c9-5bdf-b9bb-c6f904767c96 with identifier: HE00518
2026-03-30 07:49:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a2fce133-f8c9-5bdf-b9bb-c6f904767c96 with identifier: HE00518 to the API
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:46:12Z',
 'fuel_type': 'petrol',
 'id': 'a2fce133-f8c9-5bdf-b9bb-c6f904767c96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE00518',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 95782,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-28',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2011}
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE00518%27 HTTP/1.1" 200 None
2026-03-30 07:49:30 [auto1.de] INFO: Saving data for HE00518: {'auction_closing_time': 1774885572.0, 'created_time': 1774034530.894306, 'last_price_update_time': 1774856970.978883}
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE00518') HTTP/1.1" 204 0
2026-03-30 07:49:30 [auto1.de] INFO: Found listing with ID: FV41920
2026-03-30 07:49:30 [auto1.de] INFO: Found listing with ID: LH51780
2026-03-30 07:49:30 [auto1.de] INFO: Found listing with ID: UX47002
2026-03-30 07:49:30 [auto1.de] INFO: Found listing with ID: XP96351
2026-03-30 07:49:30 [auto1.de] INFO: Found listing with ID: TM66386
2026-03-30 07:49:30 [auto1.de] INFO: Found listing with ID: AV69297
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV69297%27 HTTP/1.1" 200 None
2026-03-30 07:49:31 [auto1.de] INFO: Scrape type for AV69297: 2
2026-03-30 07:49:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2bdddb9-fbbc-5364-a9dc-07dc648a7d5e with identifier: AV69297
2026-03-30 07:49:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2bdddb9-fbbc-5364-a9dc-07dc648a7d5e with scrape type 2
2026-03-30 07:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2bdddb9-fbbc-5364-a9dc-07dc648a7d5e with scrape type 2
2026-03-30 07:49:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2bdddb9-fbbc-5364-a9dc-07dc648a7d5e, identifier: AV69297
2026-03-30 07:49:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2bdddb9-fbbc-5364-a9dc-07dc648a7d5e with identifier: AV69297
2026-03-30 07:49:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2bdddb9-fbbc-5364-a9dc-07dc648a7d5e with identifier: AV69297
2026-03-30 07:49:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2bdddb9-fbbc-5364-a9dc-07dc648a7d5e with identifier: AV69297 to the API
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:45:04Z',
 'fuel_type': 'diesel',
 'id': 'b2bdddb9-fbbc-5364-a9dc-07dc648a7d5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV69297',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 286321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-04',
 'seller_name': None,
 'title': 'Skoda Fabia 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AV69297%27 HTTP/1.1" 200 None
2026-03-30 07:49:31 [auto1.de] INFO: Saving data for AV69297: {'auction_closing_time': 1774885504.0, 'created_time': 1774639638.041559, 'last_price_update_time': 1774856971.795903}
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AV69297') HTTP/1.1" 204 0
2026-03-30 07:49:31 [auto1.de] INFO: Found listing with ID: WP15063
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP15063%27 HTTP/1.1" 200 None
2026-03-30 07:49:31 [auto1.de] INFO: Scrape type for WP15063: 0
2026-03-30 07:49:31 [auto1.de] INFO: Found listing with ID: MV92547
2026-03-30 07:49:31 [auto1.de] INFO: Found listing with ID: WL10604
2026-03-30 07:49:31 [auto1.de] INFO: Found listing with ID: LA57205
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA57205%27 HTTP/1.1" 200 None
2026-03-30 07:49:31 [auto1.de] INFO: Scrape type for LA57205: 2
2026-03-30 07:49:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 624fb5d9-1b22-56dd-889b-3b95f055b909 with identifier: LA57205
2026-03-30 07:49:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 624fb5d9-1b22-56dd-889b-3b95f055b909 with scrape type 2
2026-03-30 07:49:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 624fb5d9-1b22-56dd-889b-3b95f055b909 with scrape type 2
2026-03-30 07:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 624fb5d9-1b22-56dd-889b-3b95f055b909, identifier: LA57205
2026-03-30 07:49:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 624fb5d9-1b22-56dd-889b-3b95f055b909 with identifier: LA57205
2026-03-30 07:49:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 624fb5d9-1b22-56dd-889b-3b95f055b909 with identifier: LA57205
2026-03-30 07:49:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 624fb5d9-1b22-56dd-889b-3b95f055b909 with identifier: LA57205 to the API
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:47:48Z',
 'fuel_type': 'diesel',
 'id': '624fb5d9-1b22-56dd-889b-3b95f055b909',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LA57205',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 178698,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-28',
 'seller_name': None,
 'title': 'Audi A4 2.7 V6 TDI Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA57205%27 HTTP/1.1" 200 None
2026-03-30 07:49:32 [auto1.de] INFO: Saving data for LA57205: {'auction_closing_time': 1774885668.0, 'created_time': 1774550366.575641, 'last_price_update_time': 1774856972.325403}
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LA57205') HTTP/1.1" 204 0
2026-03-30 07:49:32 [auto1.de] INFO: Found listing with ID: JU77482
2026-03-30 07:49:32 [auto1.de] INFO: Found listing with ID: SZ10404
2026-03-30 07:49:32 [auto1.de] INFO: Found listing with ID: PX47030
2026-03-30 07:49:32 [auto1.de] INFO: Found listing with ID: YP93259
2026-03-30 07:49:32 [auto1.de] INFO: Found listing with ID: WE30814
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE30814%27 HTTP/1.1" 200 None
2026-03-30 07:49:32 [auto1.de] INFO: Scrape type for WE30814: 2
2026-03-30 07:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with identifier: WE30814
2026-03-30 07:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with scrape type 2
2026-03-30 07:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with scrape type 2
2026-03-30 07:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17033710-d847-5cf8-bb1b-a9fef1a5eeb8, identifier: WE30814
2026-03-30 07:49:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with identifier: WE30814
2026-03-30 07:49:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with identifier: WE30814
2026-03-30 07:49:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17033710-d847-5cf8-bb1b-a9fef1a5eeb8 with identifier: WE30814 to the API
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:07:52Z',
 'fuel_type': 'petrol',
 'id': '17033710-d847-5cf8-bb1b-a9fef1a5eeb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE30814',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 164117,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-07-15',
 'seller_name': None,
 'title': 'Audi A4 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2001}
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE30814%27 HTTP/1.1" 200 None
2026-03-30 07:49:32 [auto1.de] INFO: Saving data for WE30814: {'auction_closing_time': 1774883272.0, 'created_time': 1774676131.403331, 'last_price_update_time': 1774856972.749373}
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE30814') HTTP/1.1" 204 0
2026-03-30 07:49:32 [auto1.de] INFO: Found listing with ID: KR84974
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR84974%27 HTTP/1.1" 200 None
2026-03-30 07:49:32 [auto1.de] INFO: Scrape type for KR84974: 2
2026-03-30 07:49:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1f67b7a-b325-504c-aa2e-7665c428bba2 with identifier: KR84974
2026-03-30 07:49:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1f67b7a-b325-504c-aa2e-7665c428bba2 with scrape type 2
2026-03-30 07:49:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1f67b7a-b325-504c-aa2e-7665c428bba2 with scrape type 2
2026-03-30 07:49:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b1f67b7a-b325-504c-aa2e-7665c428bba2, identifier: KR84974
2026-03-30 07:49:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b1f67b7a-b325-504c-aa2e-7665c428bba2 with identifier: KR84974
2026-03-30 07:49:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b1f67b7a-b325-504c-aa2e-7665c428bba2 with identifier: KR84974
2026-03-30 07:49:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b1f67b7a-b325-504c-aa2e-7665c428bba2 with identifier: KR84974 to the API
2026-03-30 07:49:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:50:44Z',
 'fuel_type': 'diesel',
 'id': 'b1f67b7a-b325-504c-aa2e-7665c428bba2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR84974',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 237123,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-05',
 'seller_name': None,
 'title': 'Volvo V70 2.4 D5 Momentum',
 'transmission': 'automatic',
 'trim': 'Momentum',
 'year': 2010}
2026-03-30 07:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR84974%27 HTTP/1.1" 200 None
2026-03-30 07:49:33 [auto1.de] INFO: Saving data for KR84974: {'auction_closing_time': 1774885844.0, 'created_time': 1774639537.043796, 'last_price_update_time': 1774856973.681242}
2026-03-30 07:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KR84974') HTTP/1.1" 204 0
2026-03-30 07:49:33 [auto1.de] INFO: Found listing with ID: FM24732
2026-03-30 07:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM24732%27 HTTP/1.1" 200 None
2026-03-30 07:49:33 [auto1.de] INFO: Scrape type for FM24732: 2
2026-03-30 07:49:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with identifier: FM24732
2026-03-30 07:49:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with scrape type 2
2026-03-30 07:49:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with scrape type 2
2026-03-30 07:49:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 92a219b7-ca9b-5483-bc59-e2600e6e04b1, identifier: FM24732
2026-03-30 07:49:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with identifier: FM24732
2026-03-30 07:49:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with identifier: FM24732
2026-03-30 07:49:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 92a219b7-ca9b-5483-bc59-e2600e6e04b1 with identifier: FM24732 to the API
2026-03-30 07:49:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:35:57Z',
 'fuel_type': 'petrol',
 'id': '92a219b7-ca9b-5483-bc59-e2600e6e04b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM24732',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLA-Klasse',
 'odometer': 41794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-03',
 'seller_name': None,
 'title': 'Mercedes-Benz GLA-Klasse GLA 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM24732%27 HTTP/1.1" 200 None
2026-03-30 07:49:34 [auto1.de] INFO: Saving data for FM24732: {'auction_closing_time': 1774884957.0, 'created_time': 1774552895.318305, 'last_price_update_time': 1774856974.100603}
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FM24732') HTTP/1.1" 204 0
2026-03-30 07:49:34 [auto1.de] INFO: Found listing with ID: EB43981
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB43981%27 HTTP/1.1" 200 None
2026-03-30 07:49:34 [auto1.de] INFO: Scrape type for EB43981: 2
2026-03-30 07:49:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with identifier: EB43981
2026-03-30 07:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with scrape type 2
2026-03-30 07:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with scrape type 2
2026-03-30 07:49:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e88b6e7a-a610-5d9e-8a9a-e1c67b385af7, identifier: EB43981
2026-03-30 07:49:34 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:49:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with identifier: EB43981
2026-03-30 07:49:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with identifier: EB43981
2026-03-30 07:49:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e88b6e7a-a610-5d9e-8a9a-e1c67b385af7 with identifier: EB43981 to the API
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:50:19Z',
 'fuel_type': 'petrol',
 'id': 'e88b6e7a-a610-5d9e-8a9a-e1c67b385af7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB43981',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 67187,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-12',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Turbo Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2017}
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB43981%27 HTTP/1.1" 200 None
2026-03-30 07:49:34 [auto1.de] INFO: Saving data for EB43981: {'auction_closing_time': 1774885819.0, 'created_time': 1774552752.436605, 'last_price_update_time': 1774856974.708312}
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EB43981') HTTP/1.1" 204 0
2026-03-30 07:49:34 [auto1.de] INFO: Found listing with ID: KW72669
2026-03-30 07:49:34 [auto1.de] INFO: Found listing with ID: YP37345
2026-03-30 07:49:34 [auto1.de] INFO: Found listing with ID: MS46414
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS46414%27 HTTP/1.1" 200 None
2026-03-30 07:49:34 [auto1.de] INFO: Scrape type for MS46414: 0
2026-03-30 07:49:34 [auto1.de] INFO: Found listing with ID: DD09602
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DD09602%27 HTTP/1.1" 200 None
2026-03-30 07:49:34 [auto1.de] INFO: Scrape type for DD09602: 0
2026-03-30 07:49:34 [auto1.de] INFO: Found listing with ID: SB14031
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB14031%27 HTTP/1.1" 200 None
2026-03-30 07:49:34 [auto1.de] INFO: Scrape type for SB14031: 2
2026-03-30 07:49:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with identifier: SB14031
2026-03-30 07:49:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with scrape type 2
2026-03-30 07:49:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with scrape type 2
2026-03-30 07:49:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5, identifier: SB14031
2026-03-30 07:49:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with identifier: SB14031
2026-03-30 07:49:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with identifier: SB14031
2026-03-30 07:49:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5 with identifier: SB14031 to the API
2026-03-30 07:49:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:45:15Z',
 'fuel_type': 'petrol',
 'id': '1fd4ad1f-2760-547a-b137-0e8bdf3b2ea5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB14031',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 114485,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-09',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-30 07:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB14031%27 HTTP/1.1" 200 None
2026-03-30 07:49:35 [auto1.de] INFO: Saving data for SB14031: {'auction_closing_time': 1774885515.0, 'created_time': 1774550714.044667, 'last_price_update_time': 1774856975.14334}
2026-03-30 07:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SB14031') HTTP/1.1" 204 0
2026-03-30 07:49:35 [auto1.de] INFO: Found listing with ID: CE68759
2026-03-30 07:49:35 [auto1.de] INFO: Found listing with ID: MP44977
2026-03-30 07:49:35 [auto1.de] INFO: Found listing with ID: AR33954
2026-03-30 07:49:35 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-30 07:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09261%27 HTTP/1.1" 200 None
2026-03-30 07:49:35 [auto1.de] INFO: Scrape type for RT09261: 2
2026-03-30 07:49:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c215080-5e99-5303-ad3a-558a6e537bb4 with identifier: RT09261
2026-03-30 07:49:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c215080-5e99-5303-ad3a-558a6e537bb4 with scrape type 2
2026-03-30 07:49:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c215080-5e99-5303-ad3a-558a6e537bb4 with scrape type 2
2026-03-30 07:49:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2c215080-5e99-5303-ad3a-558a6e537bb4, identifier: RT09261
2026-03-30 07:49:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2c215080-5e99-5303-ad3a-558a6e537bb4 with identifier: RT09261
2026-03-30 07:49:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2c215080-5e99-5303-ad3a-558a6e537bb4 with identifier: RT09261
2026-03-30 07:49:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2c215080-5e99-5303-ad3a-558a6e537bb4 with identifier: RT09261 to the API
2026-03-30 07:49:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:52:28Z',
 'fuel_type': 'petrol',
 'id': '2c215080-5e99-5303-ad3a-558a6e537bb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RT09261',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 141636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-11-13',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 Goal',
 'transmission': 'manual',
 'trim': 'Goal',
 'year': 2006}
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09261%27 HTTP/1.1" 200 None
2026-03-30 07:49:36 [auto1.de] INFO: Saving data for RT09261: {'auction_closing_time': 1774885948.0, 'created_time': 1773917552.791703, 'last_price_update_time': 1774856976.179525}
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RT09261') HTTP/1.1" 204 0
2026-03-30 07:49:36 [auto1.de] INFO: Channel: 24h | Page: 159 | totalHits: 8410 | hits on page: 40
2026-03-30 07:49:36 [auto1.de] INFO: Found listing with ID: RT09261
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT09261%27 HTTP/1.1" 200 None
2026-03-30 07:49:36 [auto1.de] INFO: Scrape type for RT09261: 0
2026-03-30 07:49:36 [auto1.de] INFO: Found listing with ID: NC07171
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC07171%27 HTTP/1.1" 200 None
2026-03-30 07:49:36 [auto1.de] INFO: Scrape type for NC07171: 0
2026-03-30 07:49:36 [auto1.de] INFO: Found listing with ID: AW26108
2026-03-30 07:49:36 [auto1.de] INFO: Found listing with ID: LJ68235
2026-03-30 07:49:36 [auto1.de] INFO: Found listing with ID: EE70879
2026-03-30 07:49:36 [auto1.de] INFO: Found listing with ID: HW02228
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW02228%27 HTTP/1.1" 200 None
2026-03-30 07:49:36 [auto1.de] INFO: Scrape type for HW02228: 2
2026-03-30 07:49:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e34fbea-0991-58e6-9bf3-474826649e31 with identifier: HW02228
2026-03-30 07:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e34fbea-0991-58e6-9bf3-474826649e31 with scrape type 2
2026-03-30 07:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e34fbea-0991-58e6-9bf3-474826649e31 with scrape type 2
2026-03-30 07:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e34fbea-0991-58e6-9bf3-474826649e31, identifier: HW02228
2026-03-30 07:49:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e34fbea-0991-58e6-9bf3-474826649e31 with identifier: HW02228
2026-03-30 07:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e34fbea-0991-58e6-9bf3-474826649e31 with identifier: HW02228
2026-03-30 07:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e34fbea-0991-58e6-9bf3-474826649e31 with identifier: HW02228 to the API
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:28:44Z',
 'fuel_type': 'diesel',
 'id': '4e34fbea-0991-58e6-9bf3-474826649e31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW02228',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'CR-V',
 'odometer': 194658,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-29',
 'seller_name': None,
 'title': 'Honda CR-V 2.2 DTEC Lifestyle 4WD',
 'transmission': 'manual',
 'trim': 'Lifestyle 4WD',
 'year': 2014}
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HW02228%27 HTTP/1.1" 200 None
2026-03-30 07:49:36 [auto1.de] INFO: Saving data for HW02228: {'auction_closing_time': 1774884524.0, 'created_time': 1774639253.444058, 'last_price_update_time': 1774856976.623123}
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HW02228') HTTP/1.1" 204 0
2026-03-30 07:49:36 [auto1.de] INFO: Found listing with ID: XC86569
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86569%27 HTTP/1.1" 200 None
2026-03-30 07:49:36 [auto1.de] INFO: Scrape type for XC86569: 2
2026-03-30 07:49:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de18d4f1-e49d-595a-a1a2-dec7598c5034 with identifier: XC86569
2026-03-30 07:49:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de18d4f1-e49d-595a-a1a2-dec7598c5034 with scrape type 2
2026-03-30 07:49:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de18d4f1-e49d-595a-a1a2-dec7598c5034 with scrape type 2
2026-03-30 07:49:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de18d4f1-e49d-595a-a1a2-dec7598c5034, identifier: XC86569
2026-03-30 07:49:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de18d4f1-e49d-595a-a1a2-dec7598c5034 with identifier: XC86569
2026-03-30 07:49:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de18d4f1-e49d-595a-a1a2-dec7598c5034 with identifier: XC86569
2026-03-30 07:49:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de18d4f1-e49d-595a-a1a2-dec7598c5034 with identifier: XC86569 to the API
2026-03-30 07:49:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:40:50Z',
 'fuel_type': 'petrol',
 'id': 'de18d4f1-e49d-595a-a1a2-dec7598c5034',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XC86569',
 'listing': 'auction',
 'make': 'Kia',
 'model': "cee'd",
 'odometer': 57497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-17',
 'seller_name': None,
 'title': "Kia cee'd 1.6 TGDI GT-Track",
 'transmission': 'manual',
 'trim': 'GT-Track',
 'year': 2017}
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XC86569%27 HTTP/1.1" 200 None
2026-03-30 07:49:37 [auto1.de] INFO: Saving data for XC86569: {'auction_closing_time': 1774885250.0, 'created_time': 1774639408.187541, 'last_price_update_time': 1774856977.122189}
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XC86569') HTTP/1.1" 204 0
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: ST04128
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST04128%27 HTTP/1.1" 200 None
2026-03-30 07:49:37 [auto1.de] INFO: Scrape type for ST04128: 0
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: EC74122
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: KX24569
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: WM50806
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: KW68340
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW68340%27 HTTP/1.1" 200 None
2026-03-30 07:49:37 [auto1.de] INFO: Scrape type for KW68340: 0
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: VR66334
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: UB61823
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB61823%27 HTTP/1.1" 200 None
2026-03-30 07:49:37 [auto1.de] INFO: Scrape type for UB61823: 2
2026-03-30 07:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e153ff5-77aa-594b-936e-197a86210358 with identifier: UB61823
2026-03-30 07:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e153ff5-77aa-594b-936e-197a86210358 with scrape type 2
2026-03-30 07:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e153ff5-77aa-594b-936e-197a86210358 with scrape type 2
2026-03-30 07:49:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1e153ff5-77aa-594b-936e-197a86210358, identifier: UB61823
2026-03-30 07:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1e153ff5-77aa-594b-936e-197a86210358 with identifier: UB61823
2026-03-30 07:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1e153ff5-77aa-594b-936e-197a86210358 with identifier: UB61823
2026-03-30 07:49:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1e153ff5-77aa-594b-936e-197a86210358 with identifier: UB61823 to the API
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:45:02Z',
 'fuel_type': 'petrol',
 'id': '1e153ff5-77aa-594b-936e-197a86210358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB61823',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 18995,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Fiat Punto 1.2 MYSTYLE',
 'transmission': 'manual',
 'trim': 'MYSTYLE',
 'year': 2016}
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB61823%27 HTTP/1.1" 200 None
2026-03-30 07:49:37 [auto1.de] INFO: Saving data for UB61823: {'auction_closing_time': 1774885502.0, 'created_time': 1774552971.960014, 'last_price_update_time': 1774856977.552069}
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB61823') HTTP/1.1" 204 0
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: WV19329
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: PD01129
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD01129%27 HTTP/1.1" 200 None
2026-03-30 07:49:37 [auto1.de] INFO: Scrape type for PD01129: 0
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: EJ12041
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: WW55400
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: KA83154
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: NX41680
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: GR15033
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR15033%27 HTTP/1.1" 200 None
2026-03-30 07:49:37 [auto1.de] INFO: Scrape type for GR15033: 0
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: JB86141
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: EU38402
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: GD44773
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: AX24898
2026-03-30 07:49:37 [auto1.de] INFO: Found listing with ID: DW69161
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW69161%27 HTTP/1.1" 200 None
2026-03-30 07:49:37 [auto1.de] INFO: Scrape type for DW69161: 2
2026-03-30 07:49:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd4cd364-6c40-5df1-8a19-c4dfa01a4a01 with identifier: DW69161
2026-03-30 07:49:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd4cd364-6c40-5df1-8a19-c4dfa01a4a01 with scrape type 2
2026-03-30 07:49:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fd4cd364-6c40-5df1-8a19-c4dfa01a4a01 with scrape type 2
2026-03-30 07:49:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fd4cd364-6c40-5df1-8a19-c4dfa01a4a01, identifier: DW69161
2026-03-30 07:49:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fd4cd364-6c40-5df1-8a19-c4dfa01a4a01 with identifier: DW69161
2026-03-30 07:49:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fd4cd364-6c40-5df1-8a19-c4dfa01a4a01 with identifier: DW69161
2026-03-30 07:49:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fd4cd364-6c40-5df1-8a19-c4dfa01a4a01 with identifier: DW69161 to the API
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:31:18Z',
 'fuel_type': 'diesel',
 'id': 'fd4cd364-6c40-5df1-8a19-c4dfa01a4a01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW69161',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 214316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-17',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 113 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2011}
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW69161%27 HTTP/1.1" 200 None
2026-03-30 07:49:38 [auto1.de] INFO: Saving data for DW69161: {'auction_closing_time': 1774884678.0, 'created_time': 1774639956.548248, 'last_price_update_time': 1774856978.029291}
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW69161') HTTP/1.1" 204 0
2026-03-30 07:49:38 [auto1.de] INFO: Found listing with ID: VH92759
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH92759%27 HTTP/1.1" 200 None
2026-03-30 07:49:38 [auto1.de] INFO: Scrape type for VH92759: 0
2026-03-30 07:49:38 [auto1.de] INFO: Found listing with ID: BX45513
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX45513%27 HTTP/1.1" 200 None
2026-03-30 07:49:38 [auto1.de] INFO: Scrape type for BX45513: 0
2026-03-30 07:49:38 [auto1.de] INFO: Found listing with ID: CV00012
2026-03-30 07:49:38 [auto1.de] INFO: Found listing with ID: UH05961
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UH05961%27 HTTP/1.1" 200 None
2026-03-30 07:49:38 [auto1.de] INFO: Scrape type for UH05961: 0
2026-03-30 07:49:38 [auto1.de] INFO: Found listing with ID: UE92744
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE92744%27 HTTP/1.1" 200 None
2026-03-30 07:49:38 [auto1.de] INFO: Scrape type for UE92744: 2
2026-03-30 07:49:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 737a427c-475b-5339-b455-8e3edba587d2 with identifier: UE92744
2026-03-30 07:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 737a427c-475b-5339-b455-8e3edba587d2 with scrape type 2
2026-03-30 07:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 737a427c-475b-5339-b455-8e3edba587d2 with scrape type 2
2026-03-30 07:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 737a427c-475b-5339-b455-8e3edba587d2, identifier: UE92744
2026-03-30 07:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 737a427c-475b-5339-b455-8e3edba587d2 with identifier: UE92744
2026-03-30 07:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 737a427c-475b-5339-b455-8e3edba587d2 with identifier: UE92744
2026-03-30 07:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 737a427c-475b-5339-b455-8e3edba587d2 with identifier: UE92744 to the API
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:48:50Z',
 'fuel_type': 'diesel',
 'id': '737a427c-475b-5339-b455-8e3edba587d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE92744',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 161787,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-20',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE92744%27 HTTP/1.1" 200 None
2026-03-30 07:49:38 [auto1.de] INFO: Saving data for UE92744: {'auction_closing_time': 1774885730.0, 'created_time': 1773946590.813389, 'last_price_update_time': 1774856978.578964}
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE92744') HTTP/1.1" 204 0
2026-03-30 07:49:38 [auto1.de] INFO: Found listing with ID: WD76267
2026-03-30 07:49:38 [auto1.de] INFO: Found listing with ID: SX50197
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX50197%27 HTTP/1.1" 200 None
2026-03-30 07:49:38 [auto1.de] INFO: Scrape type for SX50197: 2
2026-03-30 07:49:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9bef95e-a95f-540a-83f6-dd35edce1637 with identifier: SX50197
2026-03-30 07:49:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9bef95e-a95f-540a-83f6-dd35edce1637 with scrape type 2
2026-03-30 07:49:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9bef95e-a95f-540a-83f6-dd35edce1637 with scrape type 2
2026-03-30 07:49:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e9bef95e-a95f-540a-83f6-dd35edce1637, identifier: SX50197
2026-03-30 07:49:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e9bef95e-a95f-540a-83f6-dd35edce1637 with identifier: SX50197
2026-03-30 07:49:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e9bef95e-a95f-540a-83f6-dd35edce1637 with identifier: SX50197
2026-03-30 07:49:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e9bef95e-a95f-540a-83f6-dd35edce1637 with identifier: SX50197 to the API
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:40:54Z',
 'fuel_type': 'petrol',
 'id': 'e9bef95e-a95f-540a-83f6-dd35edce1637',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX50197',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 192978,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-28',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2009}
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX50197%27 HTTP/1.1" 200 None
2026-03-30 07:49:38 [auto1.de] INFO: Saving data for SX50197: {'auction_closing_time': 1774885254.0, 'created_time': 1774552635.44326, 'last_price_update_time': 1774856978.993286}
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX50197') HTTP/1.1" 204 0
2026-03-30 07:49:39 [auto1.de] INFO: Found listing with ID: WF46634
2026-03-30 07:49:39 [auto1.de] INFO: Found listing with ID: JK09354
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK09354%27 HTTP/1.1" 200 None
2026-03-30 07:49:39 [auto1.de] INFO: Scrape type for JK09354: 0
2026-03-30 07:49:39 [auto1.de] INFO: Found listing with ID: MK74159
2026-03-30 07:49:39 [auto1.de] INFO: Found listing with ID: MB99639
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB99639%27 HTTP/1.1" 200 None
2026-03-30 07:49:39 [auto1.de] INFO: Scrape type for MB99639: 0
2026-03-30 07:49:39 [auto1.de] INFO: Found listing with ID: JY20186
2026-03-30 07:49:39 [auto1.de] INFO: Found listing with ID: XF93739
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF93739%27 HTTP/1.1" 200 None
2026-03-30 07:49:39 [auto1.de] INFO: Scrape type for XF93739: 2
2026-03-30 07:49:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9124e27d-2ed1-552c-9400-b2b3115c9af8 with identifier: XF93739
2026-03-30 07:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9124e27d-2ed1-552c-9400-b2b3115c9af8 with scrape type 2
2026-03-30 07:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9124e27d-2ed1-552c-9400-b2b3115c9af8 with scrape type 2
2026-03-30 07:49:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9124e27d-2ed1-552c-9400-b2b3115c9af8, identifier: XF93739
2026-03-30 07:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9124e27d-2ed1-552c-9400-b2b3115c9af8 with identifier: XF93739
2026-03-30 07:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9124e27d-2ed1-552c-9400-b2b3115c9af8 with identifier: XF93739
2026-03-30 07:49:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9124e27d-2ed1-552c-9400-b2b3115c9af8 with identifier: XF93739 to the API
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 420,
 'expiration_date': '2026-03-30T15:15:30Z',
 'fuel_type': 'petrol',
 'id': '9124e27d-2ed1-552c-9400-b2b3115c9af8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF93739',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mustang',
 'odometer': 62305,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-16',
 'seller_name': None,
 'title': 'Ford Mustang 5.0 Ti-VCT V8 Convertible GT',
 'transmission': 'manual',
 'trim': 'Convertible GT',
 'year': 2017}
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF93739%27 HTTP/1.1" 200 None
2026-03-30 07:49:39 [auto1.de] INFO: Saving data for XF93739: {'auction_closing_time': 1774883730.0, 'created_time': 1774552683.292137, 'last_price_update_time': 1774856979.452451}
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF93739') HTTP/1.1" 204 0
2026-03-30 07:49:39 [auto1.de] INFO: Found listing with ID: MT56584
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT56584%27 HTTP/1.1" 200 None
2026-03-30 07:49:39 [auto1.de] INFO: Scrape type for MT56584: 0
2026-03-30 07:49:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:49:39 [auto1.de] INFO: Channel: 24h | Page: 160 | totalHits: 8410 | hits on page: 40
2026-03-30 07:49:39 [auto1.de] INFO: Found listing with ID: FB48782
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB48782%27 HTTP/1.1" 200 None
2026-03-30 07:49:39 [auto1.de] INFO: Scrape type for FB48782: 2
2026-03-30 07:49:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d84a779f-3d14-5e6f-87e9-6edd144e1c07 with identifier: FB48782
2026-03-30 07:49:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d84a779f-3d14-5e6f-87e9-6edd144e1c07 with scrape type 2
2026-03-30 07:49:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d84a779f-3d14-5e6f-87e9-6edd144e1c07 with scrape type 2
2026-03-30 07:49:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d84a779f-3d14-5e6f-87e9-6edd144e1c07, identifier: FB48782
2026-03-30 07:49:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d84a779f-3d14-5e6f-87e9-6edd144e1c07 with identifier: FB48782
2026-03-30 07:49:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d84a779f-3d14-5e6f-87e9-6edd144e1c07 with identifier: FB48782
2026-03-30 07:49:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d84a779f-3d14-5e6f-87e9-6edd144e1c07 with identifier: FB48782 to the API
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:50:03Z',
 'fuel_type': 'diesel',
 'id': 'd84a779f-3d14-5e6f-87e9-6edd144e1c07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB48782',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 156872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-17',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI clean diesel quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB48782%27 HTTP/1.1" 200 None
2026-03-30 07:49:40 [auto1.de] INFO: Saving data for FB48782: {'auction_closing_time': 1774885803.0, 'created_time': 1774551868.889514, 'last_price_update_time': 1774856980.100656}
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB48782') HTTP/1.1" 204 0
2026-03-30 07:49:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: FA59135
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: XJ30357
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ30357%27 HTTP/1.1" 200 None
2026-03-30 07:49:40 [auto1.de] INFO: Scrape type for XJ30357: 2
2026-03-30 07:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11e16eea-bf6f-5cdc-89d6-4a8304fd03dc with identifier: XJ30357
2026-03-30 07:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11e16eea-bf6f-5cdc-89d6-4a8304fd03dc with scrape type 2
2026-03-30 07:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11e16eea-bf6f-5cdc-89d6-4a8304fd03dc with scrape type 2
2026-03-30 07:49:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 11e16eea-bf6f-5cdc-89d6-4a8304fd03dc, identifier: XJ30357
2026-03-30 07:49:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 11e16eea-bf6f-5cdc-89d6-4a8304fd03dc with identifier: XJ30357
2026-03-30 07:49:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 11e16eea-bf6f-5cdc-89d6-4a8304fd03dc with identifier: XJ30357
2026-03-30 07:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 11e16eea-bf6f-5cdc-89d6-4a8304fd03dc with identifier: XJ30357 to the API
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-30T15:22:43Z',
 'fuel_type': 'petrol',
 'id': '11e16eea-bf6f-5cdc-89d6-4a8304fd03dc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ30357',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 32404,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-03-26',
 'seller_name': None,
 'title': 'Mazda 6 2.5 Sports-Line',
 'transmission': 'automatic',
 'trim': 'Sports-Line',
 'year': 2023}
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ30357%27 HTTP/1.1" 200 None
2026-03-30 07:49:40 [auto1.de] INFO: Saving data for XJ30357: {'auction_closing_time': 1774884163.0, 'created_time': 1774639538.389803, 'last_price_update_time': 1774856980.487266}
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ30357') HTTP/1.1" 204 0
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: BV96832
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: YE81869
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: JY20975
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY20975%27 HTTP/1.1" 200 None
2026-03-30 07:49:40 [auto1.de] INFO: Scrape type for JY20975: 0
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: GJ77265
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: JG82377
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: VA13792
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA13792%27 HTTP/1.1" 200 None
2026-03-30 07:49:40 [auto1.de] INFO: Scrape type for VA13792: 0
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: BY18365
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: CM58161
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM58161%27 HTTP/1.1" 200 None
2026-03-30 07:49:40 [auto1.de] INFO: Scrape type for CM58161: 0
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: SP67485
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SP67485%27 HTTP/1.1" 200 None
2026-03-30 07:49:40 [auto1.de] INFO: Scrape type for SP67485: 0
2026-03-30 07:49:40 [auto1.de] INFO: Found listing with ID: BC52904
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC52904%27 HTTP/1.1" 200 None
2026-03-30 07:49:40 [auto1.de] INFO: Scrape type for BC52904: 2
2026-03-30 07:49:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aac9e2f-90a3-5b87-8279-ae848c9cebc4 with identifier: BC52904
2026-03-30 07:49:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aac9e2f-90a3-5b87-8279-ae848c9cebc4 with scrape type 2
2026-03-30 07:49:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6aac9e2f-90a3-5b87-8279-ae848c9cebc4 with scrape type 2
2026-03-30 07:49:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6aac9e2f-90a3-5b87-8279-ae848c9cebc4, identifier: BC52904
2026-03-30 07:49:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6aac9e2f-90a3-5b87-8279-ae848c9cebc4 with identifier: BC52904
2026-03-30 07:49:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6aac9e2f-90a3-5b87-8279-ae848c9cebc4 with identifier: BC52904
2026-03-30 07:49:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6aac9e2f-90a3-5b87-8279-ae848c9cebc4 with identifier: BC52904 to the API
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:14Z',
 'fuel_type': 'diesel',
 'id': '6aac9e2f-90a3-5b87-8279-ae848c9cebc4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BC52904',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 104441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-31',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC52904%27 HTTP/1.1" 200 None
2026-03-30 07:49:40 [auto1.de] INFO: Saving data for BC52904: {'auction_closing_time': 1774884434.0, 'created_time': 1773137992.515122, 'last_price_update_time': 1774856980.960878}
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BC52904') HTTP/1.1" 204 0
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: PS45422
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: FX80624
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: GX75432
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: YA96721
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: TU33144
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: WC63279
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: BX52940
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: YF47459
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF47459%27 HTTP/1.1" 200 None
2026-03-30 07:49:41 [auto1.de] INFO: Scrape type for YF47459: 2
2026-03-30 07:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ec1ed21-4ed1-5c6f-b22e-a17099a41069 with identifier: YF47459
2026-03-30 07:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ec1ed21-4ed1-5c6f-b22e-a17099a41069 with scrape type 2
2026-03-30 07:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ec1ed21-4ed1-5c6f-b22e-a17099a41069 with scrape type 2
2026-03-30 07:49:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ec1ed21-4ed1-5c6f-b22e-a17099a41069, identifier: YF47459
2026-03-30 07:49:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ec1ed21-4ed1-5c6f-b22e-a17099a41069 with identifier: YF47459
2026-03-30 07:49:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ec1ed21-4ed1-5c6f-b22e-a17099a41069 with identifier: YF47459
2026-03-30 07:49:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ec1ed21-4ed1-5c6f-b22e-a17099a41069 with identifier: YF47459 to the API
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:19:52Z',
 'fuel_type': 'petrol',
 'id': '6ec1ed21-4ed1-5c6f-b22e-a17099a41069',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF47459',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 117319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1996-04-02',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0',
 'transmission': 'manual',
 'trim': '',
 'year': 1996}
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF47459%27 HTTP/1.1" 200 None
2026-03-30 07:49:41 [auto1.de] INFO: Saving data for YF47459: {'auction_closing_time': 1774883992.0, 'created_time': 1773307691.429301, 'last_price_update_time': 1774856981.476135}
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF47459') HTTP/1.1" 204 0
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: YC54043
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC54043%27 HTTP/1.1" 200 None
2026-03-30 07:49:41 [auto1.de] INFO: Scrape type for YC54043: 2
2026-03-30 07:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43857e45-0275-58cc-8ed0-41cb96eeaea2 with identifier: YC54043
2026-03-30 07:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43857e45-0275-58cc-8ed0-41cb96eeaea2 with scrape type 2
2026-03-30 07:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43857e45-0275-58cc-8ed0-41cb96eeaea2 with scrape type 2
2026-03-30 07:49:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 43857e45-0275-58cc-8ed0-41cb96eeaea2, identifier: YC54043
2026-03-30 07:49:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 43857e45-0275-58cc-8ed0-41cb96eeaea2 with identifier: YC54043
2026-03-30 07:49:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 43857e45-0275-58cc-8ed0-41cb96eeaea2 with identifier: YC54043
2026-03-30 07:49:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 43857e45-0275-58cc-8ed0-41cb96eeaea2 with identifier: YC54043 to the API
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:10:25Z',
 'fuel_type': 'diesel',
 'id': '43857e45-0275-58cc-8ed0-41cb96eeaea2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC54043',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i20',
 'odometer': 75353,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-23',
 'seller_name': None,
 'title': 'Hyundai i20 1.1 CRDi Intro Edition',
 'transmission': 'manual',
 'trim': 'Intro Edition',
 'year': 2015}
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC54043%27 HTTP/1.1" 200 None
2026-03-30 07:49:41 [auto1.de] INFO: Saving data for YC54043: {'auction_closing_time': 1774883425.0, 'created_time': 1774639731.960701, 'last_price_update_time': 1774856981.874353}
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YC54043') HTTP/1.1" 204 0
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: CE80644
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: GM45973
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: EJ52813
2026-03-30 07:49:41 [auto1.de] INFO: Found listing with ID: TS98939
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98939%27 HTTP/1.1" 200 None
2026-03-30 07:49:41 [auto1.de] INFO: Scrape type for TS98939: 2
2026-03-30 07:49:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with identifier: TS98939
2026-03-30 07:49:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with scrape type 2
2026-03-30 07:49:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with scrape type 2
2026-03-30 07:49:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41, identifier: TS98939
2026-03-30 07:49:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with identifier: TS98939
2026-03-30 07:49:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with identifier: TS98939
2026-03-30 07:49:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41 with identifier: TS98939 to the API
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:43:04Z',
 'fuel_type': 'petrol',
 'id': 'f2b5b4c8-22e9-5ed6-ae4e-4b5b7507fc41',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TS98939',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 66467,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-23',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Club up!',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2016}
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TS98939%27 HTTP/1.1" 200 None
2026-03-30 07:49:42 [auto1.de] INFO: Saving data for TS98939: {'auction_closing_time': 1774885384.0, 'created_time': 1773383195.315336, 'last_price_update_time': 1774856982.317484}
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TS98939') HTTP/1.1" 204 0
2026-03-30 07:49:42 [auto1.de] INFO: Found listing with ID: SX52884
2026-03-30 07:49:42 [auto1.de] INFO: Found listing with ID: HX55522
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX55522%27 HTTP/1.1" 200 None
2026-03-30 07:49:42 [auto1.de] INFO: Scrape type for HX55522: 2
2026-03-30 07:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with identifier: HX55522
2026-03-30 07:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with scrape type 2
2026-03-30 07:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with scrape type 2
2026-03-30 07:49:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7, identifier: HX55522
2026-03-30 07:49:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with identifier: HX55522
2026-03-30 07:49:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with identifier: HX55522
2026-03-30 07:49:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7 with identifier: HX55522 to the API
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:57:54Z',
 'fuel_type': 'diesel',
 'id': '3d4c7f3d-33e8-5e79-bbe3-6ed1ae5e0cc7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX55522',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 149793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-20',
 'seller_name': None,
 'title': 'Seat Leon 2.0 TDI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2017}
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX55522%27 HTTP/1.1" 200 None
2026-03-30 07:49:42 [auto1.de] INFO: Saving data for HX55522: {'auction_closing_time': 1774886274.0, 'created_time': 1774553199.28481, 'last_price_update_time': 1774856982.836882}
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX55522') HTTP/1.1" 204 0
2026-03-30 07:49:42 [auto1.de] INFO: Found listing with ID: JU59461
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU59461%27 HTTP/1.1" 200 None
2026-03-30 07:49:42 [auto1.de] INFO: Scrape type for JU59461: 0
2026-03-30 07:49:42 [auto1.de] INFO: Found listing with ID: YY76457
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY76457%27 HTTP/1.1" 200 None
2026-03-30 07:49:42 [auto1.de] INFO: Scrape type for YY76457: 0
2026-03-30 07:49:42 [auto1.de] INFO: Found listing with ID: HH54610
2026-03-30 07:49:42 [auto1.de] INFO: Found listing with ID: RV05301
2026-03-30 07:49:42 [auto1.de] INFO: Found listing with ID: NV91199
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV91199%27 HTTP/1.1" 200 None
2026-03-30 07:49:42 [auto1.de] INFO: Scrape type for NV91199: 2
2026-03-30 07:49:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 977a21d0-dd78-57c6-9e7d-021e5b516a0b with identifier: NV91199
2026-03-30 07:49:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977a21d0-dd78-57c6-9e7d-021e5b516a0b with scrape type 2
2026-03-30 07:49:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 977a21d0-dd78-57c6-9e7d-021e5b516a0b with scrape type 2
2026-03-30 07:49:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 977a21d0-dd78-57c6-9e7d-021e5b516a0b, identifier: NV91199
2026-03-30 07:49:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 977a21d0-dd78-57c6-9e7d-021e5b516a0b with identifier: NV91199
2026-03-30 07:49:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 977a21d0-dd78-57c6-9e7d-021e5b516a0b with identifier: NV91199
2026-03-30 07:49:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 977a21d0-dd78-57c6-9e7d-021e5b516a0b with identifier: NV91199 to the API
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:19:34Z',
 'fuel_type': 'diesel',
 'id': '977a21d0-dd78-57c6-9e7d-021e5b516a0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV91199',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Ducato',
 'odometer': 130007,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-29',
 'seller_name': None,
 'title': 'Fiat Ducato 2.0 JTD 115',
 'transmission': 'manual',
 'trim': '115',
 'year': 2012}
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV91199%27 HTTP/1.1" 200 None
2026-03-30 07:49:43 [auto1.de] INFO: Saving data for NV91199: {'auction_closing_time': 1774883974.0, 'created_time': 1773305604.125569, 'last_price_update_time': 1774856983.265339}
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NV91199') HTTP/1.1" 204 0
2026-03-30 07:49:43 [auto1.de] INFO: Found listing with ID: BL02906
2026-03-30 07:49:43 [auto1.de] INFO: Found listing with ID: MU06358
2026-03-30 07:49:43 [auto1.de] INFO: Found listing with ID: JM16548
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM16548%27 HTTP/1.1" 200 None
2026-03-30 07:49:43 [auto1.de] INFO: Scrape type for JM16548: 0
2026-03-30 07:49:43 [auto1.de] INFO: Found listing with ID: ZY60733
2026-03-30 07:49:43 [auto1.de] INFO: Found listing with ID: RZ49473
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ49473%27 HTTP/1.1" 200 None
2026-03-30 07:49:43 [auto1.de] INFO: Scrape type for RZ49473: 2
2026-03-30 07:49:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34cf28b6-d71c-5e21-87ae-e372c08b311f with identifier: RZ49473
2026-03-30 07:49:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34cf28b6-d71c-5e21-87ae-e372c08b311f with scrape type 2
2026-03-30 07:49:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34cf28b6-d71c-5e21-87ae-e372c08b311f with scrape type 2
2026-03-30 07:49:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 34cf28b6-d71c-5e21-87ae-e372c08b311f, identifier: RZ49473
2026-03-30 07:49:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 34cf28b6-d71c-5e21-87ae-e372c08b311f with identifier: RZ49473
2026-03-30 07:49:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 34cf28b6-d71c-5e21-87ae-e372c08b311f with identifier: RZ49473
2026-03-30 07:49:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 34cf28b6-d71c-5e21-87ae-e372c08b311f with identifier: RZ49473 to the API
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:24:30Z',
 'fuel_type': 'petrol',
 'id': '34cf28b6-d71c-5e21-87ae-e372c08b311f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ49473',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 162681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-20',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2010}
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ49473%27 HTTP/1.1" 200 None
2026-03-30 07:49:43 [auto1.de] INFO: Saving data for RZ49473: {'auction_closing_time': 1774884270.0, 'created_time': 1774638700.805884, 'last_price_update_time': 1774856983.684204}
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RZ49473') HTTP/1.1" 204 0
2026-03-30 07:49:43 [auto1.de] INFO: Found listing with ID: GE87881
2026-03-30 07:49:43 [auto1.de] INFO: Found listing with ID: WW79477
2026-03-30 07:49:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:49:44 [auto1.de] INFO: Channel: 24h | Page: 161 | totalHits: 8410 | hits on page: 40
2026-03-30 07:49:44 [auto1.de] INFO: Found listing with ID: GK32978
2026-03-30 07:49:44 [auto1.de] INFO: Found listing with ID: SZ94185
2026-03-30 07:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ94185%27 HTTP/1.1" 200 None
2026-03-30 07:49:44 [auto1.de] INFO: Scrape type for SZ94185: 0
2026-03-30 07:49:44 [auto1.de] INFO: Found listing with ID: EA80690
2026-03-30 07:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA80690%27 HTTP/1.1" 200 None
2026-03-30 07:49:44 [auto1.de] INFO: Scrape type for EA80690: 0
2026-03-30 07:49:44 [auto1.de] INFO: Found listing with ID: HE65946
2026-03-30 07:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE65946%27 HTTP/1.1" 200 None
2026-03-30 07:49:44 [auto1.de] INFO: Scrape type for HE65946: 2
2026-03-30 07:49:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f410918-6c2e-594f-b797-75a9c708b19b with identifier: HE65946
2026-03-30 07:49:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f410918-6c2e-594f-b797-75a9c708b19b with scrape type 2
2026-03-30 07:49:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f410918-6c2e-594f-b797-75a9c708b19b with scrape type 2
2026-03-30 07:49:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f410918-6c2e-594f-b797-75a9c708b19b, identifier: HE65946
2026-03-30 07:49:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f410918-6c2e-594f-b797-75a9c708b19b with identifier: HE65946
2026-03-30 07:49:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f410918-6c2e-594f-b797-75a9c708b19b with identifier: HE65946
2026-03-30 07:49:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f410918-6c2e-594f-b797-75a9c708b19b with identifier: HE65946 to the API
2026-03-30 07:49:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:25:04Z',
 'fuel_type': 'petrol',
 'id': '4f410918-6c2e-594f-b797-75a9c708b19b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HE65946',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris',
 'odometer': 159373,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-26',
 'seller_name': None,
 'title': 'Toyota Auris 1.6 Executive',
 'transmission': 'manual',
 'trim': 'Executive',
 'year': 2008}
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE65946%27 HTTP/1.1" 200 None
2026-03-30 07:49:45 [auto1.de] INFO: Saving data for HE65946: {'auction_closing_time': 1774884304.0, 'created_time': 1774589757.281489, 'last_price_update_time': 1774856985.184268}
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HE65946') HTTP/1.1" 204 0
2026-03-30 07:49:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:49:45 [auto1.de] INFO: Found listing with ID: WN68055
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN68055%27 HTTP/1.1" 200 None
2026-03-30 07:49:45 [auto1.de] INFO: Scrape type for WN68055: 2
2026-03-30 07:49:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13c01bc8-b3ce-532b-9a84-5613b144511f with identifier: WN68055
2026-03-30 07:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13c01bc8-b3ce-532b-9a84-5613b144511f with scrape type 2
2026-03-30 07:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13c01bc8-b3ce-532b-9a84-5613b144511f with scrape type 2
2026-03-30 07:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 13c01bc8-b3ce-532b-9a84-5613b144511f, identifier: WN68055
2026-03-30 07:49:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 13c01bc8-b3ce-532b-9a84-5613b144511f with identifier: WN68055
2026-03-30 07:49:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 13c01bc8-b3ce-532b-9a84-5613b144511f with identifier: WN68055
2026-03-30 07:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 13c01bc8-b3ce-532b-9a84-5613b144511f with identifier: WN68055 to the API
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:50:00Z',
 'fuel_type': 'petrol',
 'id': '13c01bc8-b3ce-532b-9a84-5613b144511f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN68055',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 73352,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-22',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0 Cup up!',
 'transmission': 'automatic',
 'trim': 'Cup',
 'year': 2014}
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN68055%27 HTTP/1.1" 200 None
2026-03-30 07:49:45 [auto1.de] INFO: Saving data for WN68055: {'auction_closing_time': 1774885800.0, 'created_time': 1774550721.99181, 'last_price_update_time': 1774856985.578323}
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WN68055') HTTP/1.1" 204 0
2026-03-30 07:49:45 [auto1.de] INFO: Found listing with ID: ZW60338
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW60338%27 HTTP/1.1" 200 None
2026-03-30 07:49:45 [auto1.de] INFO: Scrape type for ZW60338: 0
2026-03-30 07:49:45 [auto1.de] INFO: Found listing with ID: LC93569
2026-03-30 07:49:45 [auto1.de] INFO: Found listing with ID: PX99081
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX99081%27 HTTP/1.1" 200 None
2026-03-30 07:49:45 [auto1.de] INFO: Scrape type for PX99081: 2
2026-03-30 07:49:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c5bf03b-2cb0-5ae0-9a6b-05cacac0c363 with identifier: PX99081
2026-03-30 07:49:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c5bf03b-2cb0-5ae0-9a6b-05cacac0c363 with scrape type 2
2026-03-30 07:49:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c5bf03b-2cb0-5ae0-9a6b-05cacac0c363 with scrape type 2
2026-03-30 07:49:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9c5bf03b-2cb0-5ae0-9a6b-05cacac0c363, identifier: PX99081
2026-03-30 07:49:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9c5bf03b-2cb0-5ae0-9a6b-05cacac0c363 with identifier: PX99081
2026-03-30 07:49:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9c5bf03b-2cb0-5ae0-9a6b-05cacac0c363 with identifier: PX99081
2026-03-30 07:49:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9c5bf03b-2cb0-5ae0-9a6b-05cacac0c363 with identifier: PX99081 to the API
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:34:11Z',
 'fuel_type': 'petrol',
 'id': '9c5bf03b-2cb0-5ae0-9a6b-05cacac0c363',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PX99081',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 184336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-28',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX99081%27 HTTP/1.1" 200 None
2026-03-30 07:49:45 [auto1.de] INFO: Saving data for PX99081: {'auction_closing_time': 1774884851.0, 'created_time': 1774638960.716773, 'last_price_update_time': 1774856985.986739}
2026-03-30 07:49:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PX99081') HTTP/1.1" 204 0
2026-03-30 07:49:46 [auto1.de] INFO: Found listing with ID: GH74073
2026-03-30 07:49:46 [auto1.de] INFO: Found listing with ID: MX11435
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11435%27 HTTP/1.1" 200 None
2026-03-30 07:49:46 [auto1.de] INFO: Scrape type for MX11435: 2
2026-03-30 07:49:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b267b754-1831-5511-a955-e49675e72e52 with identifier: MX11435
2026-03-30 07:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b267b754-1831-5511-a955-e49675e72e52 with scrape type 2
2026-03-30 07:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b267b754-1831-5511-a955-e49675e72e52 with scrape type 2
2026-03-30 07:49:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b267b754-1831-5511-a955-e49675e72e52, identifier: MX11435
2026-03-30 07:49:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b267b754-1831-5511-a955-e49675e72e52 with identifier: MX11435
2026-03-30 07:49:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b267b754-1831-5511-a955-e49675e72e52 with identifier: MX11435
2026-03-30 07:49:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b267b754-1831-5511-a955-e49675e72e52 with identifier: MX11435 to the API
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:40:02Z',
 'fuel_type': 'petrol',
 'id': 'b267b754-1831-5511-a955-e49675e72e52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX11435',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 96854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT R-Line',
 'transmission': 'automatic',
 'trim': 'R-Line',
 'year': 2021}
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX11435%27 HTTP/1.1" 200 None
2026-03-30 07:49:46 [auto1.de] INFO: Saving data for MX11435: {'auction_closing_time': 1774885202.0, 'created_time': 1774639399.857022, 'last_price_update_time': 1774856986.429978}
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX11435') HTTP/1.1" 204 0
2026-03-30 07:49:46 [auto1.de] INFO: Found listing with ID: YJ21289
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ21289%27 HTTP/1.1" 200 None
2026-03-30 07:49:46 [auto1.de] INFO: Scrape type for YJ21289: 0
2026-03-30 07:49:46 [auto1.de] INFO: Found listing with ID: DK10933
2026-03-30 07:49:46 [auto1.de] INFO: Found listing with ID: GC49390
2026-03-30 07:49:46 [auto1.de] INFO: Found listing with ID: XJ84301
2026-03-30 07:49:46 [auto1.de] INFO: Found listing with ID: VW88901
2026-03-30 07:49:46 [auto1.de] INFO: Found listing with ID: EN65963
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN65963%27 HTTP/1.1" 200 None
2026-03-30 07:49:46 [auto1.de] INFO: Scrape type for EN65963: 2
2026-03-30 07:49:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 620d23e1-ab3b-5430-8f9b-d707d8cbf8ee with identifier: EN65963
2026-03-30 07:49:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 620d23e1-ab3b-5430-8f9b-d707d8cbf8ee with scrape type 2
2026-03-30 07:49:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 620d23e1-ab3b-5430-8f9b-d707d8cbf8ee with scrape type 2
2026-03-30 07:49:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 620d23e1-ab3b-5430-8f9b-d707d8cbf8ee, identifier: EN65963
2026-03-30 07:49:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 620d23e1-ab3b-5430-8f9b-d707d8cbf8ee with identifier: EN65963
2026-03-30 07:49:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 620d23e1-ab3b-5430-8f9b-d707d8cbf8ee with identifier: EN65963
2026-03-30 07:49:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 620d23e1-ab3b-5430-8f9b-d707d8cbf8ee with identifier: EN65963 to the API
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:08:38Z',
 'fuel_type': 'petrol',
 'id': '620d23e1-ab3b-5430-8f9b-d707d8cbf8ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN65963',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 70592,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-29',
 'seller_name': None,
 'title': 'Dacia Sandero 1.2 Edition FC St. Pauli',
 'transmission': 'manual',
 'trim': 'Edition FC St. Pauli',
 'year': 2010}
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN65963%27 HTTP/1.1" 200 None
2026-03-30 07:49:46 [auto1.de] INFO: Saving data for EN65963: {'auction_closing_time': 1774883318.0, 'created_time': 1774640205.013464, 'last_price_update_time': 1774856986.963796}
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN65963') HTTP/1.1" 204 0
2026-03-30 07:49:46 [auto1.de] INFO: Found listing with ID: GY78752
2026-03-30 07:49:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY78752%27 HTTP/1.1" 200 None
2026-03-30 07:49:47 [auto1.de] INFO: Scrape type for GY78752: 0
2026-03-30 07:49:47 [auto1.de] INFO: Found listing with ID: VU36237
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VU36237%27 HTTP/1.1" 200 None
2026-03-30 07:49:47 [auto1.de] INFO: Scrape type for VU36237: 0
2026-03-30 07:49:47 [auto1.de] INFO: Found listing with ID: ZY38898
2026-03-30 07:49:47 [auto1.de] INFO: Found listing with ID: WF79557
2026-03-30 07:49:47 [auto1.de] INFO: Found listing with ID: HL77152
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77152%27 HTTP/1.1" 200 None
2026-03-30 07:49:47 [auto1.de] INFO: Scrape type for HL77152: 2
2026-03-30 07:49:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e28b466-72ac-559f-a17f-22f6bd43defd with identifier: HL77152
2026-03-30 07:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e28b466-72ac-559f-a17f-22f6bd43defd with scrape type 2
2026-03-30 07:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e28b466-72ac-559f-a17f-22f6bd43defd with scrape type 2
2026-03-30 07:49:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e28b466-72ac-559f-a17f-22f6bd43defd, identifier: HL77152
2026-03-30 07:49:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e28b466-72ac-559f-a17f-22f6bd43defd with identifier: HL77152
2026-03-30 07:49:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e28b466-72ac-559f-a17f-22f6bd43defd with identifier: HL77152
2026-03-30 07:49:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e28b466-72ac-559f-a17f-22f6bd43defd with identifier: HL77152 to the API
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:59:40Z',
 'fuel_type': 'diesel',
 'id': '5e28b466-72ac-559f-a17f-22f6bd43defd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HL77152',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 125497,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T 4Matic Avantgarde',
 'transmission': 'automatic',
 'trim': 'T 4Matic Avantgarde',
 'year': 2016}
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL77152%27 HTTP/1.1" 200 None
2026-03-30 07:49:47 [auto1.de] INFO: Saving data for HL77152: {'auction_closing_time': 1774886380.0, 'created_time': 1774550421.833122, 'last_price_update_time': 1774856987.562108}
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HL77152') HTTP/1.1" 204 0
2026-03-30 07:49:47 [auto1.de] INFO: Found listing with ID: UZ43781
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ43781%27 HTTP/1.1" 200 None
2026-03-30 07:49:47 [auto1.de] INFO: Scrape type for UZ43781: 0
2026-03-30 07:49:47 [auto1.de] INFO: Found listing with ID: JS34798
2026-03-30 07:49:47 [auto1.de] INFO: Found listing with ID: TT07076
2026-03-30 07:49:47 [auto1.de] INFO: Found listing with ID: JF87432
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF87432%27 HTTP/1.1" 200 None
2026-03-30 07:49:47 [auto1.de] INFO: Scrape type for JF87432: 2
2026-03-30 07:49:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 290bc1f5-ce49-5ac6-8275-e58be0f565e3 with identifier: JF87432
2026-03-30 07:49:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 290bc1f5-ce49-5ac6-8275-e58be0f565e3 with scrape type 2
2026-03-30 07:49:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 290bc1f5-ce49-5ac6-8275-e58be0f565e3 with scrape type 2
2026-03-30 07:49:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 290bc1f5-ce49-5ac6-8275-e58be0f565e3, identifier: JF87432
2026-03-30 07:49:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 290bc1f5-ce49-5ac6-8275-e58be0f565e3 with identifier: JF87432
2026-03-30 07:49:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 290bc1f5-ce49-5ac6-8275-e58be0f565e3 with identifier: JF87432
2026-03-30 07:49:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 290bc1f5-ce49-5ac6-8275-e58be0f565e3 with identifier: JF87432 to the API
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:41:56Z',
 'fuel_type': 'diesel',
 'id': '290bc1f5-ce49-5ac6-8275-e58be0f565e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF87432',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 297258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-27',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Trend & Fun BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2013}
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JF87432%27 HTTP/1.1" 200 None
2026-03-30 07:49:48 [auto1.de] INFO: Saving data for JF87432: {'auction_closing_time': 1774885316.0, 'created_time': 1773945809.628762, 'last_price_update_time': 1774856988.111995}
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JF87432') HTTP/1.1" 204 0
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: UW42720
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: UU98141
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU98141%27 HTTP/1.1" 200 None
2026-03-30 07:49:48 [auto1.de] INFO: Scrape type for UU98141: 2
2026-03-30 07:49:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6fcb90b-e4d3-5444-9b3f-49ec22dbdd78 with identifier: UU98141
2026-03-30 07:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6fcb90b-e4d3-5444-9b3f-49ec22dbdd78 with scrape type 2
2026-03-30 07:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6fcb90b-e4d3-5444-9b3f-49ec22dbdd78 with scrape type 2
2026-03-30 07:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c6fcb90b-e4d3-5444-9b3f-49ec22dbdd78, identifier: UU98141
2026-03-30 07:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c6fcb90b-e4d3-5444-9b3f-49ec22dbdd78 with identifier: UU98141
2026-03-30 07:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c6fcb90b-e4d3-5444-9b3f-49ec22dbdd78 with identifier: UU98141
2026-03-30 07:49:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c6fcb90b-e4d3-5444-9b3f-49ec22dbdd78 with identifier: UU98141 to the API
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:59:12Z',
 'fuel_type': 'petrol',
 'id': 'c6fcb90b-e4d3-5444-9b3f-49ec22dbdd78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UU98141',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 181365,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-06',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2014}
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UU98141%27 HTTP/1.1" 200 None
2026-03-30 07:49:48 [auto1.de] INFO: Saving data for UU98141: {'auction_closing_time': 1774886352.0, 'created_time': 1774640230.033439, 'last_price_update_time': 1774856988.527118}
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UU98141') HTTP/1.1" 204 0
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: DY76053
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY76053%27 HTTP/1.1" 200 None
2026-03-30 07:49:48 [auto1.de] INFO: Scrape type for DY76053: 2
2026-03-30 07:49:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f63daae-1e59-5574-b9cd-cf436e098e79 with identifier: DY76053
2026-03-30 07:49:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f63daae-1e59-5574-b9cd-cf436e098e79 with scrape type 2
2026-03-30 07:49:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f63daae-1e59-5574-b9cd-cf436e098e79 with scrape type 2
2026-03-30 07:49:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f63daae-1e59-5574-b9cd-cf436e098e79, identifier: DY76053
2026-03-30 07:49:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f63daae-1e59-5574-b9cd-cf436e098e79 with identifier: DY76053
2026-03-30 07:49:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f63daae-1e59-5574-b9cd-cf436e098e79 with identifier: DY76053
2026-03-30 07:49:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f63daae-1e59-5574-b9cd-cf436e098e79 with identifier: DY76053 to the API
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:16:15Z',
 'fuel_type': 'diesel',
 'id': '7f63daae-1e59-5574-b9cd-cf436e098e79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DY76053',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 156628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-29',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2012}
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY76053%27 HTTP/1.1" 200 None
2026-03-30 07:49:48 [auto1.de] INFO: Saving data for DY76053: {'auction_closing_time': 1774883775.0, 'created_time': 1773383422.114786, 'last_price_update_time': 1774856988.93641}
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DY76053') HTTP/1.1" 204 0
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: CA65369
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: SD28198
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: US56502
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: TX40728
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX40728%27 HTTP/1.1" 200 None
2026-03-30 07:49:48 [auto1.de] INFO: Scrape type for TX40728: 0
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: NV48270
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: MX86281
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: EB09552
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EB09552%27 HTTP/1.1" 200 None
2026-03-30 07:49:48 [auto1.de] INFO: Scrape type for EB09552: 0
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: UJ83217
2026-03-30 07:49:48 [auto1.de] INFO: Found listing with ID: MN47186
2026-03-30 07:49:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN47186%27 HTTP/1.1" 200 None
2026-03-30 07:49:49 [auto1.de] INFO: Scrape type for MN47186: 2
2026-03-30 07:49:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 835511a6-fa16-5bdc-af5b-d4a2e0de4feb with identifier: MN47186
2026-03-30 07:49:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 835511a6-fa16-5bdc-af5b-d4a2e0de4feb with scrape type 2
2026-03-30 07:49:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 835511a6-fa16-5bdc-af5b-d4a2e0de4feb with scrape type 2
2026-03-30 07:49:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 835511a6-fa16-5bdc-af5b-d4a2e0de4feb, identifier: MN47186
2026-03-30 07:49:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 835511a6-fa16-5bdc-af5b-d4a2e0de4feb with identifier: MN47186
2026-03-30 07:49:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 835511a6-fa16-5bdc-af5b-d4a2e0de4feb with identifier: MN47186
2026-03-30 07:49:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 835511a6-fa16-5bdc-af5b-d4a2e0de4feb with identifier: MN47186 to the API
2026-03-30 07:49:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:49:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:49:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:25:26Z',
 'fuel_type': 'petrol',
 'id': '835511a6-fa16-5bdc-af5b-d4a2e0de4feb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN47186',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T-Cross',
 'odometer': 11433,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-13',
 'seller_name': None,
 'title': 'Volkswagen T-Cross 1.0 TSI Move',
 'transmission': 'manual',
 'trim': 'Move',
 'year': 2023}
2026-03-30 07:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN47186%27 HTTP/1.1" 200 None
2026-03-30 07:49:49 [auto1.de] INFO: Saving data for MN47186: {'auction_closing_time': 1774884326.0, 'created_time': 1774550133.852815, 'last_price_update_time': 1774856989.417434}
2026-03-30 07:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MN47186') HTTP/1.1" 204 0
2026-03-30 07:49:49 [auto1.de] INFO: Found listing with ID: HW30650
2026-03-30 07:49:49 [auto1.de] INFO: Found listing with ID: GJ36407
2026-03-30 07:49:49 [auto1.de] INFO: Found listing with ID: RC78323
2026-03-30 07:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:49:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC78323%27 HTTP/1.1" 200 None
2026-03-30 07:49:49 [auto1.de] INFO: Scrape type for RC78323: 0
2026-03-30 07:50:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:50:03 [auto1.de] INFO: Channel: 24h | Page: 162 | totalHits: 8410 | hits on page: 40
2026-03-30 07:50:03 [auto1.de] INFO: Found listing with ID: WX41369
2026-03-30 07:50:03 [auto1.de] INFO: Found listing with ID: ME64315
2026-03-30 07:50:03 [auto1.de] INFO: Found listing with ID: LF76340
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF76340%27 HTTP/1.1" 200 None
2026-03-30 07:50:03 [auto1.de] INFO: Scrape type for LF76340: 0
2026-03-30 07:50:03 [auto1.de] INFO: Found listing with ID: JL50388
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL50388%27 HTTP/1.1" 200 None
2026-03-30 07:50:03 [auto1.de] INFO: Scrape type for JL50388: 0
2026-03-30 07:50:03 [auto1.de] INFO: Found listing with ID: AY49158
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY49158%27 HTTP/1.1" 200 None
2026-03-30 07:50:03 [auto1.de] INFO: Scrape type for AY49158: 2
2026-03-30 07:50:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb6cedb5-c9a4-5062-b25a-f0deb0055fa2 with identifier: AY49158
2026-03-30 07:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb6cedb5-c9a4-5062-b25a-f0deb0055fa2 with scrape type 2
2026-03-30 07:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb6cedb5-c9a4-5062-b25a-f0deb0055fa2 with scrape type 2
2026-03-30 07:50:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb6cedb5-c9a4-5062-b25a-f0deb0055fa2, identifier: AY49158
2026-03-30 07:50:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb6cedb5-c9a4-5062-b25a-f0deb0055fa2 with identifier: AY49158
2026-03-30 07:50:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb6cedb5-c9a4-5062-b25a-f0deb0055fa2 with identifier: AY49158
2026-03-30 07:50:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb6cedb5-c9a4-5062-b25a-f0deb0055fa2 with identifier: AY49158 to the API
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:16:26Z',
 'fuel_type': 'petrol',
 'id': 'fb6cedb5-c9a4-5062-b25a-f0deb0055fa2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY49158',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 119612,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-12',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 EcoBoost Titanium S',
 'transmission': 'automatic',
 'trim': 'Titanium S',
 'year': 2011}
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AY49158%27 HTTP/1.1" 200 None
2026-03-30 07:50:03 [auto1.de] INFO: Saving data for AY49158: {'auction_closing_time': 1774883786.0, 'created_time': 1774638978.799299, 'last_price_update_time': 1774857003.905355}
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AY49158') HTTP/1.1" 204 0
2026-03-30 07:50:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:50:03 [auto1.de] INFO: Found listing with ID: YF72599
2026-03-30 07:50:03 [auto1.de] INFO: Found listing with ID: RC64301
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64301%27 HTTP/1.1" 200 None
2026-03-30 07:50:03 [auto1.de] INFO: Scrape type for RC64301: 0
2026-03-30 07:50:03 [auto1.de] INFO: Found listing with ID: DK89074
2026-03-30 07:50:03 [auto1.de] INFO: Found listing with ID: PS95073
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS95073%27 HTTP/1.1" 200 None
2026-03-30 07:50:03 [auto1.de] INFO: Scrape type for PS95073: 0
2026-03-30 07:50:03 [auto1.de] INFO: Found listing with ID: KV18846
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18846%27 HTTP/1.1" 200 None
2026-03-30 07:50:03 [auto1.de] INFO: Scrape type for KV18846: 2
2026-03-30 07:50:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0423db34-879f-5676-a84f-f75558f2dc2b with identifier: KV18846
2026-03-30 07:50:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0423db34-879f-5676-a84f-f75558f2dc2b with scrape type 2
2026-03-30 07:50:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0423db34-879f-5676-a84f-f75558f2dc2b with scrape type 2
2026-03-30 07:50:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0423db34-879f-5676-a84f-f75558f2dc2b, identifier: KV18846
2026-03-30 07:50:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0423db34-879f-5676-a84f-f75558f2dc2b with identifier: KV18846
2026-03-30 07:50:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0423db34-879f-5676-a84f-f75558f2dc2b with identifier: KV18846
2026-03-30 07:50:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0423db34-879f-5676-a84f-f75558f2dc2b with identifier: KV18846 to the API
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:50:12Z',
 'fuel_type': 'diesel',
 'id': '0423db34-879f-5676-a84f-f75558f2dc2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV18846',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 99197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-11-24',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Sport & Style 4Motion BlueMotion Tech',
 'year': 2013}
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18846%27 HTTP/1.1" 200 None
2026-03-30 07:50:04 [auto1.de] INFO: Saving data for KV18846: {'auction_closing_time': 1774885812.0, 'created_time': 1774637212.532229, 'last_price_update_time': 1774857004.386499}
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV18846') HTTP/1.1" 204 0
2026-03-30 07:50:04 [auto1.de] INFO: Found listing with ID: WW95477
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW95477%27 HTTP/1.1" 200 None
2026-03-30 07:50:04 [auto1.de] INFO: Scrape type for WW95477: 0
2026-03-30 07:50:04 [auto1.de] INFO: Found listing with ID: ZA79718
2026-03-30 07:50:04 [auto1.de] INFO: Found listing with ID: SX72009
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX72009%27 HTTP/1.1" 200 None
2026-03-30 07:50:04 [auto1.de] INFO: Scrape type for SX72009: 2
2026-03-30 07:50:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acbcc873-e4b0-59df-8c0f-237570c8865c with identifier: SX72009
2026-03-30 07:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acbcc873-e4b0-59df-8c0f-237570c8865c with scrape type 2
2026-03-30 07:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acbcc873-e4b0-59df-8c0f-237570c8865c with scrape type 2
2026-03-30 07:50:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acbcc873-e4b0-59df-8c0f-237570c8865c, identifier: SX72009
2026-03-30 07:50:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acbcc873-e4b0-59df-8c0f-237570c8865c with identifier: SX72009
2026-03-30 07:50:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acbcc873-e4b0-59df-8c0f-237570c8865c with identifier: SX72009
2026-03-30 07:50:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acbcc873-e4b0-59df-8c0f-237570c8865c with identifier: SX72009 to the API
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:04:50Z',
 'fuel_type': 'diesel',
 'id': 'acbcc873-e4b0-59df-8c0f-237570c8865c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX72009',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 187321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-15',
 'seller_name': None,
 'title': 'BMW 3er 320d xDrive Sport Line',
 'transmission': 'automatic',
 'trim': 'xDrive Sport Line',
 'year': 2019}
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX72009%27 HTTP/1.1" 200 None
2026-03-30 07:50:04 [auto1.de] INFO: Saving data for SX72009: {'auction_closing_time': 1774883090.0, 'created_time': 1773380569.369573, 'last_price_update_time': 1774857004.913212}
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX72009') HTTP/1.1" 204 0
2026-03-30 07:50:04 [auto1.de] INFO: Found listing with ID: YT47398
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47398%27 HTTP/1.1" 200 None
2026-03-30 07:50:04 [auto1.de] INFO: Scrape type for YT47398: 2
2026-03-30 07:50:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3200c5f3-54b2-565e-9bb2-dbc3e9612030 with identifier: YT47398
2026-03-30 07:50:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3200c5f3-54b2-565e-9bb2-dbc3e9612030 with scrape type 2
2026-03-30 07:50:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3200c5f3-54b2-565e-9bb2-dbc3e9612030 with scrape type 2
2026-03-30 07:50:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3200c5f3-54b2-565e-9bb2-dbc3e9612030, identifier: YT47398
2026-03-30 07:50:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3200c5f3-54b2-565e-9bb2-dbc3e9612030 with identifier: YT47398
2026-03-30 07:50:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3200c5f3-54b2-565e-9bb2-dbc3e9612030 with identifier: YT47398
2026-03-30 07:50:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3200c5f3-54b2-565e-9bb2-dbc3e9612030 with identifier: YT47398 to the API
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:07:22Z',
 'fuel_type': 'petrol',
 'id': '3200c5f3-54b2-565e-9bb2-dbc3e9612030',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT47398',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 60092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Join',
 'transmission': 'manual',
 'trim': 'Join',
 'year': 2018}
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT47398%27 HTTP/1.1" 200 None
2026-03-30 07:50:05 [auto1.de] INFO: Saving data for YT47398: {'auction_closing_time': 1774883242.0, 'created_time': 1774639108.967216, 'last_price_update_time': 1774857005.302816}
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT47398') HTTP/1.1" 204 0
2026-03-30 07:50:05 [auto1.de] INFO: Found listing with ID: ZA60248
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA60248%27 HTTP/1.1" 200 None
2026-03-30 07:50:05 [auto1.de] INFO: Scrape type for ZA60248: 0
2026-03-30 07:50:05 [auto1.de] INFO: Found listing with ID: SY50059
2026-03-30 07:50:05 [auto1.de] INFO: Found listing with ID: MN48285
2026-03-30 07:50:05 [auto1.de] INFO: Found listing with ID: FF62684
2026-03-30 07:50:05 [auto1.de] INFO: Found listing with ID: VG18386
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG18386%27 HTTP/1.1" 200 None
2026-03-30 07:50:05 [auto1.de] INFO: Scrape type for VG18386: 0
2026-03-30 07:50:05 [auto1.de] INFO: Found listing with ID: PP24406
2026-03-30 07:50:05 [auto1.de] INFO: Found listing with ID: FM50450
2026-03-30 07:50:05 [auto1.de] INFO: Found listing with ID: MZ72093
2026-03-30 07:50:05 [auto1.de] INFO: Found listing with ID: BB52240
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB52240%27 HTTP/1.1" 200 None
2026-03-30 07:50:05 [auto1.de] INFO: Scrape type for BB52240: 2
2026-03-30 07:50:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a35afb30-bcf9-53ad-b497-284f3b630062 with identifier: BB52240
2026-03-30 07:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a35afb30-bcf9-53ad-b497-284f3b630062 with scrape type 2
2026-03-30 07:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a35afb30-bcf9-53ad-b497-284f3b630062 with scrape type 2
2026-03-30 07:50:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a35afb30-bcf9-53ad-b497-284f3b630062, identifier: BB52240
2026-03-30 07:50:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a35afb30-bcf9-53ad-b497-284f3b630062 with identifier: BB52240
2026-03-30 07:50:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a35afb30-bcf9-53ad-b497-284f3b630062 with identifier: BB52240
2026-03-30 07:50:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a35afb30-bcf9-53ad-b497-284f3b630062 with identifier: BB52240 to the API
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:06:42Z',
 'fuel_type': 'diesel',
 'id': 'a35afb30-bcf9-53ad-b497-284f3b630062',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB52240',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 181540,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-17',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2014}
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB52240%27 HTTP/1.1" 200 None
2026-03-30 07:50:05 [auto1.de] INFO: Saving data for BB52240: {'auction_closing_time': 1774883202.0, 'created_time': 1774550628.1235, 'last_price_update_time': 1774857005.736844}
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BB52240') HTTP/1.1" 204 0
2026-03-30 07:50:05 [auto1.de] INFO: Found listing with ID: RK52419
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK52419%27 HTTP/1.1" 200 None
2026-03-30 07:50:05 [auto1.de] INFO: Scrape type for RK52419: 2
2026-03-30 07:50:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9408314-0b28-5ea1-924e-ff1403f012eb with identifier: RK52419
2026-03-30 07:50:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9408314-0b28-5ea1-924e-ff1403f012eb with scrape type 2
2026-03-30 07:50:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9408314-0b28-5ea1-924e-ff1403f012eb with scrape type 2
2026-03-30 07:50:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c9408314-0b28-5ea1-924e-ff1403f012eb, identifier: RK52419
2026-03-30 07:50:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c9408314-0b28-5ea1-924e-ff1403f012eb with identifier: RK52419
2026-03-30 07:50:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c9408314-0b28-5ea1-924e-ff1403f012eb with identifier: RK52419
2026-03-30 07:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c9408314-0b28-5ea1-924e-ff1403f012eb with identifier: RK52419 to the API
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:49:49Z',
 'fuel_type': 'petrol',
 'id': 'c9408314-0b28-5ea1-924e-ff1403f012eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK52419',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 99333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-19',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2013}
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK52419%27 HTTP/1.1" 200 None
2026-03-30 07:50:06 [auto1.de] INFO: Saving data for RK52419: {'auction_closing_time': 1774885789.0, 'created_time': 1774676129.399794, 'last_price_update_time': 1774857006.269275}
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK52419') HTTP/1.1" 204 0
2026-03-30 07:50:06 [auto1.de] INFO: Found listing with ID: TB77095
2026-03-30 07:50:06 [auto1.de] INFO: Found listing with ID: DP80486
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP80486%27 HTTP/1.1" 200 None
2026-03-30 07:50:06 [auto1.de] INFO: Scrape type for DP80486: 2
2026-03-30 07:50:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 507575d1-f2a2-596f-b09d-26134eb16301 with identifier: DP80486
2026-03-30 07:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 507575d1-f2a2-596f-b09d-26134eb16301 with scrape type 2
2026-03-30 07:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 507575d1-f2a2-596f-b09d-26134eb16301 with scrape type 2
2026-03-30 07:50:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 507575d1-f2a2-596f-b09d-26134eb16301, identifier: DP80486
2026-03-30 07:50:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 507575d1-f2a2-596f-b09d-26134eb16301 with identifier: DP80486
2026-03-30 07:50:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 507575d1-f2a2-596f-b09d-26134eb16301 with identifier: DP80486
2026-03-30 07:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 507575d1-f2a2-596f-b09d-26134eb16301 with identifier: DP80486 to the API
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:54:23Z',
 'fuel_type': 'diesel',
 'id': '507575d1-f2a2-596f-b09d-26134eb16301',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DP80486',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira',
 'odometer': 95994,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-04',
 'seller_name': None,
 'title': 'Opel Zafira 1.7 CDTI Innovation',
 'transmission': 'manual',
 'trim': 'Innovation',
 'year': 2011}
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP80486%27 HTTP/1.1" 200 None
2026-03-30 07:50:06 [auto1.de] INFO: Saving data for DP80486: {'auction_closing_time': 1774886063.0, 'created_time': 1774639855.285206, 'last_price_update_time': 1774857006.684792}
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DP80486') HTTP/1.1" 204 0
2026-03-30 07:50:06 [auto1.de] INFO: Found listing with ID: YU21879
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU21879%27 HTTP/1.1" 200 None
2026-03-30 07:50:06 [auto1.de] INFO: Scrape type for YU21879: 0
2026-03-30 07:50:06 [auto1.de] INFO: Found listing with ID: HL71363
2026-03-30 07:50:06 [auto1.de] INFO: Found listing with ID: YB40017
2026-03-30 07:50:06 [auto1.de] INFO: Found listing with ID: HD93241
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD93241%27 HTTP/1.1" 200 None
2026-03-30 07:50:06 [auto1.de] INFO: Scrape type for HD93241: 0
2026-03-30 07:50:06 [auto1.de] INFO: Found listing with ID: US92808
2026-03-30 07:50:06 [auto1.de] INFO: Found listing with ID: ZS15843
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS15843%27 HTTP/1.1" 200 None
2026-03-30 07:50:06 [auto1.de] INFO: Scrape type for ZS15843: 0
2026-03-30 07:50:06 [auto1.de] INFO: Found listing with ID: FZ89308
2026-03-30 07:50:06 [auto1.de] INFO: Found listing with ID: HL98851
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL98851%27 HTTP/1.1" 200 None
2026-03-30 07:50:06 [auto1.de] INFO: Scrape type for HL98851: 0
2026-03-30 07:50:06 [auto1.de] INFO: Found listing with ID: ZG82631
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG82631%27 HTTP/1.1" 200 None
2026-03-30 07:50:06 [auto1.de] INFO: Scrape type for ZG82631: 2
2026-03-30 07:50:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53c05ec9-2ef6-597a-ac8a-499238be3ae0 with identifier: ZG82631
2026-03-30 07:50:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53c05ec9-2ef6-597a-ac8a-499238be3ae0 with scrape type 2
2026-03-30 07:50:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53c05ec9-2ef6-597a-ac8a-499238be3ae0 with scrape type 2
2026-03-30 07:50:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53c05ec9-2ef6-597a-ac8a-499238be3ae0, identifier: ZG82631
2026-03-30 07:50:06 [scrapy.extensions.logstats] INFO: Crawled 358 pages (at 9 pages/min), scraped 1204 items (at 86 items/min)
2026-03-30 07:50:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:50:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53c05ec9-2ef6-597a-ac8a-499238be3ae0 with identifier: ZG82631
2026-03-30 07:50:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53c05ec9-2ef6-597a-ac8a-499238be3ae0 with identifier: ZG82631
2026-03-30 07:50:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53c05ec9-2ef6-597a-ac8a-499238be3ae0 with identifier: ZG82631 to the API
2026-03-30 07:50:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:14:31Z',
 'fuel_type': 'diesel',
 'id': '53c05ec9-2ef6-597a-ac8a-499238be3ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG82631',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 140259,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-29',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2013}
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG82631%27 HTTP/1.1" 200 None
2026-03-30 07:50:07 [auto1.de] INFO: Saving data for ZG82631: {'auction_closing_time': 1774883671.0, 'created_time': 1774638650.478146, 'last_price_update_time': 1774857007.164254}
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZG82631') HTTP/1.1" 204 0
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: WR57027
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR57027%27 HTTP/1.1" 200 None
2026-03-30 07:50:07 [auto1.de] INFO: Scrape type for WR57027: 0
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: SG17640
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: GT14298
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT14298%27 HTTP/1.1" 200 None
2026-03-30 07:50:07 [auto1.de] INFO: Scrape type for GT14298: 0
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: KV33048
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33048%27 HTTP/1.1" 200 None
2026-03-30 07:50:07 [auto1.de] INFO: Scrape type for KV33048: 2
2026-03-30 07:50:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with identifier: KV33048
2026-03-30 07:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with scrape type 2
2026-03-30 07:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with scrape type 2
2026-03-30 07:50:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: afacaa44-7570-5bbc-b22c-407a3e8d3fb2, identifier: KV33048
2026-03-30 07:50:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with identifier: KV33048
2026-03-30 07:50:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with identifier: KV33048
2026-03-30 07:50:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: afacaa44-7570-5bbc-b22c-407a3e8d3fb2 with identifier: KV33048 to the API
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:47:42Z',
 'fuel_type': 'diesel',
 'id': 'afacaa44-7570-5bbc-b22c-407a3e8d3fb2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV33048',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Wrangler Unlimited',
 'odometer': 105214,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-06',
 'seller_name': None,
 'title': 'Jeep Wrangler Unlimited 2.2 CRDi Sahara',
 'transmission': 'automatic',
 'trim': 'Sahara',
 'year': 2019}
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33048%27 HTTP/1.1" 200 None
2026-03-30 07:50:07 [auto1.de] INFO: Saving data for KV33048: {'auction_closing_time': 1774885662.0, 'created_time': 1774551412.786391, 'last_price_update_time': 1774857007.699251}
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KV33048') HTTP/1.1" 204 0
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: JZ53783
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ53783%27 HTTP/1.1" 200 None
2026-03-30 07:50:07 [auto1.de] INFO: Scrape type for JZ53783: 0
2026-03-30 07:50:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:50:07 [auto1.de] INFO: Channel: 24h | Page: 163 | totalHits: 8410 | hits on page: 40
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: WW27642
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: JC18235
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: SM51050
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: EY51453
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: HP12091
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: JH55559
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH55559%27 HTTP/1.1" 200 None
2026-03-30 07:50:07 [auto1.de] INFO: Scrape type for JH55559: 0
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: RS52276
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: CJ75518
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ75518%27 HTTP/1.1" 200 None
2026-03-30 07:50:07 [auto1.de] INFO: Scrape type for CJ75518: 0
2026-03-30 07:50:07 [auto1.de] INFO: Found listing with ID: JB80015
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80015%27 HTTP/1.1" 200 None
2026-03-30 07:50:07 [auto1.de] INFO: Scrape type for JB80015: 2
2026-03-30 07:50:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8109904a-f3f8-5b13-b734-9ac3cba101c0 with identifier: JB80015
2026-03-30 07:50:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8109904a-f3f8-5b13-b734-9ac3cba101c0 with scrape type 2
2026-03-30 07:50:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8109904a-f3f8-5b13-b734-9ac3cba101c0 with scrape type 2
2026-03-30 07:50:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8109904a-f3f8-5b13-b734-9ac3cba101c0, identifier: JB80015
2026-03-30 07:50:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8109904a-f3f8-5b13-b734-9ac3cba101c0 with identifier: JB80015
2026-03-30 07:50:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8109904a-f3f8-5b13-b734-9ac3cba101c0 with identifier: JB80015
2026-03-30 07:50:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8109904a-f3f8-5b13-b734-9ac3cba101c0 with identifier: JB80015 to the API
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:27:07Z',
 'fuel_type': 'petrol',
 'id': '8109904a-f3f8-5b13-b734-9ac3cba101c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB80015',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 227451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-01',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB80015%27 HTTP/1.1" 200 None
2026-03-30 07:50:08 [auto1.de] INFO: Saving data for JB80015: {'auction_closing_time': 1774884427.0, 'created_time': 1774551449.937392, 'last_price_update_time': 1774857008.377044}
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JB80015') HTTP/1.1" 204 0
2026-03-30 07:50:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:50:08 [auto1.de] INFO: Found listing with ID: DV93424
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV93424%27 HTTP/1.1" 200 None
2026-03-30 07:50:08 [auto1.de] INFO: Scrape type for DV93424: 0
2026-03-30 07:50:08 [auto1.de] INFO: Found listing with ID: RF75953
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF75953%27 HTTP/1.1" 200 None
2026-03-30 07:50:08 [auto1.de] INFO: Scrape type for RF75953: 0
2026-03-30 07:50:08 [auto1.de] INFO: Found listing with ID: DR32988
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DR32988%27 HTTP/1.1" 200 None
2026-03-30 07:50:08 [auto1.de] INFO: Scrape type for DR32988: 0
2026-03-30 07:50:08 [auto1.de] INFO: Found listing with ID: SJ02075
2026-03-30 07:50:08 [auto1.de] INFO: Found listing with ID: JX09791
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX09791%27 HTTP/1.1" 200 None
2026-03-30 07:50:08 [auto1.de] INFO: Scrape type for JX09791: 0
2026-03-30 07:50:08 [auto1.de] INFO: Found listing with ID: ZW18782
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW18782%27 HTTP/1.1" 200 None
2026-03-30 07:50:08 [auto1.de] INFO: Scrape type for ZW18782: 2
2026-03-30 07:50:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fc7479b-88b2-5fbd-baa8-34a371aab012 with identifier: ZW18782
2026-03-30 07:50:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fc7479b-88b2-5fbd-baa8-34a371aab012 with scrape type 2
2026-03-30 07:50:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fc7479b-88b2-5fbd-baa8-34a371aab012 with scrape type 2
2026-03-30 07:50:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8fc7479b-88b2-5fbd-baa8-34a371aab012, identifier: ZW18782
2026-03-30 07:50:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8fc7479b-88b2-5fbd-baa8-34a371aab012 with identifier: ZW18782
2026-03-30 07:50:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8fc7479b-88b2-5fbd-baa8-34a371aab012 with identifier: ZW18782
2026-03-30 07:50:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8fc7479b-88b2-5fbd-baa8-34a371aab012 with identifier: ZW18782 to the API
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:15:48Z',
 'fuel_type': 'petrol',
 'id': '8fc7479b-88b2-5fbd-baa8-34a371aab012',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW18782',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '108',
 'odometer': 69765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-30',
 'seller_name': None,
 'title': 'Peugeot 108 1.0 VTi TOP Style',
 'transmission': 'manual',
 'trim': 'TOP Style',
 'year': 2018}
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW18782%27 HTTP/1.1" 200 None
2026-03-30 07:50:08 [auto1.de] INFO: Saving data for ZW18782: {'auction_closing_time': 1774883748.0, 'created_time': 1774552665.208495, 'last_price_update_time': 1774857008.971715}
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZW18782') HTTP/1.1" 204 0
2026-03-30 07:50:08 [auto1.de] INFO: Found listing with ID: JX92669
2026-03-30 07:50:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX92669%27 HTTP/1.1" 200 None
2026-03-30 07:50:09 [auto1.de] INFO: Scrape type for JX92669: 2
2026-03-30 07:50:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec431d76-c3b6-5f9c-a1e1-a347ffaba50d with identifier: JX92669
2026-03-30 07:50:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec431d76-c3b6-5f9c-a1e1-a347ffaba50d with scrape type 2
2026-03-30 07:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec431d76-c3b6-5f9c-a1e1-a347ffaba50d with scrape type 2
2026-03-30 07:50:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ec431d76-c3b6-5f9c-a1e1-a347ffaba50d, identifier: JX92669
2026-03-30 07:50:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ec431d76-c3b6-5f9c-a1e1-a347ffaba50d with identifier: JX92669
2026-03-30 07:50:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ec431d76-c3b6-5f9c-a1e1-a347ffaba50d with identifier: JX92669
2026-03-30 07:50:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ec431d76-c3b6-5f9c-a1e1-a347ffaba50d with identifier: JX92669 to the API
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:02:26Z',
 'fuel_type': 'petrol',
 'id': 'ec431d76-c3b6-5f9c-a1e1-a347ffaba50d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX92669',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 150879,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-18',
 'seller_name': None,
 'title': 'Seat Mii 1.0 Style Salsa',
 'transmission': 'manual',
 'trim': 'Style Salsa',
 'year': 2013}
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JX92669%27 HTTP/1.1" 200 None
2026-03-30 07:50:09 [auto1.de] INFO: Saving data for JX92669: {'auction_closing_time': 1774882946.0, 'created_time': 1774639697.058037, 'last_price_update_time': 1774857009.400225}
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JX92669') HTTP/1.1" 204 0
2026-03-30 07:50:09 [auto1.de] INFO: Found listing with ID: RH01499
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH01499%27 HTTP/1.1" 200 None
2026-03-30 07:50:09 [auto1.de] INFO: Scrape type for RH01499: 2
2026-03-30 07:50:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30c1bd33-28d0-5423-bc22-847da88486c6 with identifier: RH01499
2026-03-30 07:50:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30c1bd33-28d0-5423-bc22-847da88486c6 with scrape type 2
2026-03-30 07:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 30c1bd33-28d0-5423-bc22-847da88486c6 with scrape type 2
2026-03-30 07:50:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 30c1bd33-28d0-5423-bc22-847da88486c6, identifier: RH01499
2026-03-30 07:50:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 30c1bd33-28d0-5423-bc22-847da88486c6 with identifier: RH01499
2026-03-30 07:50:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 30c1bd33-28d0-5423-bc22-847da88486c6 with identifier: RH01499
2026-03-30 07:50:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 30c1bd33-28d0-5423-bc22-847da88486c6 with identifier: RH01499 to the API
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 295,
 'expiration_date': '2026-03-30T15:49:22Z',
 'fuel_type': 'petrol',
 'id': '30c1bd33-28d0-5423-bc22-847da88486c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RH01499',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayman',
 'odometer': 155476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-09',
 'seller_name': None,
 'title': 'Porsche Cayman S',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH01499%27 HTTP/1.1" 200 None
2026-03-30 07:50:09 [auto1.de] INFO: Saving data for RH01499: {'auction_closing_time': 1774885762.0, 'created_time': 1773226700.403692, 'last_price_update_time': 1774857009.839996}
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RH01499') HTTP/1.1" 204 0
2026-03-30 07:50:09 [auto1.de] INFO: Found listing with ID: JV37620
2026-03-30 07:50:09 [auto1.de] INFO: Found listing with ID: KJ60236
2026-03-30 07:50:09 [auto1.de] INFO: Found listing with ID: UJ55086
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ55086%27 HTTP/1.1" 200 None
2026-03-30 07:50:09 [auto1.de] INFO: Scrape type for UJ55086: 0
2026-03-30 07:50:09 [auto1.de] INFO: Found listing with ID: HU68423
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68423%27 HTTP/1.1" 200 None
2026-03-30 07:50:09 [auto1.de] INFO: Scrape type for HU68423: 2
2026-03-30 07:50:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 151e62f5-794d-52db-ac20-aa24539d1514 with identifier: HU68423
2026-03-30 07:50:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 151e62f5-794d-52db-ac20-aa24539d1514 with scrape type 2
2026-03-30 07:50:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 151e62f5-794d-52db-ac20-aa24539d1514 with scrape type 2
2026-03-30 07:50:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 151e62f5-794d-52db-ac20-aa24539d1514, identifier: HU68423
2026-03-30 07:50:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 151e62f5-794d-52db-ac20-aa24539d1514 with identifier: HU68423
2026-03-30 07:50:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 151e62f5-794d-52db-ac20-aa24539d1514 with identifier: HU68423
2026-03-30 07:50:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 151e62f5-794d-52db-ac20-aa24539d1514 with identifier: HU68423 to the API
2026-03-30 07:50:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:45:06Z',
 'fuel_type': 'diesel',
 'id': '151e62f5-794d-52db-ac20-aa24539d1514',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HU68423',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 171176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-19',
 'seller_name': None,
 'title': 'Skoda Roomster 1.6 TDI Elegance Plus Edition',
 'transmission': 'manual',
 'trim': 'Elegance Plus Edition',
 'year': 2014}
2026-03-30 07:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU68423%27 HTTP/1.1" 200 None
2026-03-30 07:50:10 [auto1.de] INFO: Saving data for HU68423: {'auction_closing_time': 1774885506.0, 'created_time': 1774550961.878984, 'last_price_update_time': 1774857010.307354}
2026-03-30 07:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HU68423') HTTP/1.1" 204 0
2026-03-30 07:50:10 [auto1.de] INFO: Found listing with ID: CT22641
2026-03-30 07:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT22641%27 HTTP/1.1" 200 None
2026-03-30 07:50:10 [auto1.de] INFO: Scrape type for CT22641: 2
2026-03-30 07:50:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04d93696-36c0-5c3b-9f8d-c763a797c5a4 with identifier: CT22641
2026-03-30 07:50:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04d93696-36c0-5c3b-9f8d-c763a797c5a4 with scrape type 2
2026-03-30 07:50:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04d93696-36c0-5c3b-9f8d-c763a797c5a4 with scrape type 2
2026-03-30 07:50:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 04d93696-36c0-5c3b-9f8d-c763a797c5a4, identifier: CT22641
2026-03-30 07:50:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 04d93696-36c0-5c3b-9f8d-c763a797c5a4 with identifier: CT22641
2026-03-30 07:50:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 04d93696-36c0-5c3b-9f8d-c763a797c5a4 with identifier: CT22641
2026-03-30 07:50:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 04d93696-36c0-5c3b-9f8d-c763a797c5a4 with identifier: CT22641 to the API
2026-03-30 07:50:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:57:59Z',
 'fuel_type': 'petrol',
 'id': '04d93696-36c0-5c3b-9f8d-c763a797c5a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT22641',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 120357,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-28',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2012}
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT22641%27 HTTP/1.1" 200 None
2026-03-30 07:50:11 [auto1.de] INFO: Saving data for CT22641: {'auction_closing_time': 1774886279.0, 'created_time': 1774637233.546439, 'last_price_update_time': 1774857011.370297}
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CT22641') HTTP/1.1" 204 0
2026-03-30 07:50:11 [auto1.de] INFO: Found listing with ID: UE90964
2026-03-30 07:50:11 [auto1.de] INFO: Found listing with ID: VL46030
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL46030%27 HTTP/1.1" 200 None
2026-03-30 07:50:11 [auto1.de] INFO: Scrape type for VL46030: 0
2026-03-30 07:50:11 [auto1.de] INFO: Found listing with ID: NT88605
2026-03-30 07:50:11 [auto1.de] INFO: Found listing with ID: JU04620
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU04620%27 HTTP/1.1" 200 None
2026-03-30 07:50:11 [auto1.de] INFO: Scrape type for JU04620: 0
2026-03-30 07:50:11 [auto1.de] INFO: Found listing with ID: JG45711
2026-03-30 07:50:11 [auto1.de] INFO: Found listing with ID: FY09014
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY09014%27 HTTP/1.1" 200 None
2026-03-30 07:50:11 [auto1.de] INFO: Scrape type for FY09014: 2
2026-03-30 07:50:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed77048c-47dc-5ff5-9d26-453010634a67 with identifier: FY09014
2026-03-30 07:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed77048c-47dc-5ff5-9d26-453010634a67 with scrape type 2
2026-03-30 07:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed77048c-47dc-5ff5-9d26-453010634a67 with scrape type 2
2026-03-30 07:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ed77048c-47dc-5ff5-9d26-453010634a67, identifier: FY09014
2026-03-30 07:50:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ed77048c-47dc-5ff5-9d26-453010634a67 with identifier: FY09014
2026-03-30 07:50:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ed77048c-47dc-5ff5-9d26-453010634a67 with identifier: FY09014
2026-03-30 07:50:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ed77048c-47dc-5ff5-9d26-453010634a67 with identifier: FY09014 to the API
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:47:14Z',
 'fuel_type': 'petrol',
 'id': 'ed77048c-47dc-5ff5-9d26-453010634a67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY09014',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 116039,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-18',
 'seller_name': None,
 'title': 'Suzuki SX4 1.6 Comfort 4x4',
 'transmission': 'automatic',
 'trim': 'Comfort 4x4',
 'year': 2015}
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY09014%27 HTTP/1.1" 200 None
2026-03-30 07:50:11 [auto1.de] INFO: Saving data for FY09014: {'auction_closing_time': 1774885634.0, 'created_time': 1774639813.357161, 'last_price_update_time': 1774857011.803255}
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FY09014') HTTP/1.1" 204 0
2026-03-30 07:50:11 [auto1.de] INFO: Found listing with ID: AF99280
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF99280%27 HTTP/1.1" 200 None
2026-03-30 07:50:11 [auto1.de] INFO: Scrape type for AF99280: 2
2026-03-30 07:50:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5877953-b16b-56e5-8252-3f10bfb6766e with identifier: AF99280
2026-03-30 07:50:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5877953-b16b-56e5-8252-3f10bfb6766e with scrape type 2
2026-03-30 07:50:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5877953-b16b-56e5-8252-3f10bfb6766e with scrape type 2
2026-03-30 07:50:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5877953-b16b-56e5-8252-3f10bfb6766e, identifier: AF99280
2026-03-30 07:50:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5877953-b16b-56e5-8252-3f10bfb6766e with identifier: AF99280
2026-03-30 07:50:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5877953-b16b-56e5-8252-3f10bfb6766e with identifier: AF99280
2026-03-30 07:50:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5877953-b16b-56e5-8252-3f10bfb6766e with identifier: AF99280 to the API
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-30T15:18:21Z',
 'fuel_type': 'hybrid',
 'id': 'c5877953-b16b-56e5-8252-3f10bfb6766e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF99280',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 68239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-16',
 'seller_name': None,
 'title': 'Toyota Yaris 1.5 Hybrid Life',
 'transmission': 'automatic',
 'trim': 'Life',
 'year': 2013}
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF99280%27 HTTP/1.1" 200 None
2026-03-30 07:50:12 [auto1.de] INFO: Saving data for AF99280: {'auction_closing_time': 1774883901.0, 'created_time': 1774553045.436158, 'last_price_update_time': 1774857012.198326}
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AF99280') HTTP/1.1" 204 0
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: LH30739
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: WS48459
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: GX96959
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX96959%27 HTTP/1.1" 200 None
2026-03-30 07:50:12 [auto1.de] INFO: Scrape type for GX96959: 2
2026-03-30 07:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf3a2567-a66d-5f9b-8885-e73944e4abec with identifier: GX96959
2026-03-30 07:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf3a2567-a66d-5f9b-8885-e73944e4abec with scrape type 2
2026-03-30 07:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf3a2567-a66d-5f9b-8885-e73944e4abec with scrape type 2
2026-03-30 07:50:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cf3a2567-a66d-5f9b-8885-e73944e4abec, identifier: GX96959
2026-03-30 07:50:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:50:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cf3a2567-a66d-5f9b-8885-e73944e4abec with identifier: GX96959
2026-03-30 07:50:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cf3a2567-a66d-5f9b-8885-e73944e4abec with identifier: GX96959
2026-03-30 07:50:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cf3a2567-a66d-5f9b-8885-e73944e4abec with identifier: GX96959 to the API
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:51:09Z',
 'fuel_type': 'diesel',
 'id': 'cf3a2567-a66d-5f9b-8885-e73944e4abec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX96959',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'F-Pace',
 'odometer': 114799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-02',
 'seller_name': None,
 'title': 'Jaguar F-Pace 20d Prestige AWD',
 'transmission': 'automatic',
 'trim': 'Prestige AWD',
 'year': 2016}
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX96959%27 HTTP/1.1" 200 None
2026-03-30 07:50:12 [auto1.de] INFO: Saving data for GX96959: {'auction_closing_time': 1774885869.0, 'created_time': 1774639833.181285, 'last_price_update_time': 1774857012.615368}
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX96959') HTTP/1.1" 204 0
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: TL69510
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: DP54088
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: XN32134
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: PC42452
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: NY09817
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: YH26863
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: EC38320
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: VK72696
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK72696%27 HTTP/1.1" 200 None
2026-03-30 07:50:12 [auto1.de] INFO: Scrape type for VK72696: 0
2026-03-30 07:50:12 [auto1.de] INFO: Channel: 24h | Page: 164 | totalHits: 8410 | hits on page: 40
2026-03-30 07:50:12 [auto1.de] INFO: Found listing with ID: NM81365
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM81365%27 HTTP/1.1" 200 None
2026-03-30 07:50:12 [auto1.de] INFO: Scrape type for NM81365: 2
2026-03-30 07:50:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408eda9c-392c-5008-911c-fc7c62ed5127 with identifier: NM81365
2026-03-30 07:50:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 408eda9c-392c-5008-911c-fc7c62ed5127 with scrape type 2
2026-03-30 07:50:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 408eda9c-392c-5008-911c-fc7c62ed5127 with scrape type 2
2026-03-30 07:50:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 408eda9c-392c-5008-911c-fc7c62ed5127, identifier: NM81365
2026-03-30 07:50:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 408eda9c-392c-5008-911c-fc7c62ed5127 with identifier: NM81365
2026-03-30 07:50:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 408eda9c-392c-5008-911c-fc7c62ed5127 with identifier: NM81365
2026-03-30 07:50:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 408eda9c-392c-5008-911c-fc7c62ed5127 with identifier: NM81365 to the API
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:57:27Z',
 'fuel_type': 'diesel',
 'id': '408eda9c-392c-5008-911c-fc7c62ed5127',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM81365',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 119516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-25',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2018}
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM81365%27 HTTP/1.1" 200 None
2026-03-30 07:50:13 [auto1.de] INFO: Saving data for NM81365: {'auction_closing_time': 1774886247.0, 'created_time': 1773138814.889971, 'last_price_update_time': 1774857013.896002}
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NM81365') HTTP/1.1" 204 0
2026-03-30 07:50:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:50:13 [auto1.de] INFO: Found listing with ID: NP49973
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP49973%27 HTTP/1.1" 200 None
2026-03-30 07:50:13 [auto1.de] INFO: Scrape type for NP49973: 0
2026-03-30 07:50:13 [auto1.de] INFO: Found listing with ID: PD95192
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PD95192%27 HTTP/1.1" 200 None
2026-03-30 07:50:13 [auto1.de] INFO: Scrape type for PD95192: 0
2026-03-30 07:50:13 [auto1.de] INFO: Found listing with ID: BX11616
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11616%27 HTTP/1.1" 200 None
2026-03-30 07:50:13 [auto1.de] INFO: Scrape type for BX11616: 2
2026-03-30 07:50:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b757fcb3-292a-5e0f-8109-9a518317e0c2 with identifier: BX11616
2026-03-30 07:50:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b757fcb3-292a-5e0f-8109-9a518317e0c2 with scrape type 2
2026-03-30 07:50:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b757fcb3-292a-5e0f-8109-9a518317e0c2 with scrape type 2
2026-03-30 07:50:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b757fcb3-292a-5e0f-8109-9a518317e0c2, identifier: BX11616
2026-03-30 07:50:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b757fcb3-292a-5e0f-8109-9a518317e0c2 with identifier: BX11616
2026-03-30 07:50:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b757fcb3-292a-5e0f-8109-9a518317e0c2 with identifier: BX11616
2026-03-30 07:50:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b757fcb3-292a-5e0f-8109-9a518317e0c2 with identifier: BX11616 to the API
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:06:39Z',
 'fuel_type': 'petrol',
 'id': 'b757fcb3-292a-5e0f-8109-9a518317e0c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX11616',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Rapid Spaceback',
 'odometer': 223489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-08',
 'seller_name': None,
 'title': 'Skoda Rapid Spaceback 1.2 TSI Drive',
 'transmission': 'manual',
 'trim': 'Drive',
 'year': 2014}
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX11616%27 HTTP/1.1" 200 None
2026-03-30 07:50:14 [auto1.de] INFO: Saving data for BX11616: {'auction_closing_time': 1774883199.0, 'created_time': 1774034786.973858, 'last_price_update_time': 1774857014.327467}
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX11616') HTTP/1.1" 204 0
2026-03-30 07:50:14 [auto1.de] INFO: Found listing with ID: FE82761
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE82761%27 HTTP/1.1" 200 None
2026-03-30 07:50:14 [auto1.de] INFO: Scrape type for FE82761: 2
2026-03-30 07:50:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99b1647f-9522-5446-952b-0baaac3fa3b2 with identifier: FE82761
2026-03-30 07:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99b1647f-9522-5446-952b-0baaac3fa3b2 with scrape type 2
2026-03-30 07:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99b1647f-9522-5446-952b-0baaac3fa3b2 with scrape type 2
2026-03-30 07:50:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 99b1647f-9522-5446-952b-0baaac3fa3b2, identifier: FE82761
2026-03-30 07:50:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 99b1647f-9522-5446-952b-0baaac3fa3b2 with identifier: FE82761
2026-03-30 07:50:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 99b1647f-9522-5446-952b-0baaac3fa3b2 with identifier: FE82761
2026-03-30 07:50:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 99b1647f-9522-5446-952b-0baaac3fa3b2 with identifier: FE82761 to the API
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:28:12Z',
 'fuel_type': 'diesel',
 'id': '99b1647f-9522-5446-952b-0baaac3fa3b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE82761',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Zafira Life',
 'odometer': 104317,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-09',
 'seller_name': None,
 'title': 'Opel Zafira Life 2.0 CDTI L Tourer L3',
 'transmission': 'automatic',
 'trim': 'L Tourer L3',
 'year': 2020}
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE82761%27 HTTP/1.1" 200 None
2026-03-30 07:50:14 [auto1.de] INFO: Saving data for FE82761: {'auction_closing_time': 1774884492.0, 'created_time': 1773946808.054951, 'last_price_update_time': 1774857014.948546}
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FE82761') HTTP/1.1" 204 0
2026-03-30 07:50:14 [auto1.de] INFO: Found listing with ID: SW40365
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW40365%27 HTTP/1.1" 200 None
2026-03-30 07:50:14 [auto1.de] INFO: Scrape type for SW40365: 0
2026-03-30 07:50:14 [auto1.de] INFO: Found listing with ID: RP99262
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP99262%27 HTTP/1.1" 200 None
2026-03-30 07:50:14 [auto1.de] INFO: Scrape type for RP99262: 2
2026-03-30 07:50:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fff50bb8-2600-5d89-b886-71de4357b4f6 with identifier: RP99262
2026-03-30 07:50:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff50bb8-2600-5d89-b886-71de4357b4f6 with scrape type 2
2026-03-30 07:50:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fff50bb8-2600-5d89-b886-71de4357b4f6 with scrape type 2
2026-03-30 07:50:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fff50bb8-2600-5d89-b886-71de4357b4f6, identifier: RP99262
2026-03-30 07:50:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fff50bb8-2600-5d89-b886-71de4357b4f6 with identifier: RP99262
2026-03-30 07:50:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fff50bb8-2600-5d89-b886-71de4357b4f6 with identifier: RP99262
2026-03-30 07:50:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fff50bb8-2600-5d89-b886-71de4357b4f6 with identifier: RP99262 to the API
2026-03-30 07:50:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:15:03Z',
 'fuel_type': 'diesel',
 'id': 'fff50bb8-2600-5d89-b886-71de4357b4f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP99262',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 266146,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-07',
 'seller_name': None,
 'title': 'BMW 3er 325d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-30 07:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP99262%27 HTTP/1.1" 200 None
2026-03-30 07:50:15 [auto1.de] INFO: Saving data for RP99262: {'auction_closing_time': 1774883703.0, 'created_time': 1773224560.259007, 'last_price_update_time': 1774857015.700472}
2026-03-30 07:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RP99262') HTTP/1.1" 204 0
2026-03-30 07:50:15 [auto1.de] INFO: Found listing with ID: KL73476
2026-03-30 07:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL73476%27 HTTP/1.1" 200 None
2026-03-30 07:50:15 [auto1.de] INFO: Scrape type for KL73476: 0
2026-03-30 07:50:15 [auto1.de] INFO: Found listing with ID: NV84583
2026-03-30 07:50:15 [auto1.de] INFO: Found listing with ID: ER69054
2026-03-30 07:50:15 [auto1.de] INFO: Found listing with ID: TA30893
2026-03-30 07:50:15 [auto1.de] INFO: Found listing with ID: DH72575
2026-03-30 07:50:15 [auto1.de] INFO: Found listing with ID: UP40831
2026-03-30 07:50:15 [auto1.de] INFO: Found listing with ID: UY98084
2026-03-30 07:50:15 [auto1.de] INFO: Found listing with ID: BR43966
2026-03-30 07:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR43966%27 HTTP/1.1" 200 None
2026-03-30 07:50:15 [auto1.de] INFO: Scrape type for BR43966: 2
2026-03-30 07:50:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9f74838-e024-5187-a02f-88ee3aed9c0c with identifier: BR43966
2026-03-30 07:50:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9f74838-e024-5187-a02f-88ee3aed9c0c with scrape type 2
2026-03-30 07:50:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9f74838-e024-5187-a02f-88ee3aed9c0c with scrape type 2
2026-03-30 07:50:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f9f74838-e024-5187-a02f-88ee3aed9c0c, identifier: BR43966
2026-03-30 07:50:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f9f74838-e024-5187-a02f-88ee3aed9c0c with identifier: BR43966
2026-03-30 07:50:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f9f74838-e024-5187-a02f-88ee3aed9c0c with identifier: BR43966
2026-03-30 07:50:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f9f74838-e024-5187-a02f-88ee3aed9c0c with identifier: BR43966 to the API
2026-03-30 07:50:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:43:54Z',
 'fuel_type': 'petrol',
 'id': 'f9f74838-e024-5187-a02f-88ee3aed9c0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR43966',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '5',
 'odometer': 96012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-25',
 'seller_name': None,
 'title': 'Mazda 5 1.8 Sendo',
 'transmission': 'manual',
 'trim': 'Sendo',
 'year': 2015}
2026-03-30 07:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR43966%27 HTTP/1.1" 200 None
2026-03-30 07:50:16 [auto1.de] INFO: Saving data for BR43966: {'auction_closing_time': 1774885434.0, 'created_time': 1774552628.868955, 'last_price_update_time': 1774857016.900052}
2026-03-30 07:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BR43966') HTTP/1.1" 204 0
2026-03-30 07:50:17 [auto1.de] INFO: Found listing with ID: KZ47858
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ47858%27 HTTP/1.1" 200 None
2026-03-30 07:50:17 [auto1.de] INFO: Scrape type for KZ47858: 0
2026-03-30 07:50:17 [auto1.de] INFO: Found listing with ID: NE13487
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE13487%27 HTTP/1.1" 200 None
2026-03-30 07:50:17 [auto1.de] INFO: Scrape type for NE13487: 2
2026-03-30 07:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with identifier: NE13487
2026-03-30 07:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with scrape type 2
2026-03-30 07:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with scrape type 2
2026-03-30 07:50:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5f9ad73-ba97-5a5e-930d-df2dd2ffefde, identifier: NE13487
2026-03-30 07:50:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with identifier: NE13487
2026-03-30 07:50:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with identifier: NE13487
2026-03-30 07:50:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5f9ad73-ba97-5a5e-930d-df2dd2ffefde with identifier: NE13487 to the API
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:30:19Z',
 'fuel_type': 'diesel',
 'id': 'c5f9ad73-ba97-5a5e-930d-df2dd2ffefde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE13487',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Yeti',
 'odometer': 125241,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-26',
 'seller_name': None,
 'title': 'Skoda Yeti 2.0 TDI Elegance 4x4',
 'transmission': 'manual',
 'trim': 'Elegance 4x4',
 'year': 2011}
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE13487%27 HTTP/1.1" 200 None
2026-03-30 07:50:17 [auto1.de] INFO: Saving data for NE13487: {'auction_closing_time': 1774884619.0, 'created_time': 1774552454.018884, 'last_price_update_time': 1774857017.71481}
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE13487') HTTP/1.1" 204 0
2026-03-30 07:50:17 [auto1.de] INFO: Found listing with ID: YW50653
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW50653%27 HTTP/1.1" 200 None
2026-03-30 07:50:17 [auto1.de] INFO: Scrape type for YW50653: 0
2026-03-30 07:50:17 [auto1.de] INFO: Found listing with ID: FX67630
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX67630%27 HTTP/1.1" 200 None
2026-03-30 07:50:17 [auto1.de] INFO: Scrape type for FX67630: 2
2026-03-30 07:50:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45c97621-8662-55e3-95c1-2550e1258416 with identifier: FX67630
2026-03-30 07:50:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45c97621-8662-55e3-95c1-2550e1258416 with scrape type 2
2026-03-30 07:50:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45c97621-8662-55e3-95c1-2550e1258416 with scrape type 2
2026-03-30 07:50:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 45c97621-8662-55e3-95c1-2550e1258416, identifier: FX67630
2026-03-30 07:50:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 45c97621-8662-55e3-95c1-2550e1258416 with identifier: FX67630
2026-03-30 07:50:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 45c97621-8662-55e3-95c1-2550e1258416 with identifier: FX67630
2026-03-30 07:50:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 45c97621-8662-55e3-95c1-2550e1258416 with identifier: FX67630 to the API
2026-03-30 07:50:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:32:58Z',
 'fuel_type': 'petrol',
 'id': '45c97621-8662-55e3-95c1-2550e1258416',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX67630',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 132757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-27',
 'seller_name': None,
 'title': 'BMW 3er 328i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX67630%27 HTTP/1.1" 200 None
2026-03-30 07:50:18 [auto1.de] INFO: Saving data for FX67630: {'auction_closing_time': 1774884778.0, 'created_time': 1774639766.797664, 'last_price_update_time': 1774857018.39239}
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FX67630') HTTP/1.1" 204 0
2026-03-30 07:50:18 [auto1.de] INFO: Found listing with ID: YU15721
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU15721%27 HTTP/1.1" 200 None
2026-03-30 07:50:18 [auto1.de] INFO: Scrape type for YU15721: 0
2026-03-30 07:50:18 [auto1.de] INFO: Found listing with ID: JG77097
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG77097%27 HTTP/1.1" 200 None
2026-03-30 07:50:18 [auto1.de] INFO: Scrape type for JG77097: 0
2026-03-30 07:50:18 [auto1.de] INFO: Found listing with ID: FY46967
2026-03-30 07:50:18 [auto1.de] INFO: Found listing with ID: WB38942
2026-03-30 07:50:18 [auto1.de] INFO: Found listing with ID: MX01041
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX01041%27 HTTP/1.1" 200 None
2026-03-30 07:50:18 [auto1.de] INFO: Scrape type for MX01041: 2
2026-03-30 07:50:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e524d2f-7849-5cfd-9f7c-7752fe79db21 with identifier: MX01041
2026-03-30 07:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e524d2f-7849-5cfd-9f7c-7752fe79db21 with scrape type 2
2026-03-30 07:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e524d2f-7849-5cfd-9f7c-7752fe79db21 with scrape type 2
2026-03-30 07:50:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0e524d2f-7849-5cfd-9f7c-7752fe79db21, identifier: MX01041
2026-03-30 07:50:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0e524d2f-7849-5cfd-9f7c-7752fe79db21 with identifier: MX01041
2026-03-30 07:50:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0e524d2f-7849-5cfd-9f7c-7752fe79db21 with identifier: MX01041
2026-03-30 07:50:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0e524d2f-7849-5cfd-9f7c-7752fe79db21 with identifier: MX01041 to the API
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:20:37Z',
 'fuel_type': 'petrol',
 'id': '0e524d2f-7849-5cfd-9f7c-7752fe79db21',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX01041',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 173977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-07',
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2015}
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX01041%27 HTTP/1.1" 200 None
2026-03-30 07:50:18 [auto1.de] INFO: Saving data for MX01041: {'auction_closing_time': 1774884037.0, 'created_time': 1774350611.398459, 'last_price_update_time': 1774857018.857685}
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MX01041') HTTP/1.1" 204 0
2026-03-30 07:50:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:50:18 [auto1.de] INFO: Found listing with ID: LL59024
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL59024%27 HTTP/1.1" 200 None
2026-03-30 07:50:18 [auto1.de] INFO: Scrape type for LL59024: 2
2026-03-30 07:50:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d3af0ed-0389-5599-9997-1072091e8ad1 with identifier: LL59024
2026-03-30 07:50:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d3af0ed-0389-5599-9997-1072091e8ad1 with scrape type 2
2026-03-30 07:50:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d3af0ed-0389-5599-9997-1072091e8ad1 with scrape type 2
2026-03-30 07:50:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d3af0ed-0389-5599-9997-1072091e8ad1, identifier: LL59024
2026-03-30 07:50:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d3af0ed-0389-5599-9997-1072091e8ad1 with identifier: LL59024
2026-03-30 07:50:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d3af0ed-0389-5599-9997-1072091e8ad1 with identifier: LL59024
2026-03-30 07:50:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d3af0ed-0389-5599-9997-1072091e8ad1 with identifier: LL59024 to the API
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 320,
 'expiration_date': '2026-03-30T15:12:30Z',
 'fuel_type': 'diesel',
 'id': '4d3af0ed-0389-5599-9997-1072091e8ad1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL59024',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A7 Sportback',
 'odometer': 112530,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-26',
 'seller_name': None,
 'title': 'Audi A7 Sportback 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL59024%27 HTTP/1.1" 200 None
2026-03-30 07:50:19 [auto1.de] INFO: Saving data for LL59024: {'auction_closing_time': 1774883550.0, 'created_time': 1774002055.894983, 'last_price_update_time': 1774857019.295333}
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL59024') HTTP/1.1" 204 0
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: GZ29273
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ29273%27 HTTP/1.1" 200 None
2026-03-30 07:50:19 [auto1.de] INFO: Scrape type for GZ29273: 0
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: BC20634
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC20634%27 HTTP/1.1" 200 None
2026-03-30 07:50:19 [auto1.de] INFO: Scrape type for BC20634: 0
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: NL95797
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL95797%27 HTTP/1.1" 200 None
2026-03-30 07:50:19 [auto1.de] INFO: Scrape type for NL95797: 0
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: FH05972
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH05972%27 HTTP/1.1" 200 None
2026-03-30 07:50:19 [auto1.de] INFO: Scrape type for FH05972: 0
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: TN04984
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN04984%27 HTTP/1.1" 200 None
2026-03-30 07:50:19 [auto1.de] INFO: Scrape type for TN04984: 2
2026-03-30 07:50:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5 with identifier: TN04984
2026-03-30 07:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5 with scrape type 2
2026-03-30 07:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5 with scrape type 2
2026-03-30 07:50:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5, identifier: TN04984
2026-03-30 07:50:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5 with identifier: TN04984
2026-03-30 07:50:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5 with identifier: TN04984
2026-03-30 07:50:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a0bf0d6-50b7-5421-abeb-33e83e9e66b5 with identifier: TN04984 to the API
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-30T15:42:41Z',
 'fuel_type': 'petrol',
 'id': '7a0bf0d6-50b7-5421-abeb-33e83e9e66b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN04984',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Crossfire',
 'odometer': 344936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-09-30',
 'seller_name': None,
 'title': 'Chrysler Crossfire 3.2 Basis',
 'transmission': 'automatic',
 'trim': 'Basis',
 'year': 2004}
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN04984%27 HTTP/1.1" 200 None
2026-03-30 07:50:19 [auto1.de] INFO: Saving data for TN04984: {'auction_closing_time': 1774885361.0, 'created_time': 1774676136.214462, 'last_price_update_time': 1774857019.798267}
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TN04984') HTTP/1.1" 204 0
2026-03-30 07:50:19 [auto1.de] INFO: Channel: 24h | Page: 165 | totalHits: 8411 | hits on page: 40
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: DE56554
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DE56554%27 HTTP/1.1" 200 None
2026-03-30 07:50:19 [auto1.de] INFO: Scrape type for DE56554: 0
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: JL37437
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL37437%27 HTTP/1.1" 200 None
2026-03-30 07:50:19 [auto1.de] INFO: Scrape type for JL37437: 0
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: XS50752
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: LR98326
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: RA28686
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: WD34588
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: DU96107
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: PL89727
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: LG94407
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG94407%27 HTTP/1.1" 200 None
2026-03-30 07:50:19 [auto1.de] INFO: Scrape type for LG94407: 0
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: DW90276
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: UA17642
2026-03-30 07:50:19 [auto1.de] INFO: Found listing with ID: JN34556
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34556%27 HTTP/1.1" 200 None
2026-03-30 07:50:19 [auto1.de] INFO: Scrape type for JN34556: 2
2026-03-30 07:50:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23990860-197d-5116-81bb-2233cabc11a9 with identifier: JN34556
2026-03-30 07:50:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23990860-197d-5116-81bb-2233cabc11a9 with scrape type 2
2026-03-30 07:50:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23990860-197d-5116-81bb-2233cabc11a9 with scrape type 2
2026-03-30 07:50:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 23990860-197d-5116-81bb-2233cabc11a9, identifier: JN34556
2026-03-30 07:50:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:50:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 23990860-197d-5116-81bb-2233cabc11a9 with identifier: JN34556
2026-03-30 07:50:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 23990860-197d-5116-81bb-2233cabc11a9 with identifier: JN34556
2026-03-30 07:50:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 23990860-197d-5116-81bb-2233cabc11a9 with identifier: JN34556 to the API
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 380,
 'expiration_date': '2026-03-30T15:56:11Z',
 'fuel_type': 'diesel',
 'id': '23990860-197d-5116-81bb-2233cabc11a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN34556',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 243333,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-27',
 'seller_name': None,
 'title': 'BMW X5 M50d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN34556%27 HTTP/1.1" 200 None
2026-03-30 07:50:20 [auto1.de] INFO: Saving data for JN34556: {'auction_closing_time': 1774886171.0, 'created_time': 1774550613.115231, 'last_price_update_time': 1774857020.356646}
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JN34556') HTTP/1.1" 204 0
2026-03-30 07:50:20 [auto1.de] INFO: Found listing with ID: TH04951
2026-03-30 07:50:20 [auto1.de] INFO: Found listing with ID: YM57013
2026-03-30 07:50:20 [auto1.de] INFO: Found listing with ID: UB28690
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB28690%27 HTTP/1.1" 200 None
2026-03-30 07:50:20 [auto1.de] INFO: Scrape type for UB28690: 0
2026-03-30 07:50:20 [auto1.de] INFO: Found listing with ID: TF57163
2026-03-30 07:50:20 [auto1.de] INFO: Found listing with ID: WR98876
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WR98876%27 HTTP/1.1" 200 None
2026-03-30 07:50:20 [auto1.de] INFO: Scrape type for WR98876: 0
2026-03-30 07:50:20 [auto1.de] INFO: Found listing with ID: GL61912
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61912%27 HTTP/1.1" 200 None
2026-03-30 07:50:20 [auto1.de] INFO: Scrape type for GL61912: 2
2026-03-30 07:50:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a570579f-d572-5307-9c0b-a960e9735e2c with identifier: GL61912
2026-03-30 07:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a570579f-d572-5307-9c0b-a960e9735e2c with scrape type 2
2026-03-30 07:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a570579f-d572-5307-9c0b-a960e9735e2c with scrape type 2
2026-03-30 07:50:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a570579f-d572-5307-9c0b-a960e9735e2c, identifier: GL61912
2026-03-30 07:50:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a570579f-d572-5307-9c0b-a960e9735e2c with identifier: GL61912
2026-03-30 07:50:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a570579f-d572-5307-9c0b-a960e9735e2c with identifier: GL61912
2026-03-30 07:50:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a570579f-d572-5307-9c0b-a960e9735e2c with identifier: GL61912 to the API
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:35:48Z',
 'fuel_type': 'petrol',
 'id': 'a570579f-d572-5307-9c0b-a960e9735e2c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL61912',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 38168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-05',
 'seller_name': None,
 'title': 'Kia Picanto 1.2 GT Line',
 'transmission': 'manual',
 'trim': 'GT Line',
 'year': 2018}
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL61912%27 HTTP/1.1" 200 None
2026-03-30 07:50:20 [auto1.de] INFO: Saving data for GL61912: {'auction_closing_time': 1774884948.0, 'created_time': 1774552878.461978, 'last_price_update_time': 1774857020.877774}
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GL61912') HTTP/1.1" 204 0
2026-03-30 07:50:20 [auto1.de] INFO: Found listing with ID: LB03108
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB03108%27 HTTP/1.1" 200 None
2026-03-30 07:50:20 [auto1.de] INFO: Scrape type for LB03108: 2
2026-03-30 07:50:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b9152bf-76e1-555b-8688-3c694576e5ba with identifier: LB03108
2026-03-30 07:50:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b9152bf-76e1-555b-8688-3c694576e5ba with scrape type 2
2026-03-30 07:50:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b9152bf-76e1-555b-8688-3c694576e5ba with scrape type 2
2026-03-30 07:50:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4b9152bf-76e1-555b-8688-3c694576e5ba, identifier: LB03108
2026-03-30 07:50:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4b9152bf-76e1-555b-8688-3c694576e5ba with identifier: LB03108
2026-03-30 07:50:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4b9152bf-76e1-555b-8688-3c694576e5ba with identifier: LB03108
2026-03-30 07:50:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4b9152bf-76e1-555b-8688-3c694576e5ba with identifier: LB03108 to the API
2026-03-30 07:50:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:20:48Z',
 'fuel_type': 'petrol',
 'id': '4b9152bf-76e1-555b-8688-3c694576e5ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB03108',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 176048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-09',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.5 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-30 07:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB03108%27 HTTP/1.1" 200 None
2026-03-30 07:50:21 [auto1.de] INFO: Saving data for LB03108: {'auction_closing_time': 1774884048.0, 'created_time': 1774552899.742158, 'last_price_update_time': 1774857021.306294}
2026-03-30 07:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB03108') HTTP/1.1" 204 0
2026-03-30 07:50:21 [auto1.de] INFO: Found listing with ID: GA13082
2026-03-30 07:50:21 [auto1.de] INFO: Found listing with ID: DR68072
2026-03-30 07:50:21 [auto1.de] INFO: Found listing with ID: GX15527
2026-03-30 07:50:21 [auto1.de] INFO: Found listing with ID: MH34813
2026-03-30 07:50:21 [auto1.de] INFO: Found listing with ID: PC78051
2026-03-30 07:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC78051%27 HTTP/1.1" 200 None
2026-03-30 07:50:21 [auto1.de] INFO: Scrape type for PC78051: 2
2026-03-30 07:50:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c97b6bb-7a1e-529b-8438-058e8a6e1608 with identifier: PC78051
2026-03-30 07:50:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c97b6bb-7a1e-529b-8438-058e8a6e1608 with scrape type 2
2026-03-30 07:50:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c97b6bb-7a1e-529b-8438-058e8a6e1608 with scrape type 2
2026-03-30 07:50:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1c97b6bb-7a1e-529b-8438-058e8a6e1608, identifier: PC78051
2026-03-30 07:50:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1c97b6bb-7a1e-529b-8438-058e8a6e1608 with identifier: PC78051
2026-03-30 07:50:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1c97b6bb-7a1e-529b-8438-058e8a6e1608 with identifier: PC78051
2026-03-30 07:50:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1c97b6bb-7a1e-529b-8438-058e8a6e1608 with identifier: PC78051 to the API
2026-03-30 07:50:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:08Z',
 'fuel_type': 'petrol',
 'id': '1c97b6bb-7a1e-529b-8438-058e8a6e1608',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC78051',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 122180,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-06',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Trendline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion Tech',
 'year': 2016}
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC78051%27 HTTP/1.1" 200 None
2026-03-30 07:50:22 [auto1.de] INFO: Saving data for PC78051: {'auction_closing_time': 1774884128.0, 'created_time': 1773381083.001002, 'last_price_update_time': 1774857022.387378}
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC78051') HTTP/1.1" 204 0
2026-03-30 07:50:22 [auto1.de] INFO: Found listing with ID: BF61357
2026-03-30 07:50:22 [auto1.de] INFO: Found listing with ID: WF57615
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF57615%27 HTTP/1.1" 200 None
2026-03-30 07:50:22 [auto1.de] INFO: Scrape type for WF57615: 2
2026-03-30 07:50:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19f01d7a-e8bd-5a0b-b292-dd3c9b433c8d with identifier: WF57615
2026-03-30 07:50:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19f01d7a-e8bd-5a0b-b292-dd3c9b433c8d with scrape type 2
2026-03-30 07:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 19f01d7a-e8bd-5a0b-b292-dd3c9b433c8d with scrape type 2
2026-03-30 07:50:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 19f01d7a-e8bd-5a0b-b292-dd3c9b433c8d, identifier: WF57615
2026-03-30 07:50:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 19f01d7a-e8bd-5a0b-b292-dd3c9b433c8d with identifier: WF57615
2026-03-30 07:50:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 19f01d7a-e8bd-5a0b-b292-dd3c9b433c8d with identifier: WF57615
2026-03-30 07:50:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 19f01d7a-e8bd-5a0b-b292-dd3c9b433c8d with identifier: WF57615 to the API
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:41Z',
 'fuel_type': 'diesel',
 'id': '19f01d7a-e8bd-5a0b-b292-dd3c9b433c8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WF57615',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Karoq',
 'odometer': 200127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-02-14',
 'seller_name': None,
 'title': 'Skoda Karoq 2.0 TDI Sportline 4x4',
 'transmission': 'automatic',
 'trim': 'Sportline 4x4',
 'year': 2022}
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF57615%27 HTTP/1.1" 200 None
2026-03-30 07:50:22 [auto1.de] INFO: Saving data for WF57615: {'auction_closing_time': 1774883141.0, 'created_time': 1773905730.120578, 'last_price_update_time': 1774857022.882242}
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WF57615') HTTP/1.1" 204 0
2026-03-30 07:50:22 [auto1.de] INFO: Found listing with ID: XY70185
2026-03-30 07:50:22 [auto1.de] INFO: Found listing with ID: KG12536
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG12536%27 HTTP/1.1" 200 None
2026-03-30 07:50:22 [auto1.de] INFO: Scrape type for KG12536: 0
2026-03-30 07:50:22 [auto1.de] INFO: Found listing with ID: LP67164
2026-03-30 07:50:22 [auto1.de] INFO: Found listing with ID: KV18345
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV18345%27 HTTP/1.1" 200 None
2026-03-30 07:50:22 [auto1.de] INFO: Scrape type for KV18345: 0
2026-03-30 07:50:22 [auto1.de] INFO: Found listing with ID: BY51393
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY51393%27 HTTP/1.1" 200 None
2026-03-30 07:50:22 [auto1.de] INFO: Scrape type for BY51393: 2
2026-03-30 07:50:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67fc354d-3131-53ea-b946-86332f6890db with identifier: BY51393
2026-03-30 07:50:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67fc354d-3131-53ea-b946-86332f6890db with scrape type 2
2026-03-30 07:50:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67fc354d-3131-53ea-b946-86332f6890db with scrape type 2
2026-03-30 07:50:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 67fc354d-3131-53ea-b946-86332f6890db, identifier: BY51393
2026-03-30 07:50:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 67fc354d-3131-53ea-b946-86332f6890db with identifier: BY51393
2026-03-30 07:50:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 67fc354d-3131-53ea-b946-86332f6890db with identifier: BY51393
2026-03-30 07:50:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 67fc354d-3131-53ea-b946-86332f6890db with identifier: BY51393 to the API
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:42:13Z',
 'fuel_type': 'diesel',
 'id': '67fc354d-3131-53ea-b946-86332f6890db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY51393',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 172925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-05-01',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.6 dCi BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2014}
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY51393%27 HTTP/1.1" 200 None
2026-03-30 07:50:23 [auto1.de] INFO: Saving data for BY51393: {'auction_closing_time': 1774885333.0, 'created_time': 1774639245.341472, 'last_price_update_time': 1774857023.347461}
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BY51393') HTTP/1.1" 204 0
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: MY99054
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: LF81800
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF81800%27 HTTP/1.1" 200 None
2026-03-30 07:50:23 [auto1.de] INFO: Scrape type for LF81800: 0
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: ZF64276
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: VH67229
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: EU36809
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU36809%27 HTTP/1.1" 200 None
2026-03-30 07:50:23 [auto1.de] INFO: Scrape type for EU36809: 2
2026-03-30 07:50:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d161d072-5ece-5b60-90dc-f094f84acfb8 with identifier: EU36809
2026-03-30 07:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d161d072-5ece-5b60-90dc-f094f84acfb8 with scrape type 2
2026-03-30 07:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d161d072-5ece-5b60-90dc-f094f84acfb8 with scrape type 2
2026-03-30 07:50:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d161d072-5ece-5b60-90dc-f094f84acfb8, identifier: EU36809
2026-03-30 07:50:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d161d072-5ece-5b60-90dc-f094f84acfb8 with identifier: EU36809
2026-03-30 07:50:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d161d072-5ece-5b60-90dc-f094f84acfb8 with identifier: EU36809
2026-03-30 07:50:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d161d072-5ece-5b60-90dc-f094f84acfb8 with identifier: EU36809 to the API
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:12:26Z',
 'fuel_type': 'petrol',
 'id': 'd161d072-5ece-5b60-90dc-f094f84acfb8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU36809',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 338499,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-06-09',
 'seller_name': None,
 'title': 'Audi A4 1.8 Turbo',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU36809%27 HTTP/1.1" 200 None
2026-03-30 07:50:23 [auto1.de] INFO: Saving data for EU36809: {'auction_closing_time': 1774883546.0, 'created_time': 1774638745.133112, 'last_price_update_time': 1774857023.754604}
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU36809') HTTP/1.1" 204 0
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: MF45027
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: LK89545
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LK89545%27 HTTP/1.1" 200 None
2026-03-30 07:50:23 [auto1.de] INFO: Scrape type for LK89545: 0
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: BU39152
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: GA31653
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA31653%27 HTTP/1.1" 200 None
2026-03-30 07:50:23 [auto1.de] INFO: Scrape type for GA31653: 0
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: NE15652
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE15652%27 HTTP/1.1" 200 None
2026-03-30 07:50:23 [auto1.de] INFO: Scrape type for NE15652: 0
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: WT06361
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT06361%27 HTTP/1.1" 200 None
2026-03-30 07:50:23 [auto1.de] INFO: Scrape type for WT06361: 0
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: TY20606
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TY20606%27 HTTP/1.1" 200 None
2026-03-30 07:50:23 [auto1.de] INFO: Scrape type for TY20606: 0
2026-03-30 07:50:23 [auto1.de] INFO: Found listing with ID: VB50178
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB50178%27 HTTP/1.1" 200 None
2026-03-30 07:50:23 [auto1.de] INFO: Scrape type for VB50178: 2
2026-03-30 07:50:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d152196-f468-5e5a-bf8f-2da526678752 with identifier: VB50178
2026-03-30 07:50:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d152196-f468-5e5a-bf8f-2da526678752 with scrape type 2
2026-03-30 07:50:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d152196-f468-5e5a-bf8f-2da526678752 with scrape type 2
2026-03-30 07:50:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6d152196-f468-5e5a-bf8f-2da526678752, identifier: VB50178
2026-03-30 07:50:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6d152196-f468-5e5a-bf8f-2da526678752 with identifier: VB50178
2026-03-30 07:50:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6d152196-f468-5e5a-bf8f-2da526678752 with identifier: VB50178
2026-03-30 07:50:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6d152196-f468-5e5a-bf8f-2da526678752 with identifier: VB50178 to the API
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 224,
 'expiration_date': '2026-03-30T15:21:20Z',
 'fuel_type': 'petrol',
 'id': '6d152196-f468-5e5a-bf8f-2da526678752',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB50178',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLB-Klasse',
 'odometer': 117595,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-11',
 'seller_name': None,
 'title': 'Mercedes-Benz GLB-Klasse GLB 250 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2020}
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VB50178%27 HTTP/1.1" 200 None
2026-03-30 07:50:24 [auto1.de] INFO: Saving data for VB50178: {'auction_closing_time': 1774884080.0, 'created_time': 1773138262.272037, 'last_price_update_time': 1774857024.387945}
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VB50178') HTTP/1.1" 204 0
2026-03-30 07:50:24 [auto1.de] INFO: Found listing with ID: MZ37789
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37789%27 HTTP/1.1" 200 None
2026-03-30 07:50:24 [auto1.de] INFO: Scrape type for MZ37789: 2
2026-03-30 07:50:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7707c225-1567-57ce-a09c-d1d41625ae96 with identifier: MZ37789
2026-03-30 07:50:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7707c225-1567-57ce-a09c-d1d41625ae96 with scrape type 2
2026-03-30 07:50:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7707c225-1567-57ce-a09c-d1d41625ae96 with scrape type 2
2026-03-30 07:50:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7707c225-1567-57ce-a09c-d1d41625ae96, identifier: MZ37789
2026-03-30 07:50:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7707c225-1567-57ce-a09c-d1d41625ae96 with identifier: MZ37789
2026-03-30 07:50:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7707c225-1567-57ce-a09c-d1d41625ae96 with identifier: MZ37789
2026-03-30 07:50:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7707c225-1567-57ce-a09c-d1d41625ae96 with identifier: MZ37789 to the API
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:43:10Z',
 'fuel_type': 'petrol',
 'id': '7707c225-1567-57ce-a09c-d1d41625ae96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MZ37789',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 47176,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-07',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 200 4Matic Progressive',
 'transmission': 'automatic',
 'trim': '4Matic Progressive',
 'year': 2022}
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ37789%27 HTTP/1.1" 200 None
2026-03-30 07:50:24 [auto1.de] INFO: Saving data for MZ37789: {'auction_closing_time': 1774885390.0, 'created_time': 1774552854.268498, 'last_price_update_time': 1774857024.812973}
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MZ37789') HTTP/1.1" 204 0
2026-03-30 07:50:24 [auto1.de] INFO: Found listing with ID: NZ01572
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ01572%27 HTTP/1.1" 200 None
2026-03-30 07:50:24 [auto1.de] INFO: Scrape type for NZ01572: 0
2026-03-30 07:50:24 [auto1.de] INFO: Found listing with ID: NV13181
2026-03-30 07:50:24 [auto1.de] INFO: Found listing with ID: NE19972
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE19972%27 HTTP/1.1" 200 None
2026-03-30 07:50:24 [auto1.de] INFO: Scrape type for NE19972: 0
2026-03-30 07:50:24 [auto1.de] INFO: Found listing with ID: WU91677
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU91677%27 HTTP/1.1" 200 None
2026-03-30 07:50:24 [auto1.de] INFO: Scrape type for WU91677: 0
2026-03-30 07:50:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:50:24 [auto1.de] INFO: Channel: 24h | Page: 166 | totalHits: 8411 | hits on page: 40
2026-03-30 07:50:24 [auto1.de] INFO: Found listing with ID: CP50790
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP50790%27 HTTP/1.1" 200 None
2026-03-30 07:50:25 [auto1.de] INFO: Scrape type for CP50790: 2
2026-03-30 07:50:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aef6d2aa-f9e9-5bcb-bf31-b3779fc6653a with identifier: CP50790
2026-03-30 07:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aef6d2aa-f9e9-5bcb-bf31-b3779fc6653a with scrape type 2
2026-03-30 07:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aef6d2aa-f9e9-5bcb-bf31-b3779fc6653a with scrape type 2
2026-03-30 07:50:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aef6d2aa-f9e9-5bcb-bf31-b3779fc6653a, identifier: CP50790
2026-03-30 07:50:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aef6d2aa-f9e9-5bcb-bf31-b3779fc6653a with identifier: CP50790
2026-03-30 07:50:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aef6d2aa-f9e9-5bcb-bf31-b3779fc6653a with identifier: CP50790
2026-03-30 07:50:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aef6d2aa-f9e9-5bcb-bf31-b3779fc6653a with identifier: CP50790 to the API
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:52:08Z',
 'fuel_type': 'petrol',
 'id': 'aef6d2aa-f9e9-5bcb-bf31-b3779fc6653a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP50790',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 150826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-01',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.4 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2009}
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CP50790%27 HTTP/1.1" 200 None
2026-03-30 07:50:25 [auto1.de] INFO: Saving data for CP50790: {'auction_closing_time': 1774885928.0, 'created_time': 1774638938.376929, 'last_price_update_time': 1774857025.383916}
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CP50790') HTTP/1.1" 204 0
2026-03-30 07:50:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: YF79248
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF79248%27 HTTP/1.1" 200 None
2026-03-30 07:50:25 [auto1.de] INFO: Scrape type for YF79248: 2
2026-03-30 07:50:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with identifier: YF79248
2026-03-30 07:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with scrape type 2
2026-03-30 07:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with scrape type 2
2026-03-30 07:50:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4, identifier: YF79248
2026-03-30 07:50:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with identifier: YF79248
2026-03-30 07:50:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with identifier: YF79248
2026-03-30 07:50:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4 with identifier: YF79248 to the API
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:22:56Z',
 'fuel_type': 'diesel',
 'id': 'bbab33bd-c7cd-5c0b-86fe-2dfff9b209e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF79248',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 272250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-23',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YF79248%27 HTTP/1.1" 200 None
2026-03-30 07:50:25 [auto1.de] INFO: Saving data for YF79248: {'auction_closing_time': 1774884176.0, 'created_time': 1774552818.262669, 'last_price_update_time': 1774857025.871736}
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YF79248') HTTP/1.1" 204 0
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: NF91917
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: BU76386
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: WS69855
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: SG14297
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG14297%27 HTTP/1.1" 200 None
2026-03-30 07:50:25 [auto1.de] INFO: Scrape type for SG14297: 0
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: TB49418
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: TW80485
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: JD76793
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: NK53054
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK53054%27 HTTP/1.1" 200 None
2026-03-30 07:50:25 [auto1.de] INFO: Scrape type for NK53054: 0
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: TZ00942
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: TY10898
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: KT36384
2026-03-30 07:50:25 [auto1.de] INFO: Found listing with ID: KG05559
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG05559%27 HTTP/1.1" 200 None
2026-03-30 07:50:25 [auto1.de] INFO: Scrape type for KG05559: 2
2026-03-30 07:50:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3029f4f-4b61-5559-b598-3324c03e0a7a with identifier: KG05559
2026-03-30 07:50:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3029f4f-4b61-5559-b598-3324c03e0a7a with scrape type 2
2026-03-30 07:50:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3029f4f-4b61-5559-b598-3324c03e0a7a with scrape type 2
2026-03-30 07:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d3029f4f-4b61-5559-b598-3324c03e0a7a, identifier: KG05559
2026-03-30 07:50:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d3029f4f-4b61-5559-b598-3324c03e0a7a with identifier: KG05559
2026-03-30 07:50:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d3029f4f-4b61-5559-b598-3324c03e0a7a with identifier: KG05559
2026-03-30 07:50:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d3029f4f-4b61-5559-b598-3324c03e0a7a with identifier: KG05559 to the API
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:56:43Z',
 'fuel_type': 'petrol',
 'id': 'd3029f4f-4b61-5559-b598-3324c03e0a7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG05559',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 55029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-06',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2023}
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG05559%27 HTTP/1.1" 200 None
2026-03-30 07:50:26 [auto1.de] INFO: Saving data for KG05559: {'auction_closing_time': 1774886203.0, 'created_time': 1774638992.980517, 'last_price_update_time': 1774857026.326822}
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG05559') HTTP/1.1" 204 0
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: ZV64166
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: XX81034
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX81034%27 HTTP/1.1" 200 None
2026-03-30 07:50:26 [auto1.de] INFO: Scrape type for XX81034: 0
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: EP38579
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: ZJ64916
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: AE21884
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: MA12811
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA12811%27 HTTP/1.1" 200 None
2026-03-30 07:50:26 [auto1.de] INFO: Scrape type for MA12811: 2
2026-03-30 07:50:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 000e75a5-31cd-567a-bc25-60f261728f58 with identifier: MA12811
2026-03-30 07:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 000e75a5-31cd-567a-bc25-60f261728f58 with scrape type 2
2026-03-30 07:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 000e75a5-31cd-567a-bc25-60f261728f58 with scrape type 2
2026-03-30 07:50:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 000e75a5-31cd-567a-bc25-60f261728f58, identifier: MA12811
2026-03-30 07:50:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 000e75a5-31cd-567a-bc25-60f261728f58 with identifier: MA12811
2026-03-30 07:50:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 000e75a5-31cd-567a-bc25-60f261728f58 with identifier: MA12811
2026-03-30 07:50:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 000e75a5-31cd-567a-bc25-60f261728f58 with identifier: MA12811 to the API
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:12:36Z',
 'fuel_type': 'petrol',
 'id': '000e75a5-31cd-567a-bc25-60f261728f58',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA12811',
 'listing': 'auction',
 'make': 'Honda',
 'model': 'Jazz',
 'odometer': 227130,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-27',
 'seller_name': None,
 'title': 'Honda Jazz 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA12811%27 HTTP/1.1" 200 None
2026-03-30 07:50:26 [auto1.de] INFO: Saving data for MA12811: {'auction_closing_time': 1774883556.0, 'created_time': 1774553147.263632, 'last_price_update_time': 1774857026.848296}
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA12811') HTTP/1.1" 204 0
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: GV33356
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV33356%27 HTTP/1.1" 200 None
2026-03-30 07:50:26 [auto1.de] INFO: Scrape type for GV33356: 0
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: XY91338
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY91338%27 HTTP/1.1" 200 None
2026-03-30 07:50:26 [auto1.de] INFO: Scrape type for XY91338: 0
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: FU12915
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: BU81814
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: WT92712
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: WJ73657
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: HP00850
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: JU65331
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: ZL30155
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: DK81331
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: ZG14891
2026-03-30 07:50:26 [auto1.de] INFO: Found listing with ID: BH43917
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH43917%27 HTTP/1.1" 200 None
2026-03-30 07:50:26 [auto1.de] INFO: Scrape type for BH43917: 2
2026-03-30 07:50:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 927b5da1-6388-5b1a-98c8-51fe0e9a7b9e with identifier: BH43917
2026-03-30 07:50:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 927b5da1-6388-5b1a-98c8-51fe0e9a7b9e with scrape type 2
2026-03-30 07:50:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 927b5da1-6388-5b1a-98c8-51fe0e9a7b9e with scrape type 2
2026-03-30 07:50:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 927b5da1-6388-5b1a-98c8-51fe0e9a7b9e, identifier: BH43917
2026-03-30 07:50:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 927b5da1-6388-5b1a-98c8-51fe0e9a7b9e with identifier: BH43917
2026-03-30 07:50:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 927b5da1-6388-5b1a-98c8-51fe0e9a7b9e with identifier: BH43917
2026-03-30 07:50:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 927b5da1-6388-5b1a-98c8-51fe0e9a7b9e with identifier: BH43917 to the API
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:41:00Z',
 'fuel_type': 'diesel',
 'id': '927b5da1-6388-5b1a-98c8-51fe0e9a7b9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BH43917',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 173447,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-19',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2009}
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH43917%27 HTTP/1.1" 200 None
2026-03-30 07:50:27 [auto1.de] INFO: Saving data for BH43917: {'auction_closing_time': 1774885260.0, 'created_time': 1773945942.915607, 'last_price_update_time': 1774857027.28919}
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BH43917') HTTP/1.1" 204 0
2026-03-30 07:50:27 [auto1.de] INFO: Found listing with ID: GG89012
2026-03-30 07:50:27 [auto1.de] INFO: Found listing with ID: RZ09497
2026-03-30 07:50:27 [auto1.de] INFO: Found listing with ID: LF01905
2026-03-30 07:50:27 [auto1.de] INFO: Found listing with ID: SY47772
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY47772%27 HTTP/1.1" 200 None
2026-03-30 07:50:27 [auto1.de] INFO: Scrape type for SY47772: 0
2026-03-30 07:50:27 [auto1.de] INFO: Found listing with ID: KG98772
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98772%27 HTTP/1.1" 200 None
2026-03-30 07:50:27 [auto1.de] INFO: Scrape type for KG98772: 2
2026-03-30 07:50:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8544742a-fcd5-5ed1-9026-642e2d52c0fd with identifier: KG98772
2026-03-30 07:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8544742a-fcd5-5ed1-9026-642e2d52c0fd with scrape type 2
2026-03-30 07:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8544742a-fcd5-5ed1-9026-642e2d52c0fd with scrape type 2
2026-03-30 07:50:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8544742a-fcd5-5ed1-9026-642e2d52c0fd, identifier: KG98772
2026-03-30 07:50:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8544742a-fcd5-5ed1-9026-642e2d52c0fd with identifier: KG98772
2026-03-30 07:50:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8544742a-fcd5-5ed1-9026-642e2d52c0fd with identifier: KG98772
2026-03-30 07:50:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8544742a-fcd5-5ed1-9026-642e2d52c0fd with identifier: KG98772 to the API
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:40:58Z',
 'fuel_type': 'petrol',
 'id': '8544742a-fcd5-5ed1-9026-642e2d52c0fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KG98772',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 114048,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-25',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Selection Start/Stop',
 'transmission': 'manual',
 'trim': 'Selection Start/Stop',
 'year': 2017}
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KG98772%27 HTTP/1.1" 200 None
2026-03-30 07:50:27 [auto1.de] INFO: Saving data for KG98772: {'auction_closing_time': 1774885258.0, 'created_time': 1774550159.000939, 'last_price_update_time': 1774857027.792876}
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KG98772') HTTP/1.1" 204 0
2026-03-30 07:50:27 [auto1.de] INFO: Found listing with ID: TE97467
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE97467%27 HTTP/1.1" 200 None
2026-03-30 07:50:27 [auto1.de] INFO: Scrape type for TE97467: 0
2026-03-30 07:50:27 [auto1.de] INFO: Found listing with ID: VK49169
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK49169%27 HTTP/1.1" 200 None
2026-03-30 07:50:27 [auto1.de] INFO: Scrape type for VK49169: 2
2026-03-30 07:50:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 977fa3d5-6a7c-5b45-bc64-19dc0c6bbe8e with identifier: VK49169
2026-03-30 07:50:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 977fa3d5-6a7c-5b45-bc64-19dc0c6bbe8e with scrape type 2
2026-03-30 07:50:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 977fa3d5-6a7c-5b45-bc64-19dc0c6bbe8e with scrape type 2
2026-03-30 07:50:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 977fa3d5-6a7c-5b45-bc64-19dc0c6bbe8e, identifier: VK49169
2026-03-30 07:50:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 977fa3d5-6a7c-5b45-bc64-19dc0c6bbe8e with identifier: VK49169
2026-03-30 07:50:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 977fa3d5-6a7c-5b45-bc64-19dc0c6bbe8e with identifier: VK49169
2026-03-30 07:50:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 977fa3d5-6a7c-5b45-bc64-19dc0c6bbe8e with identifier: VK49169 to the API
2026-03-30 07:50:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:38:08Z',
 'fuel_type': 'petrol',
 'id': '977fa3d5-6a7c-5b45-bc64-19dc0c6bbe8e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK49169',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 42925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-17',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2019}
2026-03-30 07:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK49169%27 HTTP/1.1" 200 None
2026-03-30 07:50:28 [auto1.de] INFO: Saving data for VK49169: {'auction_closing_time': 1774885088.0, 'created_time': 1773383561.702974, 'last_price_update_time': 1774857028.24184}
2026-03-30 07:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VK49169') HTTP/1.1" 204 0
2026-03-30 07:50:28 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-30 07:50:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:50:31 [auto1.de] INFO: Channel: 24h | Page: 167 | totalHits: 8412 | hits on page: 40
2026-03-30 07:50:31 [auto1.de] INFO: Found listing with ID: TW44839
2026-03-30 07:50:31 [auto1.de] INFO: Found listing with ID: UJ17280
2026-03-30 07:50:31 [auto1.de] INFO: Found listing with ID: EN92666
2026-03-30 07:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN92666%27 HTTP/1.1" 200 None
2026-03-30 07:50:31 [auto1.de] INFO: Scrape type for EN92666: 2
2026-03-30 07:50:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e527c72-ec18-53d3-85bc-41b6ecabf712 with identifier: EN92666
2026-03-30 07:50:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e527c72-ec18-53d3-85bc-41b6ecabf712 with scrape type 2
2026-03-30 07:50:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e527c72-ec18-53d3-85bc-41b6ecabf712 with scrape type 2
2026-03-30 07:50:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6e527c72-ec18-53d3-85bc-41b6ecabf712, identifier: EN92666
2026-03-30 07:50:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6e527c72-ec18-53d3-85bc-41b6ecabf712 with identifier: EN92666
2026-03-30 07:50:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6e527c72-ec18-53d3-85bc-41b6ecabf712 with identifier: EN92666
2026-03-30 07:50:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6e527c72-ec18-53d3-85bc-41b6ecabf712 with identifier: EN92666 to the API
2026-03-30 07:50:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:14:53Z',
 'fuel_type': 'diesel',
 'id': '6e527c72-ec18-53d3-85bc-41b6ecabf712',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN92666',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 355454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-18',
 'seller_name': None,
 'title': 'BMW X3 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN92666%27 HTTP/1.1" 200 None
2026-03-30 07:50:31 [auto1.de] INFO: Saving data for EN92666: {'auction_closing_time': 1774883693.0, 'created_time': 1773916592.110068, 'last_price_update_time': 1774857031.913561}
2026-03-30 07:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EN92666') HTTP/1.1" 204 0
2026-03-30 07:50:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: HX15626
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: YX12921
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: LK21356
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: CG53828
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: RL20580
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: AX39550
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: VK36740
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK36740%27 HTTP/1.1" 200 None
2026-03-30 07:50:32 [auto1.de] INFO: Scrape type for VK36740: 0
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: GK27432
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK27432%27 HTTP/1.1" 200 None
2026-03-30 07:50:32 [auto1.de] INFO: Scrape type for GK27432: 0
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: RF33157
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: WL85831
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL85831%27 HTTP/1.1" 200 None
2026-03-30 07:50:32 [auto1.de] INFO: Scrape type for WL85831: 2
2026-03-30 07:50:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b2b9286-a781-57f3-a7a1-f1b72ef23808 with identifier: WL85831
2026-03-30 07:50:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2b9286-a781-57f3-a7a1-f1b72ef23808 with scrape type 2
2026-03-30 07:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b2b9286-a781-57f3-a7a1-f1b72ef23808 with scrape type 2
2026-03-30 07:50:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0b2b9286-a781-57f3-a7a1-f1b72ef23808, identifier: WL85831
2026-03-30 07:50:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0b2b9286-a781-57f3-a7a1-f1b72ef23808 with identifier: WL85831
2026-03-30 07:50:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0b2b9286-a781-57f3-a7a1-f1b72ef23808 with identifier: WL85831
2026-03-30 07:50:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0b2b9286-a781-57f3-a7a1-f1b72ef23808 with identifier: WL85831 to the API
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:32:02Z',
 'fuel_type': 'petrol',
 'id': '0b2b9286-a781-57f3-a7a1-f1b72ef23808',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL85831',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 100935,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-28',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency AMG Sport',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency AMG Sport',
 'year': 2015}
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL85831%27 HTTP/1.1" 200 None
2026-03-30 07:50:32 [auto1.de] INFO: Saving data for WL85831: {'auction_closing_time': 1774884722.0, 'created_time': 1773131987.269259, 'last_price_update_time': 1774857032.45036}
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL85831') HTTP/1.1" 204 0
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: JT67031
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: LJ39551
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ39551%27 HTTP/1.1" 200 None
2026-03-30 07:50:32 [auto1.de] INFO: Scrape type for LJ39551: 0
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: MA51695
2026-03-30 07:50:32 [auto1.de] INFO: Found listing with ID: TX92076
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92076%27 HTTP/1.1" 200 None
2026-03-30 07:50:32 [auto1.de] INFO: Scrape type for TX92076: 2
2026-03-30 07:50:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a015ffd6-5d11-5fe9-9c65-afa153eebeda with identifier: TX92076
2026-03-30 07:50:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a015ffd6-5d11-5fe9-9c65-afa153eebeda with scrape type 2
2026-03-30 07:50:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a015ffd6-5d11-5fe9-9c65-afa153eebeda with scrape type 2
2026-03-30 07:50:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a015ffd6-5d11-5fe9-9c65-afa153eebeda, identifier: TX92076
2026-03-30 07:50:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a015ffd6-5d11-5fe9-9c65-afa153eebeda with identifier: TX92076
2026-03-30 07:50:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a015ffd6-5d11-5fe9-9c65-afa153eebeda with identifier: TX92076
2026-03-30 07:50:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a015ffd6-5d11-5fe9-9c65-afa153eebeda with identifier: TX92076 to the API
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-30T15:08:13Z',
 'fuel_type': 'petrol',
 'id': 'a015ffd6-5d11-5fe9-9c65-afa153eebeda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX92076',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 66209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-24',
 'seller_name': None,
 'title': 'BMW X5 xDrive 35i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX92076%27 HTTP/1.1" 200 None
2026-03-30 07:50:32 [auto1.de] INFO: Saving data for TX92076: {'auction_closing_time': 1774883293.0, 'created_time': 1774033554.194302, 'last_price_update_time': 1774857032.889021}
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX92076') HTTP/1.1" 204 0
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: FV21429
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV21429%27 HTTP/1.1" 200 None
2026-03-30 07:50:33 [auto1.de] INFO: Scrape type for FV21429: 0
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: CR82363
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR82363%27 HTTP/1.1" 200 None
2026-03-30 07:50:33 [auto1.de] INFO: Scrape type for CR82363: 0
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: VL78522
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: CY33039
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY33039%27 HTTP/1.1" 200 None
2026-03-30 07:50:33 [auto1.de] INFO: Scrape type for CY33039: 0
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: FU90427
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: TH91647
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: SZ45535
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45535%27 HTTP/1.1" 200 None
2026-03-30 07:50:33 [auto1.de] INFO: Scrape type for SZ45535: 2
2026-03-30 07:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 448c4626-3197-55ff-8b47-89ee05427533 with identifier: SZ45535
2026-03-30 07:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 448c4626-3197-55ff-8b47-89ee05427533 with scrape type 2
2026-03-30 07:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 448c4626-3197-55ff-8b47-89ee05427533 with scrape type 2
2026-03-30 07:50:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 448c4626-3197-55ff-8b47-89ee05427533, identifier: SZ45535
2026-03-30 07:50:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 448c4626-3197-55ff-8b47-89ee05427533 with identifier: SZ45535
2026-03-30 07:50:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 448c4626-3197-55ff-8b47-89ee05427533 with identifier: SZ45535
2026-03-30 07:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 448c4626-3197-55ff-8b47-89ee05427533 with identifier: SZ45535 to the API
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:21:09Z',
 'fuel_type': 'petrol',
 'id': '448c4626-3197-55ff-8b47-89ee05427533',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ45535',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Cabrio',
 'odometer': 37410,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-13',
 'seller_name': None,
 'title': 'MINI Cabrio Cooper S Classic Trim',
 'transmission': 'automatic',
 'trim': 'Classic Trim',
 'year': 2022}
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SZ45535%27 HTTP/1.1" 200 None
2026-03-30 07:50:33 [auto1.de] INFO: Saving data for SZ45535: {'auction_closing_time': 1774884069.0, 'created_time': 1774553246.576639, 'last_price_update_time': 1774857033.45414}
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SZ45535') HTTP/1.1" 204 0
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: KA00227
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA00227%27 HTTP/1.1" 200 None
2026-03-30 07:50:33 [auto1.de] INFO: Scrape type for KA00227: 2
2026-03-30 07:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfe56322-77e6-5d3c-a6f7-024072961226 with identifier: KA00227
2026-03-30 07:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfe56322-77e6-5d3c-a6f7-024072961226 with scrape type 2
2026-03-30 07:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfe56322-77e6-5d3c-a6f7-024072961226 with scrape type 2
2026-03-30 07:50:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cfe56322-77e6-5d3c-a6f7-024072961226, identifier: KA00227
2026-03-30 07:50:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cfe56322-77e6-5d3c-a6f7-024072961226 with identifier: KA00227
2026-03-30 07:50:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cfe56322-77e6-5d3c-a6f7-024072961226 with identifier: KA00227
2026-03-30 07:50:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cfe56322-77e6-5d3c-a6f7-024072961226 with identifier: KA00227 to the API
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:09:20Z',
 'fuel_type': 'diesel',
 'id': 'cfe56322-77e6-5d3c-a6f7-024072961226',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KA00227',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 90363,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': None,
 'title': 'Nissan Qashqai 1.7 dCi Tekna+ 4x4',
 'transmission': 'automatic',
 'trim': 'Tekna+ 4x4',
 'year': 2019}
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA00227%27 HTTP/1.1" 200 None
2026-03-30 07:50:33 [auto1.de] INFO: Saving data for KA00227: {'auction_closing_time': 1774883360.0, 'created_time': 1774552911.1823, 'last_price_update_time': 1774857033.87288}
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KA00227') HTTP/1.1" 204 0
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: LJ75768
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: KL68094
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KL68094%27 HTTP/1.1" 200 None
2026-03-30 07:50:33 [auto1.de] INFO: Scrape type for KL68094: 0
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: MH37188
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: SJ79213
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: DK31638
2026-03-30 07:50:33 [auto1.de] INFO: Found listing with ID: BM31151
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM31151%27 HTTP/1.1" 200 None
2026-03-30 07:50:33 [auto1.de] INFO: Scrape type for BM31151: 2
2026-03-30 07:50:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f69d09c-69bb-5ea1-a963-c9317750b1ab with identifier: BM31151
2026-03-30 07:50:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f69d09c-69bb-5ea1-a963-c9317750b1ab with scrape type 2
2026-03-30 07:50:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f69d09c-69bb-5ea1-a963-c9317750b1ab with scrape type 2
2026-03-30 07:50:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f69d09c-69bb-5ea1-a963-c9317750b1ab, identifier: BM31151
2026-03-30 07:50:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f69d09c-69bb-5ea1-a963-c9317750b1ab with identifier: BM31151
2026-03-30 07:50:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f69d09c-69bb-5ea1-a963-c9317750b1ab with identifier: BM31151
2026-03-30 07:50:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f69d09c-69bb-5ea1-a963-c9317750b1ab with identifier: BM31151 to the API
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:04:38Z',
 'fuel_type': 'petrol',
 'id': '7f69d09c-69bb-5ea1-a963-c9317750b1ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM31151',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 181794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-16',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2011}
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM31151%27 HTTP/1.1" 200 None
2026-03-30 07:50:34 [auto1.de] INFO: Saving data for BM31151: {'auction_closing_time': 1774883078.0, 'created_time': 1774551119.478608, 'last_price_update_time': 1774857034.293244}
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM31151') HTTP/1.1" 204 0
2026-03-30 07:50:34 [auto1.de] INFO: Found listing with ID: GM12066
2026-03-30 07:50:34 [auto1.de] INFO: Found listing with ID: PC91683
2026-03-30 07:50:34 [auto1.de] INFO: Found listing with ID: PM88586
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM88586%27 HTTP/1.1" 200 None
2026-03-30 07:50:34 [auto1.de] INFO: Scrape type for PM88586: 0
2026-03-30 07:50:34 [auto1.de] INFO: Found listing with ID: GG98787
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG98787%27 HTTP/1.1" 200 None
2026-03-30 07:50:34 [auto1.de] INFO: Scrape type for GG98787: 0
2026-03-30 07:50:34 [auto1.de] INFO: Found listing with ID: HD47083
2026-03-30 07:50:34 [auto1.de] INFO: Found listing with ID: BE24372
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE24372%27 HTTP/1.1" 200 None
2026-03-30 07:50:34 [auto1.de] INFO: Scrape type for BE24372: 2
2026-03-30 07:50:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f75d988-e70b-5139-a934-b5c0e85a23e1 with identifier: BE24372
2026-03-30 07:50:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f75d988-e70b-5139-a934-b5c0e85a23e1 with scrape type 2
2026-03-30 07:50:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f75d988-e70b-5139-a934-b5c0e85a23e1 with scrape type 2
2026-03-30 07:50:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2f75d988-e70b-5139-a934-b5c0e85a23e1, identifier: BE24372
2026-03-30 07:50:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2f75d988-e70b-5139-a934-b5c0e85a23e1 with identifier: BE24372
2026-03-30 07:50:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2f75d988-e70b-5139-a934-b5c0e85a23e1 with identifier: BE24372
2026-03-30 07:50:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2f75d988-e70b-5139-a934-b5c0e85a23e1 with identifier: BE24372 to the API
2026-03-30 07:50:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 550,
 'expiration_date': '2026-03-30T15:39:23Z',
 'fuel_type': 'petrol',
 'id': '2f75d988-e70b-5139-a934-b5c0e85a23e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE24372',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Cayenne',
 'odometer': 115320,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-14',
 'seller_name': None,
 'title': 'Porsche Cayenne Turbo',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-30 07:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE24372%27 HTTP/1.1" 200 None
2026-03-30 07:50:35 [auto1.de] INFO: Saving data for BE24372: {'auction_closing_time': 1774885163.0, 'created_time': 1774552774.700391, 'last_price_update_time': 1774857035.505985}
2026-03-30 07:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BE24372') HTTP/1.1" 204 0
2026-03-30 07:50:35 [auto1.de] INFO: Found listing with ID: GN50102
2026-03-30 07:50:35 [auto1.de] INFO: Found listing with ID: BS00370
2026-03-30 07:50:35 [auto1.de] INFO: Found listing with ID: XG51341
2026-03-30 07:50:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:50:36 [auto1.de] INFO: Channel: 24h | Page: 168 | totalHits: 8412 | hits on page: 40
2026-03-30 07:50:36 [auto1.de] INFO: Found listing with ID: HX18202
2026-03-30 07:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX18202%27 HTTP/1.1" 200 None
2026-03-30 07:50:36 [auto1.de] INFO: Scrape type for HX18202: 0
2026-03-30 07:50:36 [auto1.de] INFO: Found listing with ID: ZN65231
2026-03-30 07:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN65231%27 HTTP/1.1" 200 None
2026-03-30 07:50:36 [auto1.de] INFO: Scrape type for ZN65231: 2
2026-03-30 07:50:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fbd593d-f5c7-554a-bfae-0027fd18ce00 with identifier: ZN65231
2026-03-30 07:50:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fbd593d-f5c7-554a-bfae-0027fd18ce00 with scrape type 2
2026-03-30 07:50:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0fbd593d-f5c7-554a-bfae-0027fd18ce00 with scrape type 2
2026-03-30 07:50:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0fbd593d-f5c7-554a-bfae-0027fd18ce00, identifier: ZN65231
2026-03-30 07:50:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0fbd593d-f5c7-554a-bfae-0027fd18ce00 with identifier: ZN65231
2026-03-30 07:50:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0fbd593d-f5c7-554a-bfae-0027fd18ce00 with identifier: ZN65231
2026-03-30 07:50:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0fbd593d-f5c7-554a-bfae-0027fd18ce00 with identifier: ZN65231 to the API
2026-03-30 07:50:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:11:41Z',
 'fuel_type': 'petrol',
 'id': '0fbd593d-f5c7-554a-bfae-0027fd18ce00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZN65231',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 62451,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-20',
 'seller_name': None,
 'title': 'Audi A4 35 TFSI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2020}
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZN65231%27 HTTP/1.1" 200 None
2026-03-30 07:50:37 [auto1.de] INFO: Saving data for ZN65231: {'auction_closing_time': 1774883501.0, 'created_time': 1773916835.253385, 'last_price_update_time': 1774857037.165942}
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZN65231') HTTP/1.1" 204 0
2026-03-30 07:50:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:50:37 [auto1.de] INFO: Found listing with ID: LV47567
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV47567%27 HTTP/1.1" 200 None
2026-03-30 07:50:37 [auto1.de] INFO: Scrape type for LV47567: 0
2026-03-30 07:50:37 [auto1.de] INFO: Found listing with ID: FK36654
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK36654%27 HTTP/1.1" 200 None
2026-03-30 07:50:37 [auto1.de] INFO: Scrape type for FK36654: 0
2026-03-30 07:50:37 [auto1.de] INFO: Found listing with ID: XW56933
2026-03-30 07:50:37 [auto1.de] INFO: Found listing with ID: TT67137
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67137%27 HTTP/1.1" 200 None
2026-03-30 07:50:37 [auto1.de] INFO: Scrape type for TT67137: 2
2026-03-30 07:50:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc70e1e0-8790-5fe8-963e-604615959a4b with identifier: TT67137
2026-03-30 07:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc70e1e0-8790-5fe8-963e-604615959a4b with scrape type 2
2026-03-30 07:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc70e1e0-8790-5fe8-963e-604615959a4b with scrape type 2
2026-03-30 07:50:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc70e1e0-8790-5fe8-963e-604615959a4b, identifier: TT67137
2026-03-30 07:50:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc70e1e0-8790-5fe8-963e-604615959a4b with identifier: TT67137
2026-03-30 07:50:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc70e1e0-8790-5fe8-963e-604615959a4b with identifier: TT67137
2026-03-30 07:50:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc70e1e0-8790-5fe8-963e-604615959a4b with identifier: TT67137 to the API
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:50:23Z',
 'fuel_type': 'petrol',
 'id': 'fc70e1e0-8790-5fe8-963e-604615959a4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT67137',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 45767,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2017}
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT67137%27 HTTP/1.1" 200 None
2026-03-30 07:50:37 [auto1.de] INFO: Saving data for TT67137: {'auction_closing_time': 1774885823.0, 'created_time': 1774553198.187595, 'last_price_update_time': 1774857037.699816}
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TT67137') HTTP/1.1" 204 0
2026-03-30 07:50:37 [auto1.de] INFO: Found listing with ID: FB58638
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB58638%27 HTTP/1.1" 200 None
2026-03-30 07:50:37 [auto1.de] INFO: Scrape type for FB58638: 2
2026-03-30 07:50:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dab55629-b266-5071-a9f2-ff84ec17ddc3 with identifier: FB58638
2026-03-30 07:50:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dab55629-b266-5071-a9f2-ff84ec17ddc3 with scrape type 2
2026-03-30 07:50:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dab55629-b266-5071-a9f2-ff84ec17ddc3 with scrape type 2
2026-03-30 07:50:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dab55629-b266-5071-a9f2-ff84ec17ddc3, identifier: FB58638
2026-03-30 07:50:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dab55629-b266-5071-a9f2-ff84ec17ddc3 with identifier: FB58638
2026-03-30 07:50:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dab55629-b266-5071-a9f2-ff84ec17ddc3 with identifier: FB58638
2026-03-30 07:50:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dab55629-b266-5071-a9f2-ff84ec17ddc3 with identifier: FB58638 to the API
2026-03-30 07:50:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:18:31Z',
 'fuel_type': 'diesel',
 'id': 'dab55629-b266-5071-a9f2-ff84ec17ddc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB58638',
 'listing': 'auction',
 'make': 'Land Rover',
 'model': 'Evoque',
 'odometer': 186122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-21',
 'seller_name': None,
 'title': 'Land Rover Evoque 2.2 Sd4 Dynamic',
 'transmission': 'automatic',
 'trim': 'Dynamic',
 'year': 2011}
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB58638%27 HTTP/1.1" 200 None
2026-03-30 07:50:38 [auto1.de] INFO: Saving data for FB58638: {'auction_closing_time': 1774883911.0, 'created_time': 1774251392.469434, 'last_price_update_time': 1774857038.139294}
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FB58638') HTTP/1.1" 204 0
2026-03-30 07:50:38 [auto1.de] INFO: Found listing with ID: CT53994
2026-03-30 07:50:38 [auto1.de] INFO: Found listing with ID: FS32666
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS32666%27 HTTP/1.1" 200 None
2026-03-30 07:50:38 [auto1.de] INFO: Scrape type for FS32666: 0
2026-03-30 07:50:38 [auto1.de] INFO: Found listing with ID: FT28462
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT28462%27 HTTP/1.1" 200 None
2026-03-30 07:50:38 [auto1.de] INFO: Scrape type for FT28462: 2
2026-03-30 07:50:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5f2e52e8-9649-5a6b-9a07-794e894839e7 with identifier: FT28462
2026-03-30 07:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5f2e52e8-9649-5a6b-9a07-794e894839e7 with scrape type 2
2026-03-30 07:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5f2e52e8-9649-5a6b-9a07-794e894839e7 with scrape type 2
2026-03-30 07:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5f2e52e8-9649-5a6b-9a07-794e894839e7, identifier: FT28462
2026-03-30 07:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5f2e52e8-9649-5a6b-9a07-794e894839e7 with identifier: FT28462
2026-03-30 07:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5f2e52e8-9649-5a6b-9a07-794e894839e7 with identifier: FT28462
2026-03-30 07:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5f2e52e8-9649-5a6b-9a07-794e894839e7 with identifier: FT28462 to the API
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:44:27Z',
 'fuel_type': 'petrol',
 'id': '5f2e52e8-9649-5a6b-9a07-794e894839e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT28462',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'up!',
 'odometer': 24546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-14',
 'seller_name': None,
 'title': 'Volkswagen up! 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2022}
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT28462%27 HTTP/1.1" 200 None
2026-03-30 07:50:38 [auto1.de] INFO: Saving data for FT28462: {'auction_closing_time': 1774885467.0, 'created_time': 1774639926.928312, 'last_price_update_time': 1774857038.628878}
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FT28462') HTTP/1.1" 204 0
2026-03-30 07:50:38 [auto1.de] INFO: Found listing with ID: MA63217
2026-03-30 07:50:38 [auto1.de] INFO: Found listing with ID: CD81555
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD81555%27 HTTP/1.1" 200 None
2026-03-30 07:50:38 [auto1.de] INFO: Scrape type for CD81555: 0
2026-03-30 07:50:38 [auto1.de] INFO: Found listing with ID: YW34309
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW34309%27 HTTP/1.1" 200 None
2026-03-30 07:50:38 [auto1.de] INFO: Scrape type for YW34309: 2
2026-03-30 07:50:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9039aa5b-4108-50a3-9456-10bc99e97807 with identifier: YW34309
2026-03-30 07:50:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9039aa5b-4108-50a3-9456-10bc99e97807 with scrape type 2
2026-03-30 07:50:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9039aa5b-4108-50a3-9456-10bc99e97807 with scrape type 2
2026-03-30 07:50:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9039aa5b-4108-50a3-9456-10bc99e97807, identifier: YW34309
2026-03-30 07:50:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9039aa5b-4108-50a3-9456-10bc99e97807 with identifier: YW34309
2026-03-30 07:50:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9039aa5b-4108-50a3-9456-10bc99e97807 with identifier: YW34309
2026-03-30 07:50:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9039aa5b-4108-50a3-9456-10bc99e97807 with identifier: YW34309 to the API
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:12:41Z',
 'fuel_type': 'petrol',
 'id': '9039aa5b-4108-50a3-9456-10bc99e97807',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YW34309',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 123794,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-12',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 43 AMG 4Matic AMG',
 'transmission': 'automatic',
 'trim': '4Matic AMG',
 'year': 2015}
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW34309%27 HTTP/1.1" 200 None
2026-03-30 07:50:39 [auto1.de] INFO: Saving data for YW34309: {'auction_closing_time': 1774883561.0, 'created_time': 1773303230.175002, 'last_price_update_time': 1774857039.046696}
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YW34309') HTTP/1.1" 204 0
2026-03-30 07:50:39 [auto1.de] INFO: Found listing with ID: UT49919
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT49919%27 HTTP/1.1" 200 None
2026-03-30 07:50:39 [auto1.de] INFO: Scrape type for UT49919: 0
2026-03-30 07:50:39 [auto1.de] INFO: Found listing with ID: UC14078
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14078%27 HTTP/1.1" 200 None
2026-03-30 07:50:39 [auto1.de] INFO: Scrape type for UC14078: 2
2026-03-30 07:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 740bfd24-7484-5185-a06c-4301066ed66e with identifier: UC14078
2026-03-30 07:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 740bfd24-7484-5185-a06c-4301066ed66e with scrape type 2
2026-03-30 07:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 740bfd24-7484-5185-a06c-4301066ed66e with scrape type 2
2026-03-30 07:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 740bfd24-7484-5185-a06c-4301066ed66e, identifier: UC14078
2026-03-30 07:50:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 740bfd24-7484-5185-a06c-4301066ed66e with identifier: UC14078
2026-03-30 07:50:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 740bfd24-7484-5185-a06c-4301066ed66e with identifier: UC14078
2026-03-30 07:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 740bfd24-7484-5185-a06c-4301066ed66e with identifier: UC14078 to the API
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:42:58Z',
 'fuel_type': 'diesel',
 'id': '740bfd24-7484-5185-a06c-4301066ed66e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC14078',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 127814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC14078%27 HTTP/1.1" 200 None
2026-03-30 07:50:39 [auto1.de] INFO: Saving data for UC14078: {'auction_closing_time': 1774885378.0, 'created_time': 1774640080.748119, 'last_price_update_time': 1774857039.556227}
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC14078') HTTP/1.1" 204 0
2026-03-30 07:50:39 [auto1.de] INFO: Found listing with ID: UK53846
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UK53846%27 HTTP/1.1" 200 None
2026-03-30 07:50:39 [auto1.de] INFO: Scrape type for UK53846: 0
2026-03-30 07:50:39 [auto1.de] INFO: Found listing with ID: LW05271
2026-03-30 07:50:39 [auto1.de] INFO: Found listing with ID: DE59201
2026-03-30 07:50:39 [auto1.de] INFO: Found listing with ID: XK18770
2026-03-30 07:50:39 [auto1.de] INFO: Found listing with ID: BJ86438
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ86438%27 HTTP/1.1" 200 None
2026-03-30 07:50:39 [auto1.de] INFO: Scrape type for BJ86438: 0
2026-03-30 07:50:39 [auto1.de] INFO: Found listing with ID: WX24181
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WX24181%27 HTTP/1.1" 200 None
2026-03-30 07:50:39 [auto1.de] INFO: Scrape type for WX24181: 0
2026-03-30 07:50:39 [auto1.de] INFO: Found listing with ID: BM05172
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM05172%27 HTTP/1.1" 200 None
2026-03-30 07:50:39 [auto1.de] INFO: Scrape type for BM05172: 2
2026-03-30 07:50:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a9438a-cdb9-57da-b445-4f2cd927d5a1 with identifier: BM05172
2026-03-30 07:50:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a9438a-cdb9-57da-b445-4f2cd927d5a1 with scrape type 2
2026-03-30 07:50:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a9438a-cdb9-57da-b445-4f2cd927d5a1 with scrape type 2
2026-03-30 07:50:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d2a9438a-cdb9-57da-b445-4f2cd927d5a1, identifier: BM05172
2026-03-30 07:50:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d2a9438a-cdb9-57da-b445-4f2cd927d5a1 with identifier: BM05172
2026-03-30 07:50:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d2a9438a-cdb9-57da-b445-4f2cd927d5a1 with identifier: BM05172
2026-03-30 07:50:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d2a9438a-cdb9-57da-b445-4f2cd927d5a1 with identifier: BM05172 to the API
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:36:05Z',
 'fuel_type': 'petrol',
 'id': 'd2a9438a-cdb9-57da-b445-4f2cd927d5a1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM05172',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 6285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-20',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 TGDI Mild-Hybrid Ultimate Edition',
 'transmission': 'automatic',
 'trim': 'Ultimate Edition',
 'year': 2025}
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM05172%27 HTTP/1.1" 200 None
2026-03-30 07:50:40 [auto1.de] INFO: Saving data for BM05172: {'auction_closing_time': 1774884965.0, 'created_time': 1774639525.850258, 'last_price_update_time': 1774857040.033996}
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BM05172') HTTP/1.1" 204 0
2026-03-30 07:50:40 [auto1.de] INFO: Found listing with ID: RX21062
2026-03-30 07:50:40 [auto1.de] INFO: Found listing with ID: UD63369
2026-03-30 07:50:40 [auto1.de] INFO: Found listing with ID: NP46589
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP46589%27 HTTP/1.1" 200 None
2026-03-30 07:50:40 [auto1.de] INFO: Scrape type for NP46589: 0
2026-03-30 07:50:40 [auto1.de] INFO: Found listing with ID: XP95900
2026-03-30 07:50:40 [auto1.de] INFO: Found listing with ID: ND25281
2026-03-30 07:50:40 [auto1.de] INFO: Found listing with ID: PJ50890
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ50890%27 HTTP/1.1" 200 None
2026-03-30 07:50:40 [auto1.de] INFO: Scrape type for PJ50890: 2
2026-03-30 07:50:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0543a4ea-eef0-5039-b751-6dceb14e4061 with identifier: PJ50890
2026-03-30 07:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0543a4ea-eef0-5039-b751-6dceb14e4061 with scrape type 2
2026-03-30 07:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0543a4ea-eef0-5039-b751-6dceb14e4061 with scrape type 2
2026-03-30 07:50:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0543a4ea-eef0-5039-b751-6dceb14e4061, identifier: PJ50890
2026-03-30 07:50:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0543a4ea-eef0-5039-b751-6dceb14e4061 with identifier: PJ50890
2026-03-30 07:50:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0543a4ea-eef0-5039-b751-6dceb14e4061 with identifier: PJ50890
2026-03-30 07:50:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0543a4ea-eef0-5039-b751-6dceb14e4061 with identifier: PJ50890 to the API
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:46:24Z',
 'fuel_type': 'petrol',
 'id': '0543a4ea-eef0-5039-b751-6dceb14e4061',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ50890',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 159127,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-20',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Trend & Fun BlueMotion Tech',
 'year': 2012}
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ50890%27 HTTP/1.1" 200 None
2026-03-30 07:50:40 [auto1.de] INFO: Saving data for PJ50890: {'auction_closing_time': 1774885584.0, 'created_time': 1774639711.981083, 'last_price_update_time': 1774857040.483667}
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PJ50890') HTTP/1.1" 204 0
2026-03-30 07:50:40 [auto1.de] INFO: Found listing with ID: ZY31624
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY31624%27 HTTP/1.1" 200 None
2026-03-30 07:50:40 [auto1.de] INFO: Scrape type for ZY31624: 2
2026-03-30 07:50:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6e6e7df-665c-5b63-9311-855b59363c9f with identifier: ZY31624
2026-03-30 07:50:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6e6e7df-665c-5b63-9311-855b59363c9f with scrape type 2
2026-03-30 07:50:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6e6e7df-665c-5b63-9311-855b59363c9f with scrape type 2
2026-03-30 07:50:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6e6e7df-665c-5b63-9311-855b59363c9f, identifier: ZY31624
2026-03-30 07:50:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6e6e7df-665c-5b63-9311-855b59363c9f with identifier: ZY31624
2026-03-30 07:50:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6e6e7df-665c-5b63-9311-855b59363c9f with identifier: ZY31624
2026-03-30 07:50:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6e6e7df-665c-5b63-9311-855b59363c9f with identifier: ZY31624 to the API
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:36:34Z',
 'fuel_type': 'diesel',
 'id': 'b6e6e7df-665c-5b63-9311-855b59363c9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY31624',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 135732,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-24',
 'seller_name': None,
 'title': 'BMW X1 xDrive 20d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY31624%27 HTTP/1.1" 200 None
2026-03-30 07:50:40 [auto1.de] INFO: Saving data for ZY31624: {'auction_closing_time': 1774884994.0, 'created_time': 1774639843.253451, 'last_price_update_time': 1774857040.968555}
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY31624') HTTP/1.1" 204 0
2026-03-30 07:50:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:50:40 [auto1.de] INFO: Found listing with ID: HZ16106
2026-03-30 07:50:40 [auto1.de] INFO: Found listing with ID: LE21956
2026-03-30 07:50:40 [auto1.de] INFO: Found listing with ID: BV38151
2026-03-30 07:50:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38151%27 HTTP/1.1" 200 None
2026-03-30 07:50:41 [auto1.de] INFO: Scrape type for BV38151: 2
2026-03-30 07:50:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60e8b1e5-b7d2-50b7-9133-1bbe2988f6e8 with identifier: BV38151
2026-03-30 07:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60e8b1e5-b7d2-50b7-9133-1bbe2988f6e8 with scrape type 2
2026-03-30 07:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60e8b1e5-b7d2-50b7-9133-1bbe2988f6e8 with scrape type 2
2026-03-30 07:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60e8b1e5-b7d2-50b7-9133-1bbe2988f6e8, identifier: BV38151
2026-03-30 07:50:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60e8b1e5-b7d2-50b7-9133-1bbe2988f6e8 with identifier: BV38151
2026-03-30 07:50:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60e8b1e5-b7d2-50b7-9133-1bbe2988f6e8 with identifier: BV38151
2026-03-30 07:50:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60e8b1e5-b7d2-50b7-9133-1bbe2988f6e8 with identifier: BV38151 to the API
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:31:10Z',
 'fuel_type': 'petrol',
 'id': '60e8b1e5-b7d2-50b7-9133-1bbe2988f6e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV38151',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 41764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-22',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2013}
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BV38151%27 HTTP/1.1" 200 None
2026-03-30 07:50:41 [auto1.de] INFO: Saving data for BV38151: {'auction_closing_time': 1774884670.0, 'created_time': 1774640009.951639, 'last_price_update_time': 1774857041.370598}
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BV38151') HTTP/1.1" 204 0
2026-03-30 07:50:41 [auto1.de] INFO: Found listing with ID: SD67792
2026-03-30 07:50:41 [auto1.de] INFO: Found listing with ID: SC73852
2026-03-30 07:50:41 [auto1.de] INFO: Found listing with ID: RC48761
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC48761%27 HTTP/1.1" 200 None
2026-03-30 07:50:41 [auto1.de] INFO: Scrape type for RC48761: 2
2026-03-30 07:50:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ce98f32-02d8-5c72-9c41-8c1a51192989 with identifier: RC48761
2026-03-30 07:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ce98f32-02d8-5c72-9c41-8c1a51192989 with scrape type 2
2026-03-30 07:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ce98f32-02d8-5c72-9c41-8c1a51192989 with scrape type 2
2026-03-30 07:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4ce98f32-02d8-5c72-9c41-8c1a51192989, identifier: RC48761
2026-03-30 07:50:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4ce98f32-02d8-5c72-9c41-8c1a51192989 with identifier: RC48761
2026-03-30 07:50:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4ce98f32-02d8-5c72-9c41-8c1a51192989 with identifier: RC48761
2026-03-30 07:50:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4ce98f32-02d8-5c72-9c41-8c1a51192989 with identifier: RC48761 to the API
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:03:41Z',
 'fuel_type': 'diesel',
 'id': '4ce98f32-02d8-5c72-9c41-8c1a51192989',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC48761',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'DS5',
 'odometer': 99675,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-08',
 'seller_name': None,
 'title': 'Citroen DS5 2.0 HDi SportChic',
 'transmission': 'manual',
 'trim': 'SportChic',
 'year': 2012}
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC48761%27 HTTP/1.1" 200 None
2026-03-30 07:50:41 [auto1.de] INFO: Saving data for RC48761: {'auction_closing_time': 1774883021.0, 'created_time': 1774637282.84553, 'last_price_update_time': 1774857041.773298}
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RC48761') HTTP/1.1" 204 0
2026-03-30 07:50:41 [auto1.de] INFO: Channel: 24h | Page: 169 | totalHits: 8413 | hits on page: 40
2026-03-30 07:50:41 [auto1.de] INFO: Found listing with ID: JZ77542
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77542%27 HTTP/1.1" 200 None
2026-03-30 07:50:41 [auto1.de] INFO: Scrape type for JZ77542: 2
2026-03-30 07:50:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ae64f04-cdc5-5f7e-aa1f-1a4dad5717b8 with identifier: JZ77542
2026-03-30 07:50:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ae64f04-cdc5-5f7e-aa1f-1a4dad5717b8 with scrape type 2
2026-03-30 07:50:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ae64f04-cdc5-5f7e-aa1f-1a4dad5717b8 with scrape type 2
2026-03-30 07:50:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1ae64f04-cdc5-5f7e-aa1f-1a4dad5717b8, identifier: JZ77542
2026-03-30 07:50:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1ae64f04-cdc5-5f7e-aa1f-1a4dad5717b8 with identifier: JZ77542
2026-03-30 07:50:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1ae64f04-cdc5-5f7e-aa1f-1a4dad5717b8 with identifier: JZ77542
2026-03-30 07:50:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1ae64f04-cdc5-5f7e-aa1f-1a4dad5717b8 with identifier: JZ77542 to the API
2026-03-30 07:50:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:32:37Z',
 'fuel_type': 'petrol',
 'id': '1ae64f04-cdc5-5f7e-aa1f-1a4dad5717b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ77542',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 121354,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-29',
 'seller_name': None,
 'title': 'Fiat Punto 0.9 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2015}
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ77542%27 HTTP/1.1" 200 None
2026-03-30 07:50:42 [auto1.de] INFO: Saving data for JZ77542: {'auction_closing_time': 1774884757.0, 'created_time': 1774637321.863537, 'last_price_update_time': 1774857042.154717}
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ77542') HTTP/1.1" 204 0
2026-03-30 07:50:42 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-30 07:50:42 [auto1.de] INFO: Found listing with ID: YU55800
2026-03-30 07:50:42 [auto1.de] INFO: Found listing with ID: LX11356
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX11356%27 HTTP/1.1" 200 None
2026-03-30 07:50:42 [auto1.de] INFO: Scrape type for LX11356: 2
2026-03-30 07:50:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64189643-9b7f-52e2-bc86-f83627df2171 with identifier: LX11356
2026-03-30 07:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64189643-9b7f-52e2-bc86-f83627df2171 with scrape type 2
2026-03-30 07:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 64189643-9b7f-52e2-bc86-f83627df2171 with scrape type 2
2026-03-30 07:50:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 64189643-9b7f-52e2-bc86-f83627df2171, identifier: LX11356
2026-03-30 07:50:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:50:42 [auto1.de] INFO: Found listing with ID: AU06987
2026-03-30 07:50:42 [auto1.de] INFO: Found listing with ID: SX98211
2026-03-30 07:50:42 [auto1.de] INFO: Found listing with ID: SL60481
2026-03-30 07:50:42 [auto1.de] INFO: Found listing with ID: VE41795
2026-03-30 07:50:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 64189643-9b7f-52e2-bc86-f83627df2171 with identifier: LX11356
2026-03-30 07:50:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 64189643-9b7f-52e2-bc86-f83627df2171 with identifier: LX11356
2026-03-30 07:50:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 64189643-9b7f-52e2-bc86-f83627df2171 with identifier: LX11356 to the API
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:26:19Z',
 'fuel_type': 'diesel',
 'id': '64189643-9b7f-52e2-bc86-f83627df2171',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX11356',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 18157,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-04-03',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi EcoBlue 350 L2 Trend',
 'transmission': 'automatic',
 'trim': '350 L2 Trend',
 'year': 2025}
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX11356%27 HTTP/1.1" 200 None
2026-03-30 07:50:42 [auto1.de] INFO: Saving data for LX11356: {'auction_closing_time': 1774884379.0, 'created_time': 1773831202.338496, 'last_price_update_time': 1774857042.625102}
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LX11356') HTTP/1.1" 204 0
2026-03-30 07:50:42 [auto1.de] INFO: Found listing with ID: LD57431
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD57431%27 HTTP/1.1" 200 None
2026-03-30 07:50:42 [auto1.de] INFO: Scrape type for LD57431: 2
2026-03-30 07:50:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2302707-4398-5535-942e-8f134a1ae743 with identifier: LD57431
2026-03-30 07:50:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2302707-4398-5535-942e-8f134a1ae743 with scrape type 2
2026-03-30 07:50:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2302707-4398-5535-942e-8f134a1ae743 with scrape type 2
2026-03-30 07:50:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b2302707-4398-5535-942e-8f134a1ae743, identifier: LD57431
2026-03-30 07:50:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b2302707-4398-5535-942e-8f134a1ae743 with identifier: LD57431
2026-03-30 07:50:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b2302707-4398-5535-942e-8f134a1ae743 with identifier: LD57431
2026-03-30 07:50:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b2302707-4398-5535-942e-8f134a1ae743 with identifier: LD57431 to the API
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:11:34Z',
 'fuel_type': 'diesel',
 'id': 'b2302707-4398-5535-942e-8f134a1ae743',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LD57431',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 241877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-09-07',
 'seller_name': None,
 'title': 'Skoda Octavia 1.9 TDI Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2006}
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD57431%27 HTTP/1.1" 200 None
2026-03-30 07:50:43 [auto1.de] INFO: Saving data for LD57431: {'auction_closing_time': 1774883494.0, 'created_time': 1774637095.774835, 'last_price_update_time': 1774857043.095845}
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LD57431') HTTP/1.1" 204 0
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: PV56207
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: MZ98399
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ98399%27 HTTP/1.1" 200 None
2026-03-30 07:50:43 [auto1.de] INFO: Scrape type for MZ98399: 0
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: DW00961
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: NH92244
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: HX92939
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX92939%27 HTTP/1.1" 200 None
2026-03-30 07:50:43 [auto1.de] INFO: Scrape type for HX92939: 0
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: PB97430
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: FN16508
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN16508%27 HTTP/1.1" 200 None
2026-03-30 07:50:43 [auto1.de] INFO: Scrape type for FN16508: 0
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: YY43681
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: YB62347
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: BD43064
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: MJ13308
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: AJ27375
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ27375%27 HTTP/1.1" 200 None
2026-03-30 07:50:43 [auto1.de] INFO: Scrape type for AJ27375: 0
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: NE25486
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE25486%27 HTTP/1.1" 200 None
2026-03-30 07:50:43 [auto1.de] INFO: Scrape type for NE25486: 2
2026-03-30 07:50:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a9a6d1e-2b43-5ca0-932e-5f74071b07dd with identifier: NE25486
2026-03-30 07:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a9a6d1e-2b43-5ca0-932e-5f74071b07dd with scrape type 2
2026-03-30 07:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a9a6d1e-2b43-5ca0-932e-5f74071b07dd with scrape type 2
2026-03-30 07:50:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a9a6d1e-2b43-5ca0-932e-5f74071b07dd, identifier: NE25486
2026-03-30 07:50:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a9a6d1e-2b43-5ca0-932e-5f74071b07dd with identifier: NE25486
2026-03-30 07:50:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a9a6d1e-2b43-5ca0-932e-5f74071b07dd with identifier: NE25486
2026-03-30 07:50:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a9a6d1e-2b43-5ca0-932e-5f74071b07dd with identifier: NE25486 to the API
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-30T15:34:09Z',
 'fuel_type': 'petrol',
 'id': '1a9a6d1e-2b43-5ca0-932e-5f74071b07dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NE25486',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 26024,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-15',
 'seller_name': None,
 'title': 'BMW 4er 420i Gran Coupe M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2023}
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE25486%27 HTTP/1.1" 200 None
2026-03-30 07:50:43 [auto1.de] INFO: Saving data for NE25486: {'auction_closing_time': 1774884849.0, 'created_time': 1774639494.186392, 'last_price_update_time': 1774857043.563802}
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NE25486') HTTP/1.1" 204 0
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: VS70073
2026-03-30 07:50:43 [auto1.de] INFO: Found listing with ID: MA53170
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA53170%27 HTTP/1.1" 200 None
2026-03-30 07:50:43 [auto1.de] INFO: Scrape type for MA53170: 2
2026-03-30 07:50:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1067f35-1973-50de-8109-19c3998374c5 with identifier: MA53170
2026-03-30 07:50:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1067f35-1973-50de-8109-19c3998374c5 with scrape type 2
2026-03-30 07:50:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1067f35-1973-50de-8109-19c3998374c5 with scrape type 2
2026-03-30 07:50:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e1067f35-1973-50de-8109-19c3998374c5, identifier: MA53170
2026-03-30 07:50:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e1067f35-1973-50de-8109-19c3998374c5 with identifier: MA53170
2026-03-30 07:50:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e1067f35-1973-50de-8109-19c3998374c5 with identifier: MA53170
2026-03-30 07:50:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e1067f35-1973-50de-8109-19c3998374c5 with identifier: MA53170 to the API
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:08:14Z',
 'fuel_type': 'petrol',
 'id': 'e1067f35-1973-50de-8109-19c3998374c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA53170',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix20',
 'odometer': 145258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-22',
 'seller_name': None,
 'title': 'Hyundai ix20 1.4 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2012}
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA53170%27 HTTP/1.1" 200 None
2026-03-30 07:50:44 [auto1.de] INFO: Saving data for MA53170: {'auction_closing_time': 1774883294.0, 'created_time': 1774639753.492105, 'last_price_update_time': 1774857044.074753}
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MA53170') HTTP/1.1" 204 0
2026-03-30 07:50:44 [auto1.de] INFO: Found listing with ID: AW92068
2026-03-30 07:50:44 [auto1.de] INFO: Found listing with ID: MF48816
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF48816%27 HTTP/1.1" 200 None
2026-03-30 07:50:44 [auto1.de] INFO: Scrape type for MF48816: 0
2026-03-30 07:50:44 [auto1.de] INFO: Found listing with ID: EW17525
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW17525%27 HTTP/1.1" 200 None
2026-03-30 07:50:44 [auto1.de] INFO: Scrape type for EW17525: 2
2026-03-30 07:50:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4649216-87b8-5b7e-8a7f-ecd40054926a with identifier: EW17525
2026-03-30 07:50:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4649216-87b8-5b7e-8a7f-ecd40054926a with scrape type 2
2026-03-30 07:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4649216-87b8-5b7e-8a7f-ecd40054926a with scrape type 2
2026-03-30 07:50:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b4649216-87b8-5b7e-8a7f-ecd40054926a, identifier: EW17525
2026-03-30 07:50:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b4649216-87b8-5b7e-8a7f-ecd40054926a with identifier: EW17525
2026-03-30 07:50:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b4649216-87b8-5b7e-8a7f-ecd40054926a with identifier: EW17525
2026-03-30 07:50:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b4649216-87b8-5b7e-8a7f-ecd40054926a with identifier: EW17525 to the API
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-30T15:14:53Z',
 'fuel_type': 'diesel',
 'id': 'b4649216-87b8-5b7e-8a7f-ecd40054926a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW17525',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 167140,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Elegance 4Motion',
 'transmission': 'automatic',
 'trim': 'Elegance 4Motion',
 'year': 2019}
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW17525%27 HTTP/1.1" 200 None
2026-03-30 07:50:44 [auto1.de] INFO: Saving data for EW17525: {'auction_closing_time': 1774883693.0, 'created_time': 1774639880.750674, 'last_price_update_time': 1774857044.506507}
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW17525') HTTP/1.1" 204 0
2026-03-30 07:50:44 [auto1.de] INFO: Found listing with ID: WP04220
2026-03-30 07:50:44 [auto1.de] INFO: Found listing with ID: TB30393
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB30393%27 HTTP/1.1" 200 None
2026-03-30 07:50:44 [auto1.de] INFO: Scrape type for TB30393: 2
2026-03-30 07:50:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8f822ac-b5b3-5af1-b14f-af7246da6b8b with identifier: TB30393
2026-03-30 07:50:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8f822ac-b5b3-5af1-b14f-af7246da6b8b with scrape type 2
2026-03-30 07:50:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8f822ac-b5b3-5af1-b14f-af7246da6b8b with scrape type 2
2026-03-30 07:50:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e8f822ac-b5b3-5af1-b14f-af7246da6b8b, identifier: TB30393
2026-03-30 07:50:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e8f822ac-b5b3-5af1-b14f-af7246da6b8b with identifier: TB30393
2026-03-30 07:50:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e8f822ac-b5b3-5af1-b14f-af7246da6b8b with identifier: TB30393
2026-03-30 07:50:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e8f822ac-b5b3-5af1-b14f-af7246da6b8b with identifier: TB30393 to the API
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:02:42Z',
 'fuel_type': 'diesel',
 'id': 'e8f822ac-b5b3-5af1-b14f-af7246da6b8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB30393',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 166209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 220 d T 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': 'T 4Matic AMG Line',
 'year': 2017}
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB30393%27 HTTP/1.1" 200 None
2026-03-30 07:50:44 [auto1.de] INFO: Saving data for TB30393: {'auction_closing_time': 1774882962.0, 'created_time': 1774639592.329078, 'last_price_update_time': 1774857044.988229}
2026-03-30 07:50:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB30393') HTTP/1.1" 204 0
2026-03-30 07:50:45 [auto1.de] INFO: Found listing with ID: FZ02715
2026-03-30 07:50:45 [auto1.de] INFO: Found listing with ID: ZJ20078
2026-03-30 07:50:45 [auto1.de] INFO: Found listing with ID: JL21750
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL21750%27 HTTP/1.1" 200 None
2026-03-30 07:50:45 [auto1.de] INFO: Scrape type for JL21750: 2
2026-03-30 07:50:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6dad9da8-f27a-5b99-b356-52ba992cdc90 with identifier: JL21750
2026-03-30 07:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6dad9da8-f27a-5b99-b356-52ba992cdc90 with scrape type 2
2026-03-30 07:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6dad9da8-f27a-5b99-b356-52ba992cdc90 with scrape type 2
2026-03-30 07:50:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6dad9da8-f27a-5b99-b356-52ba992cdc90, identifier: JL21750
2026-03-30 07:50:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6dad9da8-f27a-5b99-b356-52ba992cdc90 with identifier: JL21750
2026-03-30 07:50:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6dad9da8-f27a-5b99-b356-52ba992cdc90 with identifier: JL21750
2026-03-30 07:50:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6dad9da8-f27a-5b99-b356-52ba992cdc90 with identifier: JL21750 to the API
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:21:37Z',
 'fuel_type': 'diesel',
 'id': '6dad9da8-f27a-5b99-b356-52ba992cdc90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL21750',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 201103,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-14',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi 310 L2 Trend',
 'transmission': 'manual',
 'trim': '310 L2 Trend',
 'year': 2015}
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL21750%27 HTTP/1.1" 200 None
2026-03-30 07:50:45 [auto1.de] INFO: Saving data for JL21750: {'auction_closing_time': 1774884097.0, 'created_time': 1774640069.484606, 'last_price_update_time': 1774857045.755449}
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JL21750') HTTP/1.1" 204 0
2026-03-30 07:50:45 [auto1.de] INFO: Found listing with ID: VC80296
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VC80296%27 HTTP/1.1" 200 None
2026-03-30 07:50:45 [auto1.de] INFO: Scrape type for VC80296: 0
2026-03-30 07:50:45 [auto1.de] INFO: Found listing with ID: UX30716
2026-03-30 07:50:45 [auto1.de] INFO: Found listing with ID: CZ36938
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CZ36938%27 HTTP/1.1" 200 None
2026-03-30 07:50:45 [auto1.de] INFO: Scrape type for CZ36938: 0
2026-03-30 07:50:45 [auto1.de] INFO: Found listing with ID: CD08059
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD08059%27 HTTP/1.1" 200 None
2026-03-30 07:50:45 [auto1.de] INFO: Scrape type for CD08059: 2
2026-03-30 07:50:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dc0b102-a533-5ae3-a72f-1d6bb6efe955 with identifier: CD08059
2026-03-30 07:50:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dc0b102-a533-5ae3-a72f-1d6bb6efe955 with scrape type 2
2026-03-30 07:50:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dc0b102-a533-5ae3-a72f-1d6bb6efe955 with scrape type 2
2026-03-30 07:50:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4dc0b102-a533-5ae3-a72f-1d6bb6efe955, identifier: CD08059
2026-03-30 07:50:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4dc0b102-a533-5ae3-a72f-1d6bb6efe955 with identifier: CD08059
2026-03-30 07:50:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4dc0b102-a533-5ae3-a72f-1d6bb6efe955 with identifier: CD08059
2026-03-30 07:50:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4dc0b102-a533-5ae3-a72f-1d6bb6efe955 with identifier: CD08059 to the API
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:33:09Z',
 'fuel_type': 'diesel',
 'id': '4dc0b102-a533-5ae3-a72f-1d6bb6efe955',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CD08059',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 207401,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Skoda Superb 2.0 TDI Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2015}
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD08059%27 HTTP/1.1" 200 None
2026-03-30 07:50:46 [auto1.de] INFO: Saving data for CD08059: {'auction_closing_time': 1774884789.0, 'created_time': 1774350801.454435, 'last_price_update_time': 1774857046.218222}
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CD08059') HTTP/1.1" 204 0
2026-03-30 07:50:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:50:46 [auto1.de] INFO: Found listing with ID: KY02769
2026-03-30 07:50:46 [auto1.de] INFO: Found listing with ID: KY11260
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY11260%27 HTTP/1.1" 200 None
2026-03-30 07:50:46 [auto1.de] INFO: Scrape type for KY11260: 2
2026-03-30 07:50:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f3a49b1-9599-5292-80c9-f26b4367bcb3 with identifier: KY11260
2026-03-30 07:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f3a49b1-9599-5292-80c9-f26b4367bcb3 with scrape type 2
2026-03-30 07:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f3a49b1-9599-5292-80c9-f26b4367bcb3 with scrape type 2
2026-03-30 07:50:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f3a49b1-9599-5292-80c9-f26b4367bcb3, identifier: KY11260
2026-03-30 07:50:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f3a49b1-9599-5292-80c9-f26b4367bcb3 with identifier: KY11260
2026-03-30 07:50:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f3a49b1-9599-5292-80c9-f26b4367bcb3 with identifier: KY11260
2026-03-30 07:50:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f3a49b1-9599-5292-80c9-f26b4367bcb3 with identifier: KY11260 to the API
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 178,
 'expiration_date': '2026-03-30T15:15:14Z',
 'fuel_type': 'petrol',
 'id': '4f3a49b1-9599-5292-80c9-f26b4367bcb3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KY11260',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 16324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-23',
 'seller_name': None,
 'title': 'MINI Countryman Cooper S ALL4 Classic Trim',
 'transmission': 'automatic',
 'trim': 'ALL4 Classic Trim',
 'year': 2022}
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY11260%27 HTTP/1.1" 200 None
2026-03-30 07:50:46 [auto1.de] INFO: Saving data for KY11260: {'auction_closing_time': 1774883714.0, 'created_time': 1773301701.754427, 'last_price_update_time': 1774857046.721333}
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KY11260') HTTP/1.1" 204 0
2026-03-30 07:50:46 [auto1.de] INFO: Found listing with ID: HU72855
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HU72855%27 HTTP/1.1" 200 None
2026-03-30 07:50:46 [auto1.de] INFO: Scrape type for HU72855: 0
2026-03-30 07:50:46 [auto1.de] INFO: Found listing with ID: PW98263
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW98263%27 HTTP/1.1" 200 None
2026-03-30 07:50:46 [auto1.de] INFO: Scrape type for PW98263: 0
2026-03-30 07:50:46 [auto1.de] INFO: Found listing with ID: PU90892
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU90892%27 HTTP/1.1" 200 None
2026-03-30 07:50:46 [auto1.de] INFO: Scrape type for PU90892: 0
2026-03-30 07:50:46 [auto1.de] INFO: Found listing with ID: NK67833
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67833%27 HTTP/1.1" 200 None
2026-03-30 07:50:46 [auto1.de] INFO: Scrape type for NK67833: 2
2026-03-30 07:50:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 878acaa2-295f-5c31-8041-b4605bdc5822 with identifier: NK67833
2026-03-30 07:50:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 878acaa2-295f-5c31-8041-b4605bdc5822 with scrape type 2
2026-03-30 07:50:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 878acaa2-295f-5c31-8041-b4605bdc5822 with scrape type 2
2026-03-30 07:50:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 878acaa2-295f-5c31-8041-b4605bdc5822, identifier: NK67833
2026-03-30 07:50:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 878acaa2-295f-5c31-8041-b4605bdc5822 with identifier: NK67833
2026-03-30 07:50:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 878acaa2-295f-5c31-8041-b4605bdc5822 with identifier: NK67833
2026-03-30 07:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 878acaa2-295f-5c31-8041-b4605bdc5822 with identifier: NK67833 to the API
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:25:33Z',
 'fuel_type': 'petrol',
 'id': '878acaa2-295f-5c31-8041-b4605bdc5822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK67833',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 82737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-02-02',
 'seller_name': None,
 'title': 'Skoda Roomster 1.2 TSI Fresh',
 'transmission': 'manual',
 'trim': 'Fresh',
 'year': 2014}
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NK67833%27 HTTP/1.1" 200 None
2026-03-30 07:50:47 [auto1.de] INFO: Saving data for NK67833: {'auction_closing_time': 1774884333.0, 'created_time': 1774639051.330429, 'last_price_update_time': 1774857047.188263}
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NK67833') HTTP/1.1" 204 0
2026-03-30 07:50:47 [auto1.de] INFO: Channel: 24h | Page: 170 | totalHits: 8413 | hits on page: 40
2026-03-30 07:50:47 [auto1.de] INFO: Found listing with ID: WB37074
2026-03-30 07:50:47 [auto1.de] INFO: Found listing with ID: RK60330
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK60330%27 HTTP/1.1" 200 None
2026-03-30 07:50:47 [auto1.de] INFO: Scrape type for RK60330: 2
2026-03-30 07:50:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 625bad95-6e25-5ccf-ba53-e23a97a4611f with identifier: RK60330
2026-03-30 07:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 625bad95-6e25-5ccf-ba53-e23a97a4611f with scrape type 2
2026-03-30 07:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 625bad95-6e25-5ccf-ba53-e23a97a4611f with scrape type 2
2026-03-30 07:50:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 625bad95-6e25-5ccf-ba53-e23a97a4611f, identifier: RK60330
2026-03-30 07:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 625bad95-6e25-5ccf-ba53-e23a97a4611f with identifier: RK60330
2026-03-30 07:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 625bad95-6e25-5ccf-ba53-e23a97a4611f with identifier: RK60330
2026-03-30 07:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 625bad95-6e25-5ccf-ba53-e23a97a4611f with identifier: RK60330 to the API
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:35:20Z',
 'fuel_type': 'diesel',
 'id': '625bad95-6e25-5ccf-ba53-e23a97a4611f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK60330',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 79453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-29',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d EDITION lang',
 'transmission': 'automatic',
 'trim': 'EDITION lang',
 'year': 2022}
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK60330%27 HTTP/1.1" 200 None
2026-03-30 07:50:47 [auto1.de] INFO: Saving data for RK60330: {'auction_closing_time': 1774884920.0, 'created_time': 1774638528.721431, 'last_price_update_time': 1774857047.580638}
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='RK60330') HTTP/1.1" 204 0
2026-03-30 07:50:47 [auto1.de] INFO: Found listing with ID: JF95451
2026-03-30 07:50:47 [auto1.de] INFO: Found listing with ID: PZ82865
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ82865%27 HTTP/1.1" 200 None
2026-03-30 07:50:47 [auto1.de] INFO: Scrape type for PZ82865: 0
2026-03-30 07:50:47 [auto1.de] INFO: Found listing with ID: VF27254
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF27254%27 HTTP/1.1" 200 None
2026-03-30 07:50:47 [auto1.de] INFO: Scrape type for VF27254: 0
2026-03-30 07:50:47 [auto1.de] INFO: Found listing with ID: DB26331
2026-03-30 07:50:47 [auto1.de] INFO: Found listing with ID: LK66468
2026-03-30 07:50:47 [auto1.de] INFO: Found listing with ID: ZS04919
2026-03-30 07:50:47 [auto1.de] INFO: Found listing with ID: LT58589
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT58589%27 HTTP/1.1" 200 None
2026-03-30 07:50:47 [auto1.de] INFO: Scrape type for LT58589: 2
2026-03-30 07:50:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57d39e88-f10c-51d7-958a-8c2a29b7fa7b with identifier: LT58589
2026-03-30 07:50:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57d39e88-f10c-51d7-958a-8c2a29b7fa7b with scrape type 2
2026-03-30 07:50:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57d39e88-f10c-51d7-958a-8c2a29b7fa7b with scrape type 2
2026-03-30 07:50:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 57d39e88-f10c-51d7-958a-8c2a29b7fa7b, identifier: LT58589
2026-03-30 07:50:47 [auto1.de] INFO: Found listing with ID: WN12652
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN12652%27 HTTP/1.1" 200 None
2026-03-30 07:50:47 [auto1.de] INFO: Scrape type for WN12652: 0
2026-03-30 07:50:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 57d39e88-f10c-51d7-958a-8c2a29b7fa7b with identifier: LT58589
2026-03-30 07:50:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 57d39e88-f10c-51d7-958a-8c2a29b7fa7b with identifier: LT58589
2026-03-30 07:50:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 57d39e88-f10c-51d7-958a-8c2a29b7fa7b with identifier: LT58589 to the API
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-30T15:01:04Z',
 'fuel_type': 'diesel',
 'id': '57d39e88-f10c-51d7-958a-8c2a29b7fa7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT58589',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sorento',
 'odometer': 235629,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-13',
 'seller_name': None,
 'title': 'Kia Sorento 2.2 CRDi Platinum Edition 4WD',
 'transmission': 'automatic',
 'trim': 'Platinum Edition 4WD',
 'year': 2016}
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT58589%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Saving data for LT58589: {'auction_closing_time': 1774882864.0, 'created_time': 1774639670.402432, 'last_price_update_time': 1774857048.045794}
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LT58589') HTTP/1.1" 204 0
2026-03-30 07:50:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: TK27520
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: VW20064
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: NH12576
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH12576%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for NH12576: 0
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: GZ43118
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ43118%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for GZ43118: 0
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: JR60766
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: DZ38540
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ38540%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for DZ38540: 0
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: PW95662
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: XA54655
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA54655%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for XA54655: 0
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: YV09971
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: HY06483
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HY06483%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for HY06483: 0
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: BU32595
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU32595%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for BU32595: 0
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: KF40481
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: PY30704
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30704%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for PY30704: 2
2026-03-30 07:50:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f9a4024-b56c-525a-9a8e-61a89103a47f with identifier: PY30704
2026-03-30 07:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f9a4024-b56c-525a-9a8e-61a89103a47f with scrape type 2
2026-03-30 07:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f9a4024-b56c-525a-9a8e-61a89103a47f with scrape type 2
2026-03-30 07:50:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f9a4024-b56c-525a-9a8e-61a89103a47f, identifier: PY30704
2026-03-30 07:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f9a4024-b56c-525a-9a8e-61a89103a47f with identifier: PY30704
2026-03-30 07:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f9a4024-b56c-525a-9a8e-61a89103a47f with identifier: PY30704
2026-03-30 07:50:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f9a4024-b56c-525a-9a8e-61a89103a47f with identifier: PY30704 to the API
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:35:03Z',
 'fuel_type': 'petrol',
 'id': '6f9a4024-b56c-525a-9a8e-61a89103a47f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY30704',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 239850,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-29',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Maxi Trendline',
 'transmission': 'manual',
 'trim': 'Maxi Trendline',
 'year': 2011}
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY30704%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Saving data for PY30704: {'auction_closing_time': 1774884903.0, 'created_time': 1774639562.595963, 'last_price_update_time': 1774857048.639744}
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PY30704') HTTP/1.1" 204 0
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: FV94610
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV94610%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for FV94610: 0
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: EG14085
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: GH53408
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: XP52765
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: UM78498
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: WM97258
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: NJ08644
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: GY83216
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY83216%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for GY83216: 0
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: XR01056
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR01056%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for XR01056: 0
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: XY63966
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XY63966%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for XY63966: 0
2026-03-30 07:50:48 [auto1.de] INFO: Found listing with ID: GH14315
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH14315%27 HTTP/1.1" 200 None
2026-03-30 07:50:48 [auto1.de] INFO: Scrape type for GH14315: 2
2026-03-30 07:50:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b85239f3-e9a1-5c97-bcfc-2c769159c44d with identifier: GH14315
2026-03-30 07:50:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b85239f3-e9a1-5c97-bcfc-2c769159c44d with scrape type 2
2026-03-30 07:50:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b85239f3-e9a1-5c97-bcfc-2c769159c44d with scrape type 2
2026-03-30 07:50:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b85239f3-e9a1-5c97-bcfc-2c769159c44d, identifier: GH14315
2026-03-30 07:50:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b85239f3-e9a1-5c97-bcfc-2c769159c44d with identifier: GH14315
2026-03-30 07:50:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b85239f3-e9a1-5c97-bcfc-2c769159c44d with identifier: GH14315
2026-03-30 07:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b85239f3-e9a1-5c97-bcfc-2c769159c44d with identifier: GH14315 to the API
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:33:43Z',
 'fuel_type': 'diesel',
 'id': 'b85239f3-e9a1-5c97-bcfc-2c769159c44d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH14315',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 133364,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-03',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2010}
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH14315%27 HTTP/1.1" 200 None
2026-03-30 07:50:49 [auto1.de] INFO: Saving data for GH14315: {'auction_closing_time': 1774884823.0, 'created_time': 1774639628.673235, 'last_price_update_time': 1774857049.199752}
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH14315') HTTP/1.1" 204 0
2026-03-30 07:50:49 [auto1.de] INFO: Found listing with ID: CM40362
2026-03-30 07:50:49 [auto1.de] INFO: Found listing with ID: NM34350
2026-03-30 07:50:49 [auto1.de] INFO: Found listing with ID: RR95104
2026-03-30 07:50:49 [auto1.de] INFO: Found listing with ID: MJ16162
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ16162%27 HTTP/1.1" 200 None
2026-03-30 07:50:49 [auto1.de] INFO: Scrape type for MJ16162: 2
2026-03-30 07:50:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85164653-b65e-50a3-9bdb-2fd60db14412 with identifier: MJ16162
2026-03-30 07:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85164653-b65e-50a3-9bdb-2fd60db14412 with scrape type 2
2026-03-30 07:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85164653-b65e-50a3-9bdb-2fd60db14412 with scrape type 2
2026-03-30 07:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 85164653-b65e-50a3-9bdb-2fd60db14412, identifier: MJ16162
2026-03-30 07:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 85164653-b65e-50a3-9bdb-2fd60db14412 with identifier: MJ16162
2026-03-30 07:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 85164653-b65e-50a3-9bdb-2fd60db14412 with identifier: MJ16162
2026-03-30 07:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 85164653-b65e-50a3-9bdb-2fd60db14412 with identifier: MJ16162 to the API
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:51:18Z',
 'fuel_type': 'diesel',
 'id': '85164653-b65e-50a3-9bdb-2fd60db14412',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ16162',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 211044,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 220 CDI 4Matic BlueEfficiency',
 'transmission': 'automatic',
 'trim': '4Matic BlueEfficiency',
 'year': 2012}
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ16162%27 HTTP/1.1" 200 None
2026-03-30 07:50:49 [auto1.de] INFO: Saving data for MJ16162: {'auction_closing_time': 1774885878.0, 'created_time': 1774639912.451033, 'last_price_update_time': 1774857049.685033}
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MJ16162') HTTP/1.1" 204 0
2026-03-30 07:50:49 [auto1.de] INFO: Found listing with ID: CJ52783
2026-03-30 07:50:49 [auto1.de] INFO: Found listing with ID: XG36075
2026-03-30 07:50:49 [auto1.de] INFO: Found listing with ID: MX66491
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MX66491%27 HTTP/1.1" 200 None
2026-03-30 07:50:49 [auto1.de] INFO: Scrape type for MX66491: 0
2026-03-30 07:50:49 [auto1.de] INFO: Found listing with ID: ZY67116
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67116%27 HTTP/1.1" 200 None
2026-03-30 07:50:49 [auto1.de] INFO: Scrape type for ZY67116: 2
2026-03-30 07:50:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51776a69-ef28-5800-a63e-84bde599a898 with identifier: ZY67116
2026-03-30 07:50:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51776a69-ef28-5800-a63e-84bde599a898 with scrape type 2
2026-03-30 07:50:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51776a69-ef28-5800-a63e-84bde599a898 with scrape type 2
2026-03-30 07:50:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 51776a69-ef28-5800-a63e-84bde599a898, identifier: ZY67116
2026-03-30 07:50:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 51776a69-ef28-5800-a63e-84bde599a898 with identifier: ZY67116
2026-03-30 07:50:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 51776a69-ef28-5800-a63e-84bde599a898 with identifier: ZY67116
2026-03-30 07:50:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 51776a69-ef28-5800-a63e-84bde599a898 with identifier: ZY67116 to the API
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:58:34Z',
 'fuel_type': 'petrol',
 'id': '51776a69-ef28-5800-a63e-84bde599a898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZY67116',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 72324,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-02',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY67116%27 HTTP/1.1" 200 None
2026-03-30 07:50:50 [auto1.de] INFO: Saving data for ZY67116: {'auction_closing_time': 1774886314.0, 'created_time': 1774553225.853692, 'last_price_update_time': 1774857050.100854}
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZY67116') HTTP/1.1" 204 0
2026-03-30 07:50:50 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33465%27 HTTP/1.1" 200 None
2026-03-30 07:50:50 [auto1.de] INFO: Scrape type for MM33465: 2
2026-03-30 07:50:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with identifier: MM33465
2026-03-30 07:50:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with scrape type 2
2026-03-30 07:50:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with scrape type 2
2026-03-30 07:50:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8efa675e-2ebc-5b98-b31f-ebc4fa515a82, identifier: MM33465
2026-03-30 07:50:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with identifier: MM33465
2026-03-30 07:50:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with identifier: MM33465
2026-03-30 07:50:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8efa675e-2ebc-5b98-b31f-ebc4fa515a82 with identifier: MM33465 to the API
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:12:09Z',
 'fuel_type': 'petrol',
 'id': '8efa675e-2ebc-5b98-b31f-ebc4fa515a82',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM33465',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '626',
 'odometer': 103265,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1989-09-25',
 'seller_name': None,
 'title': 'Mazda 626 2.0 GT',
 'transmission': 'manual',
 'trim': 'GT',
 'year': 1989}
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33465%27 HTTP/1.1" 200 None
2026-03-30 07:50:50 [auto1.de] INFO: Saving data for MM33465: {'auction_closing_time': 1774883529.0, 'created_time': 1774552361.714931, 'last_price_update_time': 1774857050.497458}
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MM33465') HTTP/1.1" 204 0
2026-03-30 07:50:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:50:52 [auto1.de] INFO: Channel: 24h | Page: 171 | totalHits: 8414 | hits on page: 40
2026-03-30 07:50:52 [auto1.de] INFO: Found listing with ID: MM33465
2026-03-30 07:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MM33465%27 HTTP/1.1" 200 None
2026-03-30 07:50:52 [auto1.de] INFO: Scrape type for MM33465: 0
2026-03-30 07:50:52 [auto1.de] INFO: Found listing with ID: WY50003
2026-03-30 07:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50003%27 HTTP/1.1" 200 None
2026-03-30 07:50:52 [auto1.de] INFO: Scrape type for WY50003: 2
2026-03-30 07:50:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with identifier: WY50003
2026-03-30 07:50:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with scrape type 2
2026-03-30 07:50:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with scrape type 2
2026-03-30 07:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59, identifier: WY50003
2026-03-30 07:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with identifier: WY50003
2026-03-30 07:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with identifier: WY50003
2026-03-30 07:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59 with identifier: WY50003 to the API
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:08:22Z',
 'fuel_type': 'diesel',
 'id': 'c4c84bb3-ec30-563e-ad3a-c9e96e0c7a59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY50003',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 99922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-08',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2017}
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY50003%27 HTTP/1.1" 200 None
2026-03-30 07:50:53 [auto1.de] INFO: Saving data for WY50003: {'auction_closing_time': 1774883302.0, 'created_time': 1774552814.889691, 'last_price_update_time': 1774857053.360036}
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WY50003') HTTP/1.1" 204 0
2026-03-30 07:50:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:50:53 [auto1.de] INFO: Found listing with ID: JK50656
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JK50656%27 HTTP/1.1" 200 None
2026-03-30 07:50:53 [auto1.de] INFO: Scrape type for JK50656: 0
2026-03-30 07:50:53 [auto1.de] INFO: Found listing with ID: ZE17013
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZE17013%27 HTTP/1.1" 200 None
2026-03-30 07:50:53 [auto1.de] INFO: Scrape type for ZE17013: 0
2026-03-30 07:50:53 [auto1.de] INFO: Found listing with ID: YT60499
2026-03-30 07:50:53 [auto1.de] INFO: Found listing with ID: VN69903
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN69903%27 HTTP/1.1" 200 None
2026-03-30 07:50:53 [auto1.de] INFO: Scrape type for VN69903: 2
2026-03-30 07:50:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b60c9894-e37d-5785-9897-976ccb74bf9b with identifier: VN69903
2026-03-30 07:50:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b60c9894-e37d-5785-9897-976ccb74bf9b with scrape type 2
2026-03-30 07:50:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b60c9894-e37d-5785-9897-976ccb74bf9b with scrape type 2
2026-03-30 07:50:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b60c9894-e37d-5785-9897-976ccb74bf9b, identifier: VN69903
2026-03-30 07:50:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b60c9894-e37d-5785-9897-976ccb74bf9b with identifier: VN69903
2026-03-30 07:50:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b60c9894-e37d-5785-9897-976ccb74bf9b with identifier: VN69903
2026-03-30 07:50:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b60c9894-e37d-5785-9897-976ccb74bf9b with identifier: VN69903 to the API
2026-03-30 07:50:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:57:59Z',
 'fuel_type': 'petrol',
 'id': 'b60c9894-e37d-5785-9897-976ccb74bf9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN69903',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 136837,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-07-17',
 'seller_name': None,
 'title': 'Renault Megane 1.2 Paris',
 'transmission': 'manual',
 'trim': 'Paris',
 'year': 2013}
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN69903%27 HTTP/1.1" 200 None
2026-03-30 07:50:54 [auto1.de] INFO: Saving data for VN69903: {'auction_closing_time': 1774886279.0, 'created_time': 1774550538.906119, 'last_price_update_time': 1774857054.159138}
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN69903') HTTP/1.1" 204 0
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: YJ00075
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ00075%27 HTTP/1.1" 200 None
2026-03-30 07:50:54 [auto1.de] INFO: Scrape type for YJ00075: 0
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: XS25100
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS25100%27 HTTP/1.1" 200 None
2026-03-30 07:50:54 [auto1.de] INFO: Scrape type for XS25100: 2
2026-03-30 07:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 710408a8-254f-50ff-bef6-e430bc7bef7b with identifier: XS25100
2026-03-30 07:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 710408a8-254f-50ff-bef6-e430bc7bef7b with scrape type 2
2026-03-30 07:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 710408a8-254f-50ff-bef6-e430bc7bef7b with scrape type 2
2026-03-30 07:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 710408a8-254f-50ff-bef6-e430bc7bef7b, identifier: XS25100
2026-03-30 07:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 710408a8-254f-50ff-bef6-e430bc7bef7b with identifier: XS25100
2026-03-30 07:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 710408a8-254f-50ff-bef6-e430bc7bef7b with identifier: XS25100
2026-03-30 07:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 710408a8-254f-50ff-bef6-e430bc7bef7b with identifier: XS25100 to the API
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:41:05Z',
 'fuel_type': 'petrol',
 'id': '710408a8-254f-50ff-bef6-e430bc7bef7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS25100',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Dokker',
 'odometer': 61077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-22',
 'seller_name': None,
 'title': 'Dacia Dokker 1.6 SCe Stepway',
 'transmission': 'manual',
 'trim': 'Stepway',
 'year': 2019}
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS25100%27 HTTP/1.1" 200 None
2026-03-30 07:50:54 [auto1.de] INFO: Saving data for XS25100: {'auction_closing_time': 1774885265.0, 'created_time': 1774550633.808742, 'last_price_update_time': 1774857054.615945}
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS25100') HTTP/1.1" 204 0
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: ZB59934
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB59934%27 HTTP/1.1" 200 None
2026-03-30 07:50:54 [auto1.de] INFO: Scrape type for ZB59934: 0
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: ZU85888
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: DK81412
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: SK08799
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: LN23623
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LN23623%27 HTTP/1.1" 200 None
2026-03-30 07:50:54 [auto1.de] INFO: Scrape type for LN23623: 0
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: GT57416
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: MK32752
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: YS74184
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: NE31655
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE31655%27 HTTP/1.1" 200 None
2026-03-30 07:50:54 [auto1.de] INFO: Scrape type for NE31655: 0
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: VS20151
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: PA97502
2026-03-30 07:50:54 [auto1.de] INFO: Found listing with ID: CM27166
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM27166%27 HTTP/1.1" 200 None
2026-03-30 07:50:54 [auto1.de] INFO: Scrape type for CM27166: 2
2026-03-30 07:50:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 059308f8-a7ee-55c9-bfda-d01459e6cda2 with identifier: CM27166
2026-03-30 07:50:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 059308f8-a7ee-55c9-bfda-d01459e6cda2 with scrape type 2
2026-03-30 07:50:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 059308f8-a7ee-55c9-bfda-d01459e6cda2 with scrape type 2
2026-03-30 07:50:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 059308f8-a7ee-55c9-bfda-d01459e6cda2, identifier: CM27166
2026-03-30 07:50:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 059308f8-a7ee-55c9-bfda-d01459e6cda2 with identifier: CM27166
2026-03-30 07:50:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 059308f8-a7ee-55c9-bfda-d01459e6cda2 with identifier: CM27166
2026-03-30 07:50:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 059308f8-a7ee-55c9-bfda-d01459e6cda2 with identifier: CM27166 to the API
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:41:05Z',
 'fuel_type': 'petrol',
 'id': '059308f8-a7ee-55c9-bfda-d01459e6cda2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM27166',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 184083,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-10',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM27166%27 HTTP/1.1" 200 None
2026-03-30 07:50:55 [auto1.de] INFO: Saving data for CM27166: {'auction_closing_time': 1774885265.0, 'created_time': 1773946073.798885, 'last_price_update_time': 1774857055.061858}
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CM27166') HTTP/1.1" 204 0
2026-03-30 07:50:55 [auto1.de] INFO: Found listing with ID: DX01361
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01361%27 HTTP/1.1" 200 None
2026-03-30 07:50:55 [auto1.de] INFO: Scrape type for DX01361: 2
2026-03-30 07:50:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33c0e883-f388-5741-ab13-d22847df819a with identifier: DX01361
2026-03-30 07:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33c0e883-f388-5741-ab13-d22847df819a with scrape type 2
2026-03-30 07:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33c0e883-f388-5741-ab13-d22847df819a with scrape type 2
2026-03-30 07:50:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 33c0e883-f388-5741-ab13-d22847df819a, identifier: DX01361
2026-03-30 07:50:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 33c0e883-f388-5741-ab13-d22847df819a with identifier: DX01361
2026-03-30 07:50:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 33c0e883-f388-5741-ab13-d22847df819a with identifier: DX01361
2026-03-30 07:50:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 33c0e883-f388-5741-ab13-d22847df819a with identifier: DX01361 to the API
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:51:57Z',
 'fuel_type': 'diesel',
 'id': '33c0e883-f388-5741-ab13-d22847df819a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX01361',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5',
 'odometer': 122603,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-19',
 'seller_name': None,
 'title': 'Audi A5 2.0 TDI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DX01361%27 HTTP/1.1" 200 None
2026-03-30 07:50:55 [auto1.de] INFO: Saving data for DX01361: {'auction_closing_time': 1774885917.0, 'created_time': 1774638996.110806, 'last_price_update_time': 1774857055.579406}
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DX01361') HTTP/1.1" 204 0
2026-03-30 07:50:55 [auto1.de] INFO: Found listing with ID: XJ97474
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ97474%27 HTTP/1.1" 200 None
2026-03-30 07:50:55 [auto1.de] INFO: Scrape type for XJ97474: 0
2026-03-30 07:50:55 [auto1.de] INFO: Found listing with ID: JR87294
2026-03-30 07:50:55 [auto1.de] INFO: Found listing with ID: ST89847
2026-03-30 07:50:55 [auto1.de] INFO: Found listing with ID: XN65057
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN65057%27 HTTP/1.1" 200 None
2026-03-30 07:50:55 [auto1.de] INFO: Scrape type for XN65057: 2
2026-03-30 07:50:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with identifier: XN65057
2026-03-30 07:50:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with scrape type 2
2026-03-30 07:50:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with scrape type 2
2026-03-30 07:50:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6, identifier: XN65057
2026-03-30 07:50:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with identifier: XN65057
2026-03-30 07:50:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with identifier: XN65057
2026-03-30 07:50:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 885c24c4-bb32-57f9-8cbd-7aa8d88e19a6 with identifier: XN65057 to the API
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:02:40Z',
 'fuel_type': 'diesel',
 'id': '885c24c4-bb32-57f9-8cbd-7aa8d88e19a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XN65057',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 128776,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-24',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.6 TDI IQ.DRIVE',
 'transmission': 'manual',
 'trim': 'IQ.DRIVE',
 'year': 2019}
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN65057%27 HTTP/1.1" 200 None
2026-03-30 07:50:55 [auto1.de] INFO: Saving data for XN65057: {'auction_closing_time': 1774882960.0, 'created_time': 1774553136.172931, 'last_price_update_time': 1774857055.985123}
2026-03-30 07:50:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XN65057') HTTP/1.1" 204 0
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: EW02544
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW02544%27 HTTP/1.1" 200 None
2026-03-30 07:50:56 [auto1.de] INFO: Scrape type for EW02544: 2
2026-03-30 07:50:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4398e8-dee8-55ff-acd2-2548d02a7cfa with identifier: EW02544
2026-03-30 07:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4398e8-dee8-55ff-acd2-2548d02a7cfa with scrape type 2
2026-03-30 07:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb4398e8-dee8-55ff-acd2-2548d02a7cfa with scrape type 2
2026-03-30 07:50:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: eb4398e8-dee8-55ff-acd2-2548d02a7cfa, identifier: EW02544
2026-03-30 07:50:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: eb4398e8-dee8-55ff-acd2-2548d02a7cfa with identifier: EW02544
2026-03-30 07:50:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: eb4398e8-dee8-55ff-acd2-2548d02a7cfa with identifier: EW02544
2026-03-30 07:50:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: eb4398e8-dee8-55ff-acd2-2548d02a7cfa with identifier: EW02544 to the API
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:44Z',
 'fuel_type': 'petrol',
 'id': 'eb4398e8-dee8-55ff-acd2-2548d02a7cfa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW02544',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Adam',
 'odometer': 134200,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-11',
 'seller_name': None,
 'title': 'Opel Adam 1.4 Turbo S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2015}
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW02544%27 HTTP/1.1" 200 None
2026-03-30 07:50:56 [auto1.de] INFO: Saving data for EW02544: {'auction_closing_time': 1774883744.0, 'created_time': 1774553089.639965, 'last_price_update_time': 1774857056.379932}
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EW02544') HTTP/1.1" 204 0
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: JV68869
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JV68869%27 HTTP/1.1" 200 None
2026-03-30 07:50:56 [auto1.de] INFO: Scrape type for JV68869: 0
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: NW02543
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW02543%27 HTTP/1.1" 200 None
2026-03-30 07:50:56 [auto1.de] INFO: Scrape type for NW02543: 2
2026-03-30 07:50:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fa7f5e3-9bb7-59e1-9436-ca82339565d8 with identifier: NW02543
2026-03-30 07:50:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fa7f5e3-9bb7-59e1-9436-ca82339565d8 with scrape type 2
2026-03-30 07:50:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fa7f5e3-9bb7-59e1-9436-ca82339565d8 with scrape type 2
2026-03-30 07:50:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7fa7f5e3-9bb7-59e1-9436-ca82339565d8, identifier: NW02543
2026-03-30 07:50:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7fa7f5e3-9bb7-59e1-9436-ca82339565d8 with identifier: NW02543
2026-03-30 07:50:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7fa7f5e3-9bb7-59e1-9436-ca82339565d8 with identifier: NW02543
2026-03-30 07:50:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7fa7f5e3-9bb7-59e1-9436-ca82339565d8 with identifier: NW02543 to the API
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-30T15:44:19Z',
 'fuel_type': 'diesel',
 'id': '7fa7f5e3-9bb7-59e1-9436-ca82339565d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW02543',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 270892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-04-27',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 320 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2006}
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW02543%27 HTTP/1.1" 200 None
2026-03-30 07:50:56 [auto1.de] INFO: Saving data for NW02543: {'auction_closing_time': 1774885459.0, 'created_time': 1774639020.709839, 'last_price_update_time': 1774857056.879945}
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW02543') HTTP/1.1" 204 0
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: RX10948
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX10948%27 HTTP/1.1" 200 None
2026-03-30 07:50:56 [auto1.de] INFO: Scrape type for RX10948: 0
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: ZL98433
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL98433%27 HTTP/1.1" 200 None
2026-03-30 07:50:56 [auto1.de] INFO: Scrape type for ZL98433: 0
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: RB77182
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: XV15906
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: FV46397
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: YV35353
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV35353%27 HTTP/1.1" 200 None
2026-03-30 07:50:56 [auto1.de] INFO: Scrape type for YV35353: 0
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: HA44433
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: LL60682
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: KY06770
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY06770%27 HTTP/1.1" 200 None
2026-03-30 07:50:56 [auto1.de] INFO: Scrape type for KY06770: 0
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: PC35903
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC35903%27 HTTP/1.1" 200 None
2026-03-30 07:50:56 [auto1.de] INFO: Scrape type for PC35903: 0
2026-03-30 07:50:56 [auto1.de] INFO: Found listing with ID: VR25014
2026-03-30 07:50:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR25014%27 HTTP/1.1" 200 None
2026-03-30 07:50:57 [auto1.de] INFO: Scrape type for VR25014: 2
2026-03-30 07:50:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4622e2a1-2270-59d5-9513-aae6bca98e30 with identifier: VR25014
2026-03-30 07:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4622e2a1-2270-59d5-9513-aae6bca98e30 with scrape type 2
2026-03-30 07:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4622e2a1-2270-59d5-9513-aae6bca98e30 with scrape type 2
2026-03-30 07:50:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4622e2a1-2270-59d5-9513-aae6bca98e30, identifier: VR25014
2026-03-30 07:50:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:50:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4622e2a1-2270-59d5-9513-aae6bca98e30 with identifier: VR25014
2026-03-30 07:50:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4622e2a1-2270-59d5-9513-aae6bca98e30 with identifier: VR25014
2026-03-30 07:50:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4622e2a1-2270-59d5-9513-aae6bca98e30 with identifier: VR25014 to the API
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:19:11Z',
 'fuel_type': 'diesel',
 'id': '4622e2a1-2270-59d5-9513-aae6bca98e30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR25014',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q8',
 'odometer': 121250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-05',
 'seller_name': None,
 'title': 'Audi Q8 50 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR25014%27 HTTP/1.1" 200 None
2026-03-30 07:50:57 [auto1.de] INFO: Saving data for VR25014: {'auction_closing_time': 1774883951.0, 'created_time': 1774350911.390542, 'last_price_update_time': 1774857057.385699}
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR25014') HTTP/1.1" 204 0
2026-03-30 07:50:57 [auto1.de] INFO: Found listing with ID: XS93446
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS93446%27 HTTP/1.1" 200 None
2026-03-30 07:50:57 [auto1.de] INFO: Scrape type for XS93446: 2
2026-03-30 07:50:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with identifier: XS93446
2026-03-30 07:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with scrape type 2
2026-03-30 07:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with scrape type 2
2026-03-30 07:50:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c, identifier: XS93446
2026-03-30 07:50:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with identifier: XS93446
2026-03-30 07:50:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with identifier: XS93446
2026-03-30 07:50:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c with identifier: XS93446 to the API
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 435,
 'expiration_date': '2026-03-30T15:24:10Z',
 'fuel_type': 'petrol',
 'id': 'c64cc156-4e62-5f2e-83cd-fd8d43aa6d8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS93446',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S6',
 'odometer': 242504,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-27',
 'seller_name': None,
 'title': 'Audi S6 5.2 V10 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2007}
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS93446%27 HTTP/1.1" 200 None
2026-03-30 07:50:57 [auto1.de] INFO: Saving data for XS93446: {'auction_closing_time': 1774884250.0, 'created_time': 1774553204.657941, 'last_price_update_time': 1774857057.87906}
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS93446') HTTP/1.1" 204 0
2026-03-30 07:50:57 [auto1.de] INFO: Channel: 24h | Page: 172 | totalHits: 8414 | hits on page: 40
2026-03-30 07:50:57 [auto1.de] INFO: Found listing with ID: BX01003
2026-03-30 07:50:57 [auto1.de] INFO: Found listing with ID: CC89371
2026-03-30 07:50:57 [auto1.de] INFO: Found listing with ID: GH20850
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH20850%27 HTTP/1.1" 200 None
2026-03-30 07:50:57 [auto1.de] INFO: Scrape type for GH20850: 2
2026-03-30 07:50:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fb5475f-7208-5b72-8d05-e2ce05972a01 with identifier: GH20850
2026-03-30 07:50:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fb5475f-7208-5b72-8d05-e2ce05972a01 with scrape type 2
2026-03-30 07:50:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fb5475f-7208-5b72-8d05-e2ce05972a01 with scrape type 2
2026-03-30 07:50:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4fb5475f-7208-5b72-8d05-e2ce05972a01, identifier: GH20850
2026-03-30 07:50:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:50:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4fb5475f-7208-5b72-8d05-e2ce05972a01 with identifier: GH20850
2026-03-30 07:50:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4fb5475f-7208-5b72-8d05-e2ce05972a01 with identifier: GH20850
2026-03-30 07:50:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4fb5475f-7208-5b72-8d05-e2ce05972a01 with identifier: GH20850 to the API
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:43:32Z',
 'fuel_type': 'diesel',
 'id': '4fb5475f-7208-5b72-8d05-e2ce05972a01',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH20850',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Boxer',
 'odometer': 324058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-27',
 'seller_name': None,
 'title': 'Peugeot Boxer 2.2 HDi HDi',
 'transmission': 'manual',
 'trim': 'HDi',
 'year': 2010}
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH20850%27 HTTP/1.1" 200 None
2026-03-30 07:50:58 [auto1.de] INFO: Saving data for GH20850: {'auction_closing_time': 1774885412.0, 'created_time': 1774550148.491931, 'last_price_update_time': 1774857058.287956}
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH20850') HTTP/1.1" 204 0
2026-03-30 07:50:58 [auto1.de] INFO: Found listing with ID: AJ83009
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ83009%27 HTTP/1.1" 200 None
2026-03-30 07:50:58 [auto1.de] INFO: Scrape type for AJ83009: 0
2026-03-30 07:50:58 [auto1.de] INFO: Found listing with ID: LK17231
2026-03-30 07:50:58 [auto1.de] INFO: Found listing with ID: PB00515
2026-03-30 07:50:58 [auto1.de] INFO: Found listing with ID: JZ38471
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ38471%27 HTTP/1.1" 200 None
2026-03-30 07:50:58 [auto1.de] INFO: Scrape type for JZ38471: 2
2026-03-30 07:50:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a178fc35-249d-564c-98ea-4bb8a5056182 with identifier: JZ38471
2026-03-30 07:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a178fc35-249d-564c-98ea-4bb8a5056182 with scrape type 2
2026-03-30 07:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a178fc35-249d-564c-98ea-4bb8a5056182 with scrape type 2
2026-03-30 07:50:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a178fc35-249d-564c-98ea-4bb8a5056182, identifier: JZ38471
2026-03-30 07:50:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a178fc35-249d-564c-98ea-4bb8a5056182 with identifier: JZ38471
2026-03-30 07:50:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a178fc35-249d-564c-98ea-4bb8a5056182 with identifier: JZ38471
2026-03-30 07:50:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a178fc35-249d-564c-98ea-4bb8a5056182 with identifier: JZ38471 to the API
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 283,
 'expiration_date': '2026-03-30T15:03:57Z',
 'fuel_type': 'petrol',
 'id': 'a178fc35-249d-564c-98ea-4bb8a5056182',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ38471',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Voyager',
 'odometer': 167600,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-12',
 'seller_name': None,
 'title': 'Lancia Voyager 3.6 V6 Gold',
 'transmission': 'automatic',
 'trim': 'Gold',
 'year': 2017}
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ38471%27 HTTP/1.1" 200 None
2026-03-30 07:50:58 [auto1.de] INFO: Saving data for JZ38471: {'auction_closing_time': 1774883037.0, 'created_time': 1774550870.208829, 'last_price_update_time': 1774857058.690752}
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ38471') HTTP/1.1" 204 0
2026-03-30 07:50:58 [auto1.de] INFO: Found listing with ID: LL09257
2026-03-30 07:50:58 [auto1.de] INFO: Found listing with ID: JR17394
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17394%27 HTTP/1.1" 200 None
2026-03-30 07:50:58 [auto1.de] INFO: Scrape type for JR17394: 2
2026-03-30 07:50:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82857689-10ce-5d56-9709-ea1a81e1726e with identifier: JR17394
2026-03-30 07:50:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82857689-10ce-5d56-9709-ea1a81e1726e with scrape type 2
2026-03-30 07:50:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 82857689-10ce-5d56-9709-ea1a81e1726e with scrape type 2
2026-03-30 07:50:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 82857689-10ce-5d56-9709-ea1a81e1726e, identifier: JR17394
2026-03-30 07:50:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 82857689-10ce-5d56-9709-ea1a81e1726e with identifier: JR17394
2026-03-30 07:50:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 82857689-10ce-5d56-9709-ea1a81e1726e with identifier: JR17394
2026-03-30 07:50:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 82857689-10ce-5d56-9709-ea1a81e1726e with identifier: JR17394 to the API
2026-03-30 07:50:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-30T15:44:50Z',
 'fuel_type': 'diesel',
 'id': '82857689-10ce-5d56-9709-ea1a81e1726e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR17394',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 147814,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-10',
 'seller_name': None,
 'title': 'Audi A6 50 TDI Mild-Hybrid quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2019}
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JR17394%27 HTTP/1.1" 200 None
2026-03-30 07:50:59 [auto1.de] INFO: Saving data for JR17394: {'auction_closing_time': 1774885490.0, 'created_time': 1774552779.072235, 'last_price_update_time': 1774857059.13988}
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JR17394') HTTP/1.1" 204 0
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: EX67189
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: KS94316
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: ML83071
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: SC92751
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: TP96640
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: EX44757
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: XS14457
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS14457%27 HTTP/1.1" 200 None
2026-03-30 07:50:59 [auto1.de] INFO: Scrape type for XS14457: 2
2026-03-30 07:50:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3de46726-204e-502d-a653-63c98938e3cc with identifier: XS14457
2026-03-30 07:50:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3de46726-204e-502d-a653-63c98938e3cc with scrape type 2
2026-03-30 07:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3de46726-204e-502d-a653-63c98938e3cc with scrape type 2
2026-03-30 07:50:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3de46726-204e-502d-a653-63c98938e3cc, identifier: XS14457
2026-03-30 07:50:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3de46726-204e-502d-a653-63c98938e3cc with identifier: XS14457
2026-03-30 07:50:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3de46726-204e-502d-a653-63c98938e3cc with identifier: XS14457
2026-03-30 07:50:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3de46726-204e-502d-a653-63c98938e3cc with identifier: XS14457 to the API
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:50:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:43:34Z',
 'fuel_type': 'diesel',
 'id': '3de46726-204e-502d-a653-63c98938e3cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS14457',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 158042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-22',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2017}
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS14457%27 HTTP/1.1" 200 None
2026-03-30 07:50:59 [auto1.de] INFO: Saving data for XS14457: {'auction_closing_time': 1774885414.0, 'created_time': 1774638456.612958, 'last_price_update_time': 1774857059.545883}
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XS14457') HTTP/1.1" 204 0
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: ZG28999
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG28999%27 HTTP/1.1" 200 None
2026-03-30 07:50:59 [auto1.de] INFO: Scrape type for ZG28999: 0
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: GW15546
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW15546%27 HTTP/1.1" 200 None
2026-03-30 07:50:59 [auto1.de] INFO: Scrape type for GW15546: 0
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: CG07330
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: US86443
2026-03-30 07:50:59 [auto1.de] INFO: Found listing with ID: BX36135
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX36135%27 HTTP/1.1" 200 None
2026-03-30 07:50:59 [auto1.de] INFO: Scrape type for BX36135: 2
2026-03-30 07:50:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb277ad2-4d2e-59fe-8e23-d94f9045c249 with identifier: BX36135
2026-03-30 07:50:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb277ad2-4d2e-59fe-8e23-d94f9045c249 with scrape type 2
2026-03-30 07:50:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb277ad2-4d2e-59fe-8e23-d94f9045c249 with scrape type 2
2026-03-30 07:50:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fb277ad2-4d2e-59fe-8e23-d94f9045c249, identifier: BX36135
2026-03-30 07:50:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fb277ad2-4d2e-59fe-8e23-d94f9045c249 with identifier: BX36135
2026-03-30 07:50:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fb277ad2-4d2e-59fe-8e23-d94f9045c249 with identifier: BX36135
2026-03-30 07:50:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fb277ad2-4d2e-59fe-8e23-d94f9045c249 with identifier: BX36135 to the API
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:50:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:01:36Z',
 'fuel_type': 'petrol',
 'id': 'fb277ad2-4d2e-59fe-8e23-d94f9045c249',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX36135',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 75355,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-09',
 'seller_name': None,
 'title': 'Renault Clio 1.2 Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2015}
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX36135%27 HTTP/1.1" 200 None
2026-03-30 07:51:00 [auto1.de] INFO: Saving data for BX36135: {'auction_closing_time': 1774882896.0, 'created_time': 1774640157.35169, 'last_price_update_time': 1774857060.10854}
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX36135') HTTP/1.1" 204 0
2026-03-30 07:51:00 [auto1.de] INFO: Found listing with ID: XR15758
2026-03-30 07:51:00 [auto1.de] INFO: Found listing with ID: ND29954
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND29954%27 HTTP/1.1" 200 None
2026-03-30 07:51:00 [auto1.de] INFO: Scrape type for ND29954: 2
2026-03-30 07:51:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e45b833-9630-5747-95b9-9bb7acda68cd with identifier: ND29954
2026-03-30 07:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e45b833-9630-5747-95b9-9bb7acda68cd with scrape type 2
2026-03-30 07:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e45b833-9630-5747-95b9-9bb7acda68cd with scrape type 2
2026-03-30 07:51:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4e45b833-9630-5747-95b9-9bb7acda68cd, identifier: ND29954
2026-03-30 07:51:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4e45b833-9630-5747-95b9-9bb7acda68cd with identifier: ND29954
2026-03-30 07:51:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4e45b833-9630-5747-95b9-9bb7acda68cd with identifier: ND29954
2026-03-30 07:51:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4e45b833-9630-5747-95b9-9bb7acda68cd with identifier: ND29954 to the API
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:44:34Z',
 'fuel_type': 'petrol',
 'id': '4e45b833-9630-5747-95b9-9bb7acda68cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND29954',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 42240,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-11',
 'seller_name': None,
 'title': 'Audi Q2 35 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND29954%27 HTTP/1.1" 200 None
2026-03-30 07:51:00 [auto1.de] INFO: Saving data for ND29954: {'auction_closing_time': 1774885474.0, 'created_time': 1774676138.309276, 'last_price_update_time': 1774857060.522019}
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ND29954') HTTP/1.1" 204 0
2026-03-30 07:51:00 [auto1.de] INFO: Found listing with ID: WA46177
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA46177%27 HTTP/1.1" 200 None
2026-03-30 07:51:00 [auto1.de] INFO: Scrape type for WA46177: 0
2026-03-30 07:51:00 [auto1.de] INFO: Found listing with ID: YL63918
2026-03-30 07:51:00 [auto1.de] INFO: Found listing with ID: DP55195
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP55195%27 HTTP/1.1" 200 None
2026-03-30 07:51:00 [auto1.de] INFO: Scrape type for DP55195: 0
2026-03-30 07:51:00 [auto1.de] INFO: Found listing with ID: HV40211
2026-03-30 07:51:00 [auto1.de] INFO: Found listing with ID: MF63690
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF63690%27 HTTP/1.1" 200 None
2026-03-30 07:51:00 [auto1.de] INFO: Scrape type for MF63690: 2
2026-03-30 07:51:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 664e7065-ef6e-59eb-a282-fbd07118a30c with identifier: MF63690
2026-03-30 07:51:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 664e7065-ef6e-59eb-a282-fbd07118a30c with scrape type 2
2026-03-30 07:51:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 664e7065-ef6e-59eb-a282-fbd07118a30c with scrape type 2
2026-03-30 07:51:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 664e7065-ef6e-59eb-a282-fbd07118a30c, identifier: MF63690
2026-03-30 07:51:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 664e7065-ef6e-59eb-a282-fbd07118a30c with identifier: MF63690
2026-03-30 07:51:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 664e7065-ef6e-59eb-a282-fbd07118a30c with identifier: MF63690
2026-03-30 07:51:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 664e7065-ef6e-59eb-a282-fbd07118a30c with identifier: MF63690 to the API
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:16:10Z',
 'fuel_type': 'diesel',
 'id': '664e7065-ef6e-59eb-a282-fbd07118a30c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF63690',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 153906,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-18',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2016}
2026-03-30 07:51:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF63690%27 HTTP/1.1" 200 None
2026-03-30 07:51:01 [auto1.de] INFO: Saving data for MF63690: {'auction_closing_time': 1774883770.0, 'created_time': 1774553250.849015, 'last_price_update_time': 1774857061.004521}
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF63690') HTTP/1.1" 204 0
2026-03-30 07:51:01 [auto1.de] INFO: Found listing with ID: DS08913
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS08913%27 HTTP/1.1" 200 None
2026-03-30 07:51:01 [auto1.de] INFO: Scrape type for DS08913: 2
2026-03-30 07:51:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0440ec26-c9cd-500f-b877-8a968c3126d8 with identifier: DS08913
2026-03-30 07:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0440ec26-c9cd-500f-b877-8a968c3126d8 with scrape type 2
2026-03-30 07:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0440ec26-c9cd-500f-b877-8a968c3126d8 with scrape type 2
2026-03-30 07:51:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0440ec26-c9cd-500f-b877-8a968c3126d8, identifier: DS08913
2026-03-30 07:51:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0440ec26-c9cd-500f-b877-8a968c3126d8 with identifier: DS08913
2026-03-30 07:51:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0440ec26-c9cd-500f-b877-8a968c3126d8 with identifier: DS08913
2026-03-30 07:51:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0440ec26-c9cd-500f-b877-8a968c3126d8 with identifier: DS08913 to the API
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:50:47Z',
 'fuel_type': 'petrol',
 'id': '0440ec26-c9cd-500f-b877-8a968c3126d8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS08913',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 193350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1998-09-07',
 'seller_name': None,
 'title': 'BMW 3er 320i',
 'transmission': 'manual',
 'trim': '',
 'year': 1998}
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS08913%27 HTTP/1.1" 200 None
2026-03-30 07:51:01 [auto1.de] INFO: Saving data for DS08913: {'auction_closing_time': 1774885847.0, 'created_time': 1774640026.540792, 'last_price_update_time': 1774857061.728136}
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DS08913') HTTP/1.1" 204 0
2026-03-30 07:51:01 [auto1.de] INFO: Found listing with ID: ZG52180
2026-03-30 07:51:01 [auto1.de] INFO: Found listing with ID: VS42918
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS42918%27 HTTP/1.1" 200 None
2026-03-30 07:51:01 [auto1.de] INFO: Scrape type for VS42918: 2
2026-03-30 07:51:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b1d39bb-f8a9-5c8d-88b7-834d5d7ba679 with identifier: VS42918
2026-03-30 07:51:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b1d39bb-f8a9-5c8d-88b7-834d5d7ba679 with scrape type 2
2026-03-30 07:51:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b1d39bb-f8a9-5c8d-88b7-834d5d7ba679 with scrape type 2
2026-03-30 07:51:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9b1d39bb-f8a9-5c8d-88b7-834d5d7ba679, identifier: VS42918
2026-03-30 07:51:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9b1d39bb-f8a9-5c8d-88b7-834d5d7ba679 with identifier: VS42918
2026-03-30 07:51:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9b1d39bb-f8a9-5c8d-88b7-834d5d7ba679 with identifier: VS42918
2026-03-30 07:51:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9b1d39bb-f8a9-5c8d-88b7-834d5d7ba679 with identifier: VS42918 to the API
2026-03-30 07:51:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 250,
 'expiration_date': '2026-03-30T15:55:44Z',
 'fuel_type': 'petrol',
 'id': '9b1d39bb-f8a9-5c8d-88b7-834d5d7ba679',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS42918',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 118153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-23',
 'seller_name': None,
 'title': 'Ford Focus 2.0 EcoBoost ST',
 'transmission': 'manual',
 'trim': 'ST',
 'year': 2017}
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VS42918%27 HTTP/1.1" 200 None
2026-03-30 07:51:02 [auto1.de] INFO: Saving data for VS42918: {'auction_closing_time': 1774886144.0, 'created_time': 1774639107.577047, 'last_price_update_time': 1774857062.128467}
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VS42918') HTTP/1.1" 204 0
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: JY24308
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: DV65946
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: RJ15430
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: FM97642
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM97642%27 HTTP/1.1" 200 None
2026-03-30 07:51:02 [auto1.de] INFO: Scrape type for FM97642: 0
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: VJ26450
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: WC38783
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: UD91634
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: UL11229
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: ZP95286
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP95286%27 HTTP/1.1" 200 None
2026-03-30 07:51:02 [auto1.de] INFO: Scrape type for ZP95286: 2
2026-03-30 07:51:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 691cca88-9e09-5cbe-83ca-19d42e839c9c with identifier: ZP95286
2026-03-30 07:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 691cca88-9e09-5cbe-83ca-19d42e839c9c with scrape type 2
2026-03-30 07:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 691cca88-9e09-5cbe-83ca-19d42e839c9c with scrape type 2
2026-03-30 07:51:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 691cca88-9e09-5cbe-83ca-19d42e839c9c, identifier: ZP95286
2026-03-30 07:51:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:51:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 691cca88-9e09-5cbe-83ca-19d42e839c9c with identifier: ZP95286
2026-03-30 07:51:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 691cca88-9e09-5cbe-83ca-19d42e839c9c with identifier: ZP95286
2026-03-30 07:51:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 691cca88-9e09-5cbe-83ca-19d42e839c9c with identifier: ZP95286 to the API
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:02:13Z',
 'fuel_type': 'diesel',
 'id': '691cca88-9e09-5cbe-83ca-19d42e839c9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP95286',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 125111,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-26',
 'seller_name': None,
 'title': 'Peugeot 5008 2.0 Blue-HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2018}
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP95286%27 HTTP/1.1" 200 None
2026-03-30 07:51:02 [auto1.de] INFO: Saving data for ZP95286: {'auction_closing_time': 1774882933.0, 'created_time': 1774639285.399147, 'last_price_update_time': 1774857062.713453}
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZP95286') HTTP/1.1" 204 0
2026-03-30 07:51:02 [auto1.de] INFO: Channel: 24h | Page: 173 | totalHits: 8414 | hits on page: 40
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: DN11419
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: HF93741
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: KB62018
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: NA89904
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: KC37462
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KC37462%27 HTTP/1.1" 200 None
2026-03-30 07:51:02 [auto1.de] INFO: Scrape type for KC37462: 0
2026-03-30 07:51:02 [auto1.de] INFO: Found listing with ID: MF41479
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41479%27 HTTP/1.1" 200 None
2026-03-30 07:51:02 [auto1.de] INFO: Scrape type for MF41479: 2
2026-03-30 07:51:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 247d909d-e963-56d0-b70f-138300f15f06 with identifier: MF41479
2026-03-30 07:51:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 247d909d-e963-56d0-b70f-138300f15f06 with scrape type 2
2026-03-30 07:51:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 247d909d-e963-56d0-b70f-138300f15f06 with scrape type 2
2026-03-30 07:51:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 247d909d-e963-56d0-b70f-138300f15f06, identifier: MF41479
2026-03-30 07:51:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 247d909d-e963-56d0-b70f-138300f15f06 with identifier: MF41479
2026-03-30 07:51:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 247d909d-e963-56d0-b70f-138300f15f06 with identifier: MF41479
2026-03-30 07:51:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 247d909d-e963-56d0-b70f-138300f15f06 with identifier: MF41479 to the API
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:24:23Z',
 'fuel_type': 'petrol',
 'id': '247d909d-e963-56d0-b70f-138300f15f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MF41479',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 34594,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-23',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X-Play club',
 'transmission': 'manual',
 'trim': 'X-Play club',
 'year': 2019}
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41479%27 HTTP/1.1" 200 None
2026-03-30 07:51:03 [auto1.de] INFO: Saving data for MF41479: {'auction_closing_time': 1774884263.0, 'created_time': 1774639481.272903, 'last_price_update_time': 1774857063.203282}
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MF41479') HTTP/1.1" 204 0
2026-03-30 07:51:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:51:03 [auto1.de] INFO: Found listing with ID: VN00313
2026-03-30 07:51:03 [auto1.de] INFO: Found listing with ID: XD31530
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD31530%27 HTTP/1.1" 200 None
2026-03-30 07:51:03 [auto1.de] INFO: Scrape type for XD31530: 2
2026-03-30 07:51:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f93d641a-54ad-5557-a932-20caed0d3de3 with identifier: XD31530
2026-03-30 07:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f93d641a-54ad-5557-a932-20caed0d3de3 with scrape type 2
2026-03-30 07:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f93d641a-54ad-5557-a932-20caed0d3de3 with scrape type 2
2026-03-30 07:51:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f93d641a-54ad-5557-a932-20caed0d3de3, identifier: XD31530
2026-03-30 07:51:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f93d641a-54ad-5557-a932-20caed0d3de3 with identifier: XD31530
2026-03-30 07:51:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f93d641a-54ad-5557-a932-20caed0d3de3 with identifier: XD31530
2026-03-30 07:51:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f93d641a-54ad-5557-a932-20caed0d3de3 with identifier: XD31530 to the API
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:29:40Z',
 'fuel_type': 'petrol',
 'id': 'f93d641a-54ad-5557-a932-20caed0d3de3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XD31530',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 133189,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-16',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.2 TSI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD31530%27 HTTP/1.1" 200 None
2026-03-30 07:51:03 [auto1.de] INFO: Saving data for XD31530: {'auction_closing_time': 1774884580.0, 'created_time': 1774589753.790147, 'last_price_update_time': 1774857063.595435}
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XD31530') HTTP/1.1" 204 0
2026-03-30 07:51:03 [auto1.de] INFO: Found listing with ID: UC48235
2026-03-30 07:51:03 [auto1.de] INFO: Found listing with ID: GV24790
2026-03-30 07:51:03 [auto1.de] INFO: Found listing with ID: AG68555
2026-03-30 07:51:03 [auto1.de] INFO: Found listing with ID: VJ90236
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ90236%27 HTTP/1.1" 200 None
2026-03-30 07:51:03 [auto1.de] INFO: Scrape type for VJ90236: 0
2026-03-30 07:51:03 [auto1.de] INFO: Found listing with ID: PP43066
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PP43066%27 HTTP/1.1" 200 None
2026-03-30 07:51:03 [auto1.de] INFO: Scrape type for PP43066: 0
2026-03-30 07:51:03 [auto1.de] INFO: Found listing with ID: UE28952
2026-03-30 07:51:03 [auto1.de] INFO: Found listing with ID: JN13946
2026-03-30 07:51:03 [auto1.de] INFO: Found listing with ID: GZ31172
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ31172%27 HTTP/1.1" 200 None
2026-03-30 07:51:03 [auto1.de] INFO: Scrape type for GZ31172: 2
2026-03-30 07:51:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd591f8c-a577-562d-a681-8f766857bec9 with identifier: GZ31172
2026-03-30 07:51:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd591f8c-a577-562d-a681-8f766857bec9 with scrape type 2
2026-03-30 07:51:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd591f8c-a577-562d-a681-8f766857bec9 with scrape type 2
2026-03-30 07:51:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd591f8c-a577-562d-a681-8f766857bec9, identifier: GZ31172
2026-03-30 07:51:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd591f8c-a577-562d-a681-8f766857bec9 with identifier: GZ31172
2026-03-30 07:51:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd591f8c-a577-562d-a681-8f766857bec9 with identifier: GZ31172
2026-03-30 07:51:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd591f8c-a577-562d-a681-8f766857bec9 with identifier: GZ31172 to the API
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-30T15:10:48Z',
 'fuel_type': 'petrol',
 'id': 'cd591f8c-a577-562d-a681-8f766857bec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ31172',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S4',
 'odometer': 76223,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-31',
 'seller_name': None,
 'title': 'Audi S4 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ31172%27 HTTP/1.1" 200 None
2026-03-30 07:51:04 [auto1.de] INFO: Saving data for GZ31172: {'auction_closing_time': 1774883448.0, 'created_time': 1774035175.399247, 'last_price_update_time': 1774857064.040783}
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GZ31172') HTTP/1.1" 204 0
2026-03-30 07:51:04 [auto1.de] INFO: Found listing with ID: GU48092
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU48092%27 HTTP/1.1" 200 None
2026-03-30 07:51:04 [auto1.de] INFO: Scrape type for GU48092: 2
2026-03-30 07:51:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e678a50a-6eb6-52c3-80c0-7723a8bf94de with identifier: GU48092
2026-03-30 07:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e678a50a-6eb6-52c3-80c0-7723a8bf94de with scrape type 2
2026-03-30 07:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e678a50a-6eb6-52c3-80c0-7723a8bf94de with scrape type 2
2026-03-30 07:51:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e678a50a-6eb6-52c3-80c0-7723a8bf94de, identifier: GU48092
2026-03-30 07:51:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e678a50a-6eb6-52c3-80c0-7723a8bf94de with identifier: GU48092
2026-03-30 07:51:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e678a50a-6eb6-52c3-80c0-7723a8bf94de with identifier: GU48092
2026-03-30 07:51:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e678a50a-6eb6-52c3-80c0-7723a8bf94de with identifier: GU48092 to the API
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:12Z',
 'fuel_type': 'diesel',
 'id': 'e678a50a-6eb6-52c3-80c0-7723a8bf94de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GU48092',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Avensis',
 'odometer': 188479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-14',
 'seller_name': None,
 'title': 'Toyota Avensis 2.2 D-4D Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2015}
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GU48092%27 HTTP/1.1" 200 None
2026-03-30 07:51:04 [auto1.de] INFO: Saving data for GU48092: {'auction_closing_time': 1774885692.0, 'created_time': 1774350115.715319, 'last_price_update_time': 1774857064.57787}
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GU48092') HTTP/1.1" 204 0
2026-03-30 07:51:04 [auto1.de] INFO: Found listing with ID: AE12757
2026-03-30 07:51:04 [auto1.de] INFO: Found listing with ID: GA58010
2026-03-30 07:51:04 [auto1.de] INFO: Found listing with ID: UT93934
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT93934%27 HTTP/1.1" 200 None
2026-03-30 07:51:04 [auto1.de] INFO: Scrape type for UT93934: 0
2026-03-30 07:51:04 [auto1.de] INFO: Found listing with ID: MS86460
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MS86460%27 HTTP/1.1" 200 None
2026-03-30 07:51:04 [auto1.de] INFO: Scrape type for MS86460: 0
2026-03-30 07:51:04 [auto1.de] INFO: Found listing with ID: DJ97721
2026-03-30 07:51:04 [auto1.de] INFO: Found listing with ID: PZ27483
2026-03-30 07:51:04 [auto1.de] INFO: Found listing with ID: KD53590
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD53590%27 HTTP/1.1" 200 None
2026-03-30 07:51:04 [auto1.de] INFO: Scrape type for KD53590: 0
2026-03-30 07:51:04 [auto1.de] INFO: Found listing with ID: GN70453
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN70453%27 HTTP/1.1" 200 None
2026-03-30 07:51:04 [auto1.de] INFO: Scrape type for GN70453: 2
2026-03-30 07:51:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8fc041b-124c-59e8-9570-4a0182733b95 with identifier: GN70453
2026-03-30 07:51:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8fc041b-124c-59e8-9570-4a0182733b95 with scrape type 2
2026-03-30 07:51:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8fc041b-124c-59e8-9570-4a0182733b95 with scrape type 2
2026-03-30 07:51:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8fc041b-124c-59e8-9570-4a0182733b95, identifier: GN70453
2026-03-30 07:51:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8fc041b-124c-59e8-9570-4a0182733b95 with identifier: GN70453
2026-03-30 07:51:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8fc041b-124c-59e8-9570-4a0182733b95 with identifier: GN70453
2026-03-30 07:51:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8fc041b-124c-59e8-9570-4a0182733b95 with identifier: GN70453 to the API
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:17:15Z',
 'fuel_type': 'petrol',
 'id': 'c8fc041b-124c-59e8-9570-4a0182733b95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN70453',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 74236,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-28',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TSI RS Plus',
 'transmission': 'automatic',
 'trim': 'RS Plus',
 'year': 2021}
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN70453%27 HTTP/1.1" 200 None
2026-03-30 07:51:05 [auto1.de] INFO: Saving data for GN70453: {'auction_closing_time': 1774883835.0, 'created_time': 1774002065.852361, 'last_price_update_time': 1774857065.046069}
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN70453') HTTP/1.1" 204 0
2026-03-30 07:51:05 [auto1.de] INFO: Found listing with ID: ZE72511
2026-03-30 07:51:05 [auto1.de] INFO: Found listing with ID: XD68871
2026-03-30 07:51:05 [auto1.de] INFO: Found listing with ID: WE09551
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09551%27 HTTP/1.1" 200 None
2026-03-30 07:51:05 [auto1.de] INFO: Scrape type for WE09551: 2
2026-03-30 07:51:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55b5d522-48ee-574f-8a20-8fa0583fd6c6 with identifier: WE09551
2026-03-30 07:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55b5d522-48ee-574f-8a20-8fa0583fd6c6 with scrape type 2
2026-03-30 07:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55b5d522-48ee-574f-8a20-8fa0583fd6c6 with scrape type 2
2026-03-30 07:51:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55b5d522-48ee-574f-8a20-8fa0583fd6c6, identifier: WE09551
2026-03-30 07:51:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55b5d522-48ee-574f-8a20-8fa0583fd6c6 with identifier: WE09551
2026-03-30 07:51:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55b5d522-48ee-574f-8a20-8fa0583fd6c6 with identifier: WE09551
2026-03-30 07:51:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55b5d522-48ee-574f-8a20-8fa0583fd6c6 with identifier: WE09551 to the API
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:27:14Z',
 'fuel_type': 'diesel',
 'id': '55b5d522-48ee-574f-8a20-8fa0583fd6c6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WE09551',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 174220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-24',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 200 d AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE09551%27 HTTP/1.1" 200 None
2026-03-30 07:51:05 [auto1.de] INFO: Saving data for WE09551: {'auction_closing_time': 1774884434.0, 'created_time': 1774639605.962501, 'last_price_update_time': 1774857065.46106}
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WE09551') HTTP/1.1" 204 0
2026-03-30 07:51:05 [auto1.de] INFO: Found listing with ID: WP84657
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP84657%27 HTTP/1.1" 200 None
2026-03-30 07:51:05 [auto1.de] INFO: Scrape type for WP84657: 2
2026-03-30 07:51:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df9581d0-0f83-50f2-94e5-f53793d505ea with identifier: WP84657
2026-03-30 07:51:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df9581d0-0f83-50f2-94e5-f53793d505ea with scrape type 2
2026-03-30 07:51:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item df9581d0-0f83-50f2-94e5-f53793d505ea with scrape type 2
2026-03-30 07:51:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: df9581d0-0f83-50f2-94e5-f53793d505ea, identifier: WP84657
2026-03-30 07:51:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: df9581d0-0f83-50f2-94e5-f53793d505ea with identifier: WP84657
2026-03-30 07:51:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: df9581d0-0f83-50f2-94e5-f53793d505ea with identifier: WP84657
2026-03-30 07:51:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: df9581d0-0f83-50f2-94e5-f53793d505ea with identifier: WP84657 to the API
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:06:28Z',
 'fuel_type': 'diesel',
 'id': 'df9581d0-0f83-50f2-94e5-f53793d505ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP84657',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 402819,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-30',
 'seller_name': None,
 'title': 'Audi A4 2.7 V6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2010}
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP84657%27 HTTP/1.1" 200 None
2026-03-30 07:51:05 [auto1.de] INFO: Saving data for WP84657: {'auction_closing_time': 1774883188.0, 'created_time': 1773308187.456916, 'last_price_update_time': 1774857065.956649}
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WP84657') HTTP/1.1" 204 0
2026-03-30 07:51:05 [auto1.de] INFO: Found listing with ID: VE41412
2026-03-30 07:51:05 [auto1.de] INFO: Found listing with ID: UZ82929
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UZ82929%27 HTTP/1.1" 200 None
2026-03-30 07:51:05 [auto1.de] INFO: Scrape type for UZ82929: 0
2026-03-30 07:51:05 [auto1.de] INFO: Found listing with ID: FH31570
2026-03-30 07:51:05 [auto1.de] INFO: Found listing with ID: VH71903
2026-03-30 07:51:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH71903%27 HTTP/1.1" 200 None
2026-03-30 07:51:06 [auto1.de] INFO: Scrape type for VH71903: 0
2026-03-30 07:51:06 [auto1.de] INFO: Found listing with ID: MP71410
2026-03-30 07:51:06 [auto1.de] INFO: Found listing with ID: VH64157
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH64157%27 HTTP/1.1" 200 None
2026-03-30 07:51:06 [auto1.de] INFO: Scrape type for VH64157: 0
2026-03-30 07:51:06 [auto1.de] INFO: Found listing with ID: LL81874
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL81874%27 HTTP/1.1" 200 None
2026-03-30 07:51:06 [auto1.de] INFO: Scrape type for LL81874: 0
2026-03-30 07:51:06 [auto1.de] INFO: Found listing with ID: EU98670
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98670%27 HTTP/1.1" 200 None
2026-03-30 07:51:06 [auto1.de] INFO: Scrape type for EU98670: 2
2026-03-30 07:51:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41c96e10-8a67-542a-8282-70a83a4086fb with identifier: EU98670
2026-03-30 07:51:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41c96e10-8a67-542a-8282-70a83a4086fb with scrape type 2
2026-03-30 07:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41c96e10-8a67-542a-8282-70a83a4086fb with scrape type 2
2026-03-30 07:51:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 41c96e10-8a67-542a-8282-70a83a4086fb, identifier: EU98670
2026-03-30 07:51:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 41c96e10-8a67-542a-8282-70a83a4086fb with identifier: EU98670
2026-03-30 07:51:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 41c96e10-8a67-542a-8282-70a83a4086fb with identifier: EU98670
2026-03-30 07:51:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 41c96e10-8a67-542a-8282-70a83a4086fb with identifier: EU98670 to the API
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:23:41Z',
 'fuel_type': 'diesel',
 'id': '41c96e10-8a67-542a-8282-70a83a4086fb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU98670',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 216464,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-11',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2014}
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EU98670%27 HTTP/1.1" 200 None
2026-03-30 07:51:06 [auto1.de] INFO: Saving data for EU98670: {'auction_closing_time': 1774884221.0, 'created_time': 1774552960.805611, 'last_price_update_time': 1774857066.450405}
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EU98670') HTTP/1.1" 204 0
2026-03-30 07:51:06 [auto1.de] INFO: Found listing with ID: LG36185
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG36185%27 HTTP/1.1" 200 None
2026-03-30 07:51:06 [auto1.de] INFO: Scrape type for LG36185: 0
2026-03-30 07:51:06 [auto1.de] INFO: Found listing with ID: AU97195
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU97195%27 HTTP/1.1" 200 None
2026-03-30 07:51:06 [auto1.de] INFO: Scrape type for AU97195: 0
2026-03-30 07:51:06 [auto1.de] INFO: Found listing with ID: ZH41953
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH41953%27 HTTP/1.1" 200 None
2026-03-30 07:51:06 [auto1.de] INFO: Scrape type for ZH41953: 2
2026-03-30 07:51:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29b0f94-5a43-56e9-9b5f-a96538acdb42 with identifier: ZH41953
2026-03-30 07:51:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29b0f94-5a43-56e9-9b5f-a96538acdb42 with scrape type 2
2026-03-30 07:51:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a29b0f94-5a43-56e9-9b5f-a96538acdb42 with scrape type 2
2026-03-30 07:51:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a29b0f94-5a43-56e9-9b5f-a96538acdb42, identifier: ZH41953
2026-03-30 07:51:06 [scrapy.extensions.logstats] INFO: Crawled 369 pages (at 11 pages/min), scraped 1305 items (at 101 items/min)
2026-03-30 07:51:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:51:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a29b0f94-5a43-56e9-9b5f-a96538acdb42 with identifier: ZH41953
2026-03-30 07:51:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a29b0f94-5a43-56e9-9b5f-a96538acdb42 with identifier: ZH41953
2026-03-30 07:51:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a29b0f94-5a43-56e9-9b5f-a96538acdb42 with identifier: ZH41953 to the API
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:45:55Z',
 'fuel_type': 'petrol',
 'id': 'a29b0f94-5a43-56e9-9b5f-a96538acdb42',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZH41953',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 227976,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-19',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZH41953%27 HTTP/1.1" 200 None
2026-03-30 07:51:06 [auto1.de] INFO: Saving data for ZH41953: {'auction_closing_time': 1774885555.0, 'created_time': 1774636991.107666, 'last_price_update_time': 1774857066.875644}
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZH41953') HTTP/1.1" 204 0
2026-03-30 07:51:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:51:07 [auto1.de] INFO: Channel: 24h | Page: 174 | totalHits: 8414 | hits on page: 40
2026-03-30 07:51:07 [auto1.de] INFO: Found listing with ID: SV69616
2026-03-30 07:51:07 [auto1.de] INFO: Found listing with ID: GS82653
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS82653%27 HTTP/1.1" 200 None
2026-03-30 07:51:07 [auto1.de] INFO: Scrape type for GS82653: 2
2026-03-30 07:51:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with identifier: GS82653
2026-03-30 07:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with scrape type 2
2026-03-30 07:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with scrape type 2
2026-03-30 07:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f6ed9f36-e9f6-5136-b603-bde1a0bc9341, identifier: GS82653
2026-03-30 07:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with identifier: GS82653
2026-03-30 07:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with identifier: GS82653
2026-03-30 07:51:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f6ed9f36-e9f6-5136-b603-bde1a0bc9341 with identifier: GS82653 to the API
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:41:46Z',
 'fuel_type': 'diesel',
 'id': 'f6ed9f36-e9f6-5136-b603-bde1a0bc9341',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS82653',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 283269,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-15',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2010}
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS82653%27 HTTP/1.1" 200 None
2026-03-30 07:51:07 [auto1.de] INFO: Saving data for GS82653: {'auction_closing_time': 1774885306.0, 'created_time': 1774551553.695883, 'last_price_update_time': 1774857067.837873}
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GS82653') HTTP/1.1" 204 0
2026-03-30 07:51:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:51:07 [auto1.de] INFO: Found listing with ID: EN87643
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN87643%27 HTTP/1.1" 200 None
2026-03-30 07:51:07 [auto1.de] INFO: Scrape type for EN87643: 0
2026-03-30 07:51:07 [auto1.de] INFO: Found listing with ID: DD20559
2026-03-30 07:51:07 [auto1.de] INFO: Found listing with ID: VB56822
2026-03-30 07:51:07 [auto1.de] INFO: Found listing with ID: HM56533
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM56533%27 HTTP/1.1" 200 None
2026-03-30 07:51:07 [auto1.de] INFO: Scrape type for HM56533: 2
2026-03-30 07:51:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac7e0b63-5071-5cde-b97d-ebd9975b38b7 with identifier: HM56533
2026-03-30 07:51:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac7e0b63-5071-5cde-b97d-ebd9975b38b7 with scrape type 2
2026-03-30 07:51:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac7e0b63-5071-5cde-b97d-ebd9975b38b7 with scrape type 2
2026-03-30 07:51:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ac7e0b63-5071-5cde-b97d-ebd9975b38b7, identifier: HM56533
2026-03-30 07:51:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ac7e0b63-5071-5cde-b97d-ebd9975b38b7 with identifier: HM56533
2026-03-30 07:51:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ac7e0b63-5071-5cde-b97d-ebd9975b38b7 with identifier: HM56533
2026-03-30 07:51:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ac7e0b63-5071-5cde-b97d-ebd9975b38b7 with identifier: HM56533 to the API
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:32:06Z',
 'fuel_type': 'diesel',
 'id': 'ac7e0b63-5071-5cde-b97d-ebd9975b38b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM56533',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 318560,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-06',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2012}
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HM56533%27 HTTP/1.1" 200 None
2026-03-30 07:51:08 [auto1.de] INFO: Saving data for HM56533: {'auction_closing_time': 1774884726.0, 'created_time': 1774639482.949006, 'last_price_update_time': 1774857068.275233}
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HM56533') HTTP/1.1" 204 0
2026-03-30 07:51:08 [auto1.de] INFO: Found listing with ID: DY27021
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY27021%27 HTTP/1.1" 200 None
2026-03-30 07:51:08 [auto1.de] INFO: Scrape type for DY27021: 0
2026-03-30 07:51:08 [auto1.de] INFO: Found listing with ID: EB81332
2026-03-30 07:51:08 [auto1.de] INFO: Found listing with ID: HM11779
2026-03-30 07:51:08 [auto1.de] INFO: Found listing with ID: EG81564
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG81564%27 HTTP/1.1" 200 None
2026-03-30 07:51:08 [auto1.de] INFO: Scrape type for EG81564: 2
2026-03-30 07:51:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e36bb5c-5483-5523-8276-d707c737d753 with identifier: EG81564
2026-03-30 07:51:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e36bb5c-5483-5523-8276-d707c737d753 with scrape type 2
2026-03-30 07:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e36bb5c-5483-5523-8276-d707c737d753 with scrape type 2
2026-03-30 07:51:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5e36bb5c-5483-5523-8276-d707c737d753, identifier: EG81564
2026-03-30 07:51:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5e36bb5c-5483-5523-8276-d707c737d753 with identifier: EG81564
2026-03-30 07:51:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5e36bb5c-5483-5523-8276-d707c737d753 with identifier: EG81564
2026-03-30 07:51:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5e36bb5c-5483-5523-8276-d707c737d753 with identifier: EG81564 to the API
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 390,
 'expiration_date': '2026-03-30T15:38:29Z',
 'fuel_type': 'petrol',
 'id': '5e36bb5c-5483-5523-8276-d707c737d753',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG81564',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 108861,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 43 AMG 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2020}
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EG81564%27 HTTP/1.1" 200 None
2026-03-30 07:51:08 [auto1.de] INFO: Saving data for EG81564: {'auction_closing_time': 1774885109.0, 'created_time': 1773301869.666213, 'last_price_update_time': 1774857068.688028}
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EG81564') HTTP/1.1" 204 0
2026-03-30 07:51:08 [auto1.de] INFO: Found listing with ID: SG31546
2026-03-30 07:51:08 [auto1.de] INFO: Found listing with ID: CU93791
2026-03-30 07:51:08 [auto1.de] INFO: Found listing with ID: LL85069
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL85069%27 HTTP/1.1" 200 None
2026-03-30 07:51:08 [auto1.de] INFO: Scrape type for LL85069: 2
2026-03-30 07:51:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f956e71a-64a4-5e53-bf6a-0780d9459a73 with identifier: LL85069
2026-03-30 07:51:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f956e71a-64a4-5e53-bf6a-0780d9459a73 with scrape type 2
2026-03-30 07:51:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f956e71a-64a4-5e53-bf6a-0780d9459a73 with scrape type 2
2026-03-30 07:51:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f956e71a-64a4-5e53-bf6a-0780d9459a73, identifier: LL85069
2026-03-30 07:51:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f956e71a-64a4-5e53-bf6a-0780d9459a73 with identifier: LL85069
2026-03-30 07:51:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f956e71a-64a4-5e53-bf6a-0780d9459a73 with identifier: LL85069
2026-03-30 07:51:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f956e71a-64a4-5e53-bf6a-0780d9459a73 with identifier: LL85069 to the API
2026-03-30 07:51:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:36:40Z',
 'fuel_type': 'diesel',
 'id': 'f956e71a-64a4-5e53-bf6a-0780d9459a73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL85069',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'H1',
 'odometer': 140145,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-20',
 'seller_name': None,
 'title': 'Hyundai H1 2.5 CRDi Travel Comfort',
 'transmission': 'manual',
 'trim': 'Travel Comfort',
 'year': 2017}
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL85069%27 HTTP/1.1" 200 None
2026-03-30 07:51:09 [auto1.de] INFO: Saving data for LL85069: {'auction_closing_time': 1774885000.0, 'created_time': 1773831200.548217, 'last_price_update_time': 1774857069.201751}
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL85069') HTTP/1.1" 204 0
2026-03-30 07:51:09 [auto1.de] INFO: Found listing with ID: NZ68458
2026-03-30 07:51:09 [auto1.de] INFO: Found listing with ID: RV94916
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV94916%27 HTTP/1.1" 200 None
2026-03-30 07:51:09 [auto1.de] INFO: Scrape type for RV94916: 0
2026-03-30 07:51:09 [auto1.de] INFO: Found listing with ID: JZ63393
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ63393%27 HTTP/1.1" 200 None
2026-03-30 07:51:09 [auto1.de] INFO: Scrape type for JZ63393: 2
2026-03-30 07:51:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 714ff40f-7cd4-5e5d-a7a5-e7f91a29bc95 with identifier: JZ63393
2026-03-30 07:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 714ff40f-7cd4-5e5d-a7a5-e7f91a29bc95 with scrape type 2
2026-03-30 07:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 714ff40f-7cd4-5e5d-a7a5-e7f91a29bc95 with scrape type 2
2026-03-30 07:51:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 714ff40f-7cd4-5e5d-a7a5-e7f91a29bc95, identifier: JZ63393
2026-03-30 07:51:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 714ff40f-7cd4-5e5d-a7a5-e7f91a29bc95 with identifier: JZ63393
2026-03-30 07:51:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 714ff40f-7cd4-5e5d-a7a5-e7f91a29bc95 with identifier: JZ63393
2026-03-30 07:51:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 714ff40f-7cd4-5e5d-a7a5-e7f91a29bc95 with identifier: JZ63393 to the API
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:39:41Z',
 'fuel_type': 'petrol',
 'id': '714ff40f-7cd4-5e5d-a7a5-e7f91a29bc95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JZ63393',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 92336,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-11-16',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.6 FSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2003}
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JZ63393%27 HTTP/1.1" 200 None
2026-03-30 07:51:09 [auto1.de] INFO: Saving data for JZ63393: {'auction_closing_time': 1774885181.0, 'created_time': 1773132223.759128, 'last_price_update_time': 1774857069.718748}
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JZ63393') HTTP/1.1" 204 0
2026-03-30 07:51:09 [auto1.de] INFO: Found listing with ID: CU11315
2026-03-30 07:51:09 [auto1.de] INFO: Found listing with ID: BS60844
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS60844%27 HTTP/1.1" 200 None
2026-03-30 07:51:09 [auto1.de] INFO: Scrape type for BS60844: 2
2026-03-30 07:51:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with identifier: BS60844
2026-03-30 07:51:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with scrape type 2
2026-03-30 07:51:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with scrape type 2
2026-03-30 07:51:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 93dd2b2c-9bf0-500b-a47c-23afdbf71807, identifier: BS60844
2026-03-30 07:51:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with identifier: BS60844
2026-03-30 07:51:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with identifier: BS60844
2026-03-30 07:51:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 93dd2b2c-9bf0-500b-a47c-23afdbf71807 with identifier: BS60844 to the API
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:08:42Z',
 'fuel_type': 'diesel',
 'id': '93dd2b2c-9bf0-500b-a47c-23afdbf71807',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS60844',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 195738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-07',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Cup',
 'transmission': 'manual',
 'trim': 'Cup',
 'year': 2015}
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS60844%27 HTTP/1.1" 200 None
2026-03-30 07:51:10 [auto1.de] INFO: Saving data for BS60844: {'auction_closing_time': 1774883322.0, 'created_time': 1774552539.942203, 'last_price_update_time': 1774857070.186627}
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BS60844') HTTP/1.1" 204 0
2026-03-30 07:51:10 [auto1.de] INFO: Found listing with ID: XX23158
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX23158%27 HTTP/1.1" 200 None
2026-03-30 07:51:10 [auto1.de] INFO: Scrape type for XX23158: 2
2026-03-30 07:51:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a45e2f8-5ed1-5662-ae15-e658ad2922b3 with identifier: XX23158
2026-03-30 07:51:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a45e2f8-5ed1-5662-ae15-e658ad2922b3 with scrape type 2
2026-03-30 07:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a45e2f8-5ed1-5662-ae15-e658ad2922b3 with scrape type 2
2026-03-30 07:51:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7a45e2f8-5ed1-5662-ae15-e658ad2922b3, identifier: XX23158
2026-03-30 07:51:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7a45e2f8-5ed1-5662-ae15-e658ad2922b3 with identifier: XX23158
2026-03-30 07:51:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7a45e2f8-5ed1-5662-ae15-e658ad2922b3 with identifier: XX23158
2026-03-30 07:51:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7a45e2f8-5ed1-5662-ae15-e658ad2922b3 with identifier: XX23158 to the API
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:17:28Z',
 'fuel_type': 'petrol',
 'id': '7a45e2f8-5ed1-5662-ae15-e658ad2922b3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX23158',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 212406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-08-21',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI I-Tech',
 'transmission': 'manual',
 'trim': 'I-Tech',
 'year': 2014}
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX23158%27 HTTP/1.1" 200 None
2026-03-30 07:51:10 [auto1.de] INFO: Saving data for XX23158: {'auction_closing_time': 1774883848.0, 'created_time': 1774550712.36898, 'last_price_update_time': 1774857070.586789}
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XX23158') HTTP/1.1" 204 0
2026-03-30 07:51:10 [auto1.de] INFO: Found listing with ID: GW98108
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW98108%27 HTTP/1.1" 200 None
2026-03-30 07:51:10 [auto1.de] INFO: Scrape type for GW98108: 2
2026-03-30 07:51:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26306a10-dfd3-5ba9-9aa9-ac8c2f46acef with identifier: GW98108
2026-03-30 07:51:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26306a10-dfd3-5ba9-9aa9-ac8c2f46acef with scrape type 2
2026-03-30 07:51:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26306a10-dfd3-5ba9-9aa9-ac8c2f46acef with scrape type 2
2026-03-30 07:51:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 26306a10-dfd3-5ba9-9aa9-ac8c2f46acef, identifier: GW98108
2026-03-30 07:51:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 26306a10-dfd3-5ba9-9aa9-ac8c2f46acef with identifier: GW98108
2026-03-30 07:51:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 26306a10-dfd3-5ba9-9aa9-ac8c2f46acef with identifier: GW98108
2026-03-30 07:51:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 26306a10-dfd3-5ba9-9aa9-ac8c2f46acef with identifier: GW98108 to the API
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:22:50Z',
 'fuel_type': 'petrol',
 'id': '26306a10-dfd3-5ba9-9aa9-ac8c2f46acef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW98108',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4',
 'odometer': 110423,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-17',
 'seller_name': None,
 'title': 'Citroen C4 1.6 Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2009}
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW98108%27 HTTP/1.1" 200 None
2026-03-30 07:51:10 [auto1.de] INFO: Saving data for GW98108: {'auction_closing_time': 1774884170.0, 'created_time': 1774637247.415653, 'last_price_update_time': 1774857070.983828}
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW98108') HTTP/1.1" 204 0
2026-03-30 07:51:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:51:11 [auto1.de] INFO: Found listing with ID: VP61348
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP61348%27 HTTP/1.1" 200 None
2026-03-30 07:51:11 [auto1.de] INFO: Scrape type for VP61348: 2
2026-03-30 07:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ce3f8fe-701a-5ffe-ae95-84552cb4c26d with identifier: VP61348
2026-03-30 07:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ce3f8fe-701a-5ffe-ae95-84552cb4c26d with scrape type 2
2026-03-30 07:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ce3f8fe-701a-5ffe-ae95-84552cb4c26d with scrape type 2
2026-03-30 07:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9ce3f8fe-701a-5ffe-ae95-84552cb4c26d, identifier: VP61348
2026-03-30 07:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9ce3f8fe-701a-5ffe-ae95-84552cb4c26d with identifier: VP61348
2026-03-30 07:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9ce3f8fe-701a-5ffe-ae95-84552cb4c26d with identifier: VP61348
2026-03-30 07:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9ce3f8fe-701a-5ffe-ae95-84552cb4c26d with identifier: VP61348 to the API
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:52:06Z',
 'fuel_type': 'diesel',
 'id': '9ce3f8fe-701a-5ffe-ae95-84552cb4c26d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP61348',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 163757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-04',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Innovation',
 'transmission': 'automatic',
 'trim': 'Innovation',
 'year': 2018}
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP61348%27 HTTP/1.1" 200 None
2026-03-30 07:51:11 [auto1.de] INFO: Saving data for VP61348: {'auction_closing_time': 1774885926.0, 'created_time': 1774640110.791102, 'last_price_update_time': 1774857071.391841}
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VP61348') HTTP/1.1" 204 0
2026-03-30 07:51:11 [auto1.de] INFO: Found listing with ID: XJ99289
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ99289%27 HTTP/1.1" 200 None
2026-03-30 07:51:11 [auto1.de] INFO: Scrape type for XJ99289: 2
2026-03-30 07:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60daf1ea-7c5c-53c2-896b-309d5ae3357b with identifier: XJ99289
2026-03-30 07:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60daf1ea-7c5c-53c2-896b-309d5ae3357b with scrape type 2
2026-03-30 07:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60daf1ea-7c5c-53c2-896b-309d5ae3357b with scrape type 2
2026-03-30 07:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 60daf1ea-7c5c-53c2-896b-309d5ae3357b, identifier: XJ99289
2026-03-30 07:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 60daf1ea-7c5c-53c2-896b-309d5ae3357b with identifier: XJ99289
2026-03-30 07:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 60daf1ea-7c5c-53c2-896b-309d5ae3357b with identifier: XJ99289
2026-03-30 07:51:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 60daf1ea-7c5c-53c2-896b-309d5ae3357b with identifier: XJ99289 to the API
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-30T15:03:39Z',
 'fuel_type': 'diesel',
 'id': '60daf1ea-7c5c-53c2-896b-309d5ae3357b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ99289',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 169980,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-19',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XJ99289%27 HTTP/1.1" 200 None
2026-03-30 07:51:11 [auto1.de] INFO: Saving data for XJ99289: {'auction_closing_time': 1774883019.0, 'created_time': 1774639845.045092, 'last_price_update_time': 1774857071.812304}
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XJ99289') HTTP/1.1" 204 0
2026-03-30 07:51:11 [auto1.de] INFO: Channel: 24h | Page: 175 | totalHits: 8415 | hits on page: 40
2026-03-30 07:51:11 [auto1.de] INFO: Found listing with ID: CD13649
2026-03-30 07:51:11 [auto1.de] INFO: Found listing with ID: KW68536
2026-03-30 07:51:11 [auto1.de] INFO: Found listing with ID: BP82527
2026-03-30 07:51:11 [auto1.de] INFO: Found listing with ID: CY66130
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY66130%27 HTTP/1.1" 200 None
2026-03-30 07:51:11 [auto1.de] INFO: Scrape type for CY66130: 2
2026-03-30 07:51:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6df600cc-5e7b-58f6-bd75-6bcf5c7ff296 with identifier: CY66130
2026-03-30 07:51:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6df600cc-5e7b-58f6-bd75-6bcf5c7ff296 with scrape type 2
2026-03-30 07:51:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6df600cc-5e7b-58f6-bd75-6bcf5c7ff296 with scrape type 2
2026-03-30 07:51:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6df600cc-5e7b-58f6-bd75-6bcf5c7ff296, identifier: CY66130
2026-03-30 07:51:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6df600cc-5e7b-58f6-bd75-6bcf5c7ff296 with identifier: CY66130
2026-03-30 07:51:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6df600cc-5e7b-58f6-bd75-6bcf5c7ff296 with identifier: CY66130
2026-03-30 07:51:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6df600cc-5e7b-58f6-bd75-6bcf5c7ff296 with identifier: CY66130 to the API
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:07:56Z',
 'fuel_type': 'petrol',
 'id': '6df600cc-5e7b-58f6-bd75-6bcf5c7ff296',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY66130',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 144783,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-02',
 'seller_name': None,
 'title': 'Mazda CX-5 2.0 Center-Line AWD',
 'transmission': 'manual',
 'trim': 'Center-Line AWD',
 'year': 2012}
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY66130%27 HTTP/1.1" 200 None
2026-03-30 07:51:12 [auto1.de] INFO: Saving data for CY66130: {'auction_closing_time': 1774883276.0, 'created_time': 1774639826.410206, 'last_price_update_time': 1774857072.231696}
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CY66130') HTTP/1.1" 204 0
2026-03-30 07:51:12 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-30 07:51:12 [auto1.de] INFO: Found listing with ID: YM11561
2026-03-30 07:51:12 [auto1.de] INFO: Found listing with ID: RR41525
2026-03-30 07:51:12 [auto1.de] INFO: Found listing with ID: MK56565
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56565%27 HTTP/1.1" 200 None
2026-03-30 07:51:12 [auto1.de] INFO: Scrape type for MK56565: 2
2026-03-30 07:51:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69241d07-8421-5fee-9d8e-e8afd9ad9c32 with identifier: MK56565
2026-03-30 07:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69241d07-8421-5fee-9d8e-e8afd9ad9c32 with scrape type 2
2026-03-30 07:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69241d07-8421-5fee-9d8e-e8afd9ad9c32 with scrape type 2
2026-03-30 07:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69241d07-8421-5fee-9d8e-e8afd9ad9c32, identifier: MK56565
2026-03-30 07:51:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:51:12 [auto1.de] INFO: Found listing with ID: FX32627
2026-03-30 07:51:12 [auto1.de] INFO: Found listing with ID: VM53714
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM53714%27 HTTP/1.1" 200 None
2026-03-30 07:51:12 [auto1.de] INFO: Scrape type for VM53714: 2
2026-03-30 07:51:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf62c87c-59a2-53b6-a242-1deca4216467 with identifier: VM53714
2026-03-30 07:51:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf62c87c-59a2-53b6-a242-1deca4216467 with scrape type 2
2026-03-30 07:51:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf62c87c-59a2-53b6-a242-1deca4216467 with scrape type 2
2026-03-30 07:51:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bf62c87c-59a2-53b6-a242-1deca4216467, identifier: VM53714
2026-03-30 07:51:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69241d07-8421-5fee-9d8e-e8afd9ad9c32 with identifier: MK56565
2026-03-30 07:51:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69241d07-8421-5fee-9d8e-e8afd9ad9c32 with identifier: MK56565
2026-03-30 07:51:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69241d07-8421-5fee-9d8e-e8afd9ad9c32 with identifier: MK56565 to the API
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:24:00Z',
 'fuel_type': 'diesel',
 'id': '69241d07-8421-5fee-9d8e-e8afd9ad9c32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK56565',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 165122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-26',
 'seller_name': None,
 'title': 'BMW 3er 320d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2017}
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK56565%27 HTTP/1.1" 200 None
2026-03-30 07:51:12 [auto1.de] INFO: Saving data for MK56565: {'auction_closing_time': 1774884240.0, 'created_time': 1774639322.563154, 'last_price_update_time': 1774857072.84469}
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK56565') HTTP/1.1" 204 0
2026-03-30 07:51:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bf62c87c-59a2-53b6-a242-1deca4216467 with identifier: VM53714
2026-03-30 07:51:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bf62c87c-59a2-53b6-a242-1deca4216467 with identifier: VM53714
2026-03-30 07:51:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bf62c87c-59a2-53b6-a242-1deca4216467 with identifier: VM53714 to the API
2026-03-30 07:51:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:16:09Z',
 'fuel_type': 'petrol',
 'id': 'bf62c87c-59a2-53b6-a242-1deca4216467',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM53714',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 95694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-31',
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Authentique',
 'transmission': 'manual',
 'trim': 'Authentique',
 'year': 2010}
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VM53714%27 HTTP/1.1" 200 None
2026-03-30 07:51:13 [auto1.de] INFO: Saving data for VM53714: {'auction_closing_time': 1774883769.0, 'created_time': 1774639095.828136, 'last_price_update_time': 1774857073.120964}
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VM53714') HTTP/1.1" 204 0
2026-03-30 07:51:13 [auto1.de] INFO: Found listing with ID: ZF73856
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF73856%27 HTTP/1.1" 200 None
2026-03-30 07:51:13 [auto1.de] INFO: Scrape type for ZF73856: 2
2026-03-30 07:51:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6e1fec2-a740-54ad-b1a4-14cad525840b with identifier: ZF73856
2026-03-30 07:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6e1fec2-a740-54ad-b1a4-14cad525840b with scrape type 2
2026-03-30 07:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6e1fec2-a740-54ad-b1a4-14cad525840b with scrape type 2
2026-03-30 07:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a6e1fec2-a740-54ad-b1a4-14cad525840b, identifier: ZF73856
2026-03-30 07:51:13 [auto1.de] INFO: Found listing with ID: KH87635
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH87635%27 HTTP/1.1" 200 None
2026-03-30 07:51:13 [auto1.de] INFO: Scrape type for KH87635: 2
2026-03-30 07:51:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7cbda55-fa7e-5855-bea4-a244a835c7a9 with identifier: KH87635
2026-03-30 07:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7cbda55-fa7e-5855-bea4-a244a835c7a9 with scrape type 2
2026-03-30 07:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f7cbda55-fa7e-5855-bea4-a244a835c7a9 with scrape type 2
2026-03-30 07:51:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f7cbda55-fa7e-5855-bea4-a244a835c7a9, identifier: KH87635
2026-03-30 07:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a6e1fec2-a740-54ad-b1a4-14cad525840b with identifier: ZF73856
2026-03-30 07:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a6e1fec2-a740-54ad-b1a4-14cad525840b with identifier: ZF73856
2026-03-30 07:51:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a6e1fec2-a740-54ad-b1a4-14cad525840b with identifier: ZF73856 to the API
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 480,
 'expiration_date': '2026-03-30T15:52:49Z',
 'fuel_type': 'petrol',
 'id': 'a6e1fec2-a740-54ad-b1a4-14cad525840b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZF73856',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 97729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-05',
 'seller_name': None,
 'title': 'BMW X4 M',
 'transmission': 'automatic',
 'trim': 'BW',
 'year': 2020}
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZF73856%27 HTTP/1.1" 200 None
2026-03-30 07:51:13 [auto1.de] INFO: Saving data for ZF73856: {'auction_closing_time': 1774885969.0, 'created_time': 1774639614.403657, 'last_price_update_time': 1774857073.633045}
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ZF73856') HTTP/1.1" 204 0
2026-03-30 07:51:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f7cbda55-fa7e-5855-bea4-a244a835c7a9 with identifier: KH87635
2026-03-30 07:51:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f7cbda55-fa7e-5855-bea4-a244a835c7a9 with identifier: KH87635
2026-03-30 07:51:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f7cbda55-fa7e-5855-bea4-a244a835c7a9 with identifier: KH87635 to the API
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:28:41Z',
 'fuel_type': 'hybrid',
 'id': 'f7cbda55-fa7e-5855-bea4-a244a835c7a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH87635',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 25284,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-26',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 eHybrid Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2022}
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH87635%27 HTTP/1.1" 200 None
2026-03-30 07:51:13 [auto1.de] INFO: Saving data for KH87635: {'auction_closing_time': 1774884521.0, 'created_time': 1774552995.066208, 'last_price_update_time': 1774857073.916741}
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KH87635') HTTP/1.1" 204 0
2026-03-30 07:51:13 [auto1.de] INFO: Found listing with ID: XR30933
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR30933%27 HTTP/1.1" 200 None
2026-03-30 07:51:13 [auto1.de] INFO: Scrape type for XR30933: 0
2026-03-30 07:51:13 [auto1.de] INFO: Found listing with ID: XB63753
2026-03-30 07:51:13 [auto1.de] INFO: Found listing with ID: BZ79041
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ79041%27 HTTP/1.1" 200 None
2026-03-30 07:51:13 [auto1.de] INFO: Scrape type for BZ79041: 2
2026-03-30 07:51:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f29c632-8079-56d7-aedf-ba16f23fd792 with identifier: BZ79041
2026-03-30 07:51:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f29c632-8079-56d7-aedf-ba16f23fd792 with scrape type 2
2026-03-30 07:51:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f29c632-8079-56d7-aedf-ba16f23fd792 with scrape type 2
2026-03-30 07:51:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6f29c632-8079-56d7-aedf-ba16f23fd792, identifier: BZ79041
2026-03-30 07:51:14 [auto1.de] INFO: Found listing with ID: NZ21452
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ21452%27 HTTP/1.1" 200 None
2026-03-30 07:51:14 [auto1.de] INFO: Scrape type for NZ21452: 2
2026-03-30 07:51:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b316e05b-3aa6-5474-a166-c55b6f1e2b6c with identifier: NZ21452
2026-03-30 07:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b316e05b-3aa6-5474-a166-c55b6f1e2b6c with scrape type 2
2026-03-30 07:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b316e05b-3aa6-5474-a166-c55b6f1e2b6c with scrape type 2
2026-03-30 07:51:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b316e05b-3aa6-5474-a166-c55b6f1e2b6c, identifier: NZ21452
2026-03-30 07:51:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6f29c632-8079-56d7-aedf-ba16f23fd792 with identifier: BZ79041
2026-03-30 07:51:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6f29c632-8079-56d7-aedf-ba16f23fd792 with identifier: BZ79041
2026-03-30 07:51:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6f29c632-8079-56d7-aedf-ba16f23fd792 with identifier: BZ79041 to the API
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-30T15:51:40Z',
 'fuel_type': 'petrol',
 'id': '6f29c632-8079-56d7-aedf-ba16f23fd792',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ79041',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 221151,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-16',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2012}
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BZ79041%27 HTTP/1.1" 200 None
2026-03-30 07:51:14 [auto1.de] INFO: Saving data for BZ79041: {'auction_closing_time': 1774885900.0, 'created_time': 1774639696.665677, 'last_price_update_time': 1774857074.452715}
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BZ79041') HTTP/1.1" 204 0
2026-03-30 07:51:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b316e05b-3aa6-5474-a166-c55b6f1e2b6c with identifier: NZ21452
2026-03-30 07:51:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b316e05b-3aa6-5474-a166-c55b6f1e2b6c with identifier: NZ21452
2026-03-30 07:51:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b316e05b-3aa6-5474-a166-c55b6f1e2b6c with identifier: NZ21452 to the API
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:08:11Z',
 'fuel_type': 'petrol',
 'id': 'b316e05b-3aa6-5474-a166-c55b6f1e2b6c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NZ21452',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 43617,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-06',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.2 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2011}
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ21452%27 HTTP/1.1" 200 None
2026-03-30 07:51:14 [auto1.de] INFO: Saving data for NZ21452: {'auction_closing_time': 1774883291.0, 'created_time': 1774552913.163639, 'last_price_update_time': 1774857074.832127}
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NZ21452') HTTP/1.1" 204 0
2026-03-30 07:51:14 [auto1.de] INFO: Found listing with ID: ME72354
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ME72354%27 HTTP/1.1" 200 None
2026-03-30 07:51:14 [auto1.de] INFO: Scrape type for ME72354: 0
2026-03-30 07:51:14 [auto1.de] INFO: Found listing with ID: SW13301
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW13301%27 HTTP/1.1" 200 None
2026-03-30 07:51:14 [auto1.de] INFO: Scrape type for SW13301: 0
2026-03-30 07:51:14 [auto1.de] INFO: Found listing with ID: KV52621
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV52621%27 HTTP/1.1" 200 None
2026-03-30 07:51:14 [auto1.de] INFO: Scrape type for KV52621: 0
2026-03-30 07:51:14 [auto1.de] INFO: Found listing with ID: ER51805
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER51805%27 HTTP/1.1" 200 None
2026-03-30 07:51:14 [auto1.de] INFO: Scrape type for ER51805: 0
2026-03-30 07:51:14 [auto1.de] INFO: Found listing with ID: VY78817
2026-03-30 07:51:14 [auto1.de] INFO: Found listing with ID: BX26482
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX26482%27 HTTP/1.1" 200 None
2026-03-30 07:51:14 [auto1.de] INFO: Scrape type for BX26482: 0
2026-03-30 07:51:14 [auto1.de] INFO: Found listing with ID: GS86907
2026-03-30 07:51:14 [auto1.de] INFO: Found listing with ID: RC49554
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC49554%27 HTTP/1.1" 200 None
2026-03-30 07:51:14 [auto1.de] INFO: Scrape type for RC49554: 0
2026-03-30 07:51:14 [auto1.de] INFO: Found listing with ID: FN01227
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN01227%27 HTTP/1.1" 200 None
2026-03-30 07:51:14 [auto1.de] INFO: Scrape type for FN01227: 2
2026-03-30 07:51:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0950b97-e003-54b9-a4c7-968286e17e95 with identifier: FN01227
2026-03-30 07:51:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0950b97-e003-54b9-a4c7-968286e17e95 with scrape type 2
2026-03-30 07:51:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d0950b97-e003-54b9-a4c7-968286e17e95 with scrape type 2
2026-03-30 07:51:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d0950b97-e003-54b9-a4c7-968286e17e95, identifier: FN01227
2026-03-30 07:51:15 [auto1.de] INFO: Found listing with ID: FN51585
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN51585%27 HTTP/1.1" 200 None
2026-03-30 07:51:15 [auto1.de] INFO: Scrape type for FN51585: 0
2026-03-30 07:51:15 [auto1.de] INFO: Found listing with ID: ER89217
2026-03-30 07:51:15 [auto1.de] INFO: Found listing with ID: AE67956
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AE67956%27 HTTP/1.1" 200 None
2026-03-30 07:51:15 [auto1.de] INFO: Scrape type for AE67956: 0
2026-03-30 07:51:15 [auto1.de] INFO: Found listing with ID: XM89515
2026-03-30 07:51:15 [auto1.de] INFO: Found listing with ID: PB15916
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB15916%27 HTTP/1.1" 200 None
2026-03-30 07:51:15 [auto1.de] INFO: Scrape type for PB15916: 2
2026-03-30 07:51:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6763de55-3ac6-57a6-bdfd-a62a06338340 with identifier: PB15916
2026-03-30 07:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6763de55-3ac6-57a6-bdfd-a62a06338340 with scrape type 2
2026-03-30 07:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6763de55-3ac6-57a6-bdfd-a62a06338340 with scrape type 2
2026-03-30 07:51:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6763de55-3ac6-57a6-bdfd-a62a06338340, identifier: PB15916
2026-03-30 07:51:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d0950b97-e003-54b9-a4c7-968286e17e95 with identifier: FN01227
2026-03-30 07:51:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d0950b97-e003-54b9-a4c7-968286e17e95 with identifier: FN01227
2026-03-30 07:51:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d0950b97-e003-54b9-a4c7-968286e17e95 with identifier: FN01227 to the API
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:31:22Z',
 'fuel_type': 'diesel',
 'id': 'd0950b97-e003-54b9-a4c7-968286e17e95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FN01227',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 184158,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-18',
 'seller_name': None,
 'title': 'Ford Kuga 2.0 TDCi Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2011}
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN01227%27 HTTP/1.1" 200 None
2026-03-30 07:51:15 [auto1.de] INFO: Saving data for FN01227: {'auction_closing_time': 1774884682.0, 'created_time': 1774552602.798169, 'last_price_update_time': 1774857075.462051}
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FN01227') HTTP/1.1" 204 0
2026-03-30 07:51:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6763de55-3ac6-57a6-bdfd-a62a06338340 with identifier: PB15916
2026-03-30 07:51:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6763de55-3ac6-57a6-bdfd-a62a06338340 with identifier: PB15916
2026-03-30 07:51:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6763de55-3ac6-57a6-bdfd-a62a06338340 with identifier: PB15916 to the API
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:14:54Z',
 'fuel_type': 'diesel',
 'id': '6763de55-3ac6-57a6-bdfd-a62a06338340',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PB15916',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 143632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-08-04',
 'seller_name': None,
 'title': 'Peugeot 3008 2.0 Blue-HDi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB15916%27 HTTP/1.1" 200 None
2026-03-30 07:51:15 [auto1.de] INFO: Saving data for PB15916: {'auction_closing_time': 1774883694.0, 'created_time': 1772541504.831496, 'last_price_update_time': 1774857075.923569}
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PB15916') HTTP/1.1" 204 0
2026-03-30 07:51:15 [auto1.de] INFO: Found listing with ID: MK04993
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK04993%27 HTTP/1.1" 200 None
2026-03-30 07:51:15 [auto1.de] INFO: Scrape type for MK04993: 0
2026-03-30 07:51:15 [auto1.de] INFO: Found listing with ID: RA95780
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RA95780%27 HTTP/1.1" 200 None
2026-03-30 07:51:15 [auto1.de] INFO: Scrape type for RA95780: 0
2026-03-30 07:51:15 [auto1.de] INFO: Found listing with ID: LK83365
2026-03-30 07:51:15 [auto1.de] INFO: Found listing with ID: YS84502
2026-03-30 07:51:15 [auto1.de] INFO: Found listing with ID: SS31762
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS31762%27 HTTP/1.1" 200 None
2026-03-30 07:51:15 [auto1.de] INFO: Scrape type for SS31762: 2
2026-03-30 07:51:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ef64d3a-9d1a-5dca-b149-d4b7764f0166 with identifier: SS31762
2026-03-30 07:51:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ef64d3a-9d1a-5dca-b149-d4b7764f0166 with scrape type 2
2026-03-30 07:51:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ef64d3a-9d1a-5dca-b149-d4b7764f0166 with scrape type 2
2026-03-30 07:51:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6ef64d3a-9d1a-5dca-b149-d4b7764f0166, identifier: SS31762
2026-03-30 07:51:16 [auto1.de] INFO: Found listing with ID: BX10295
2026-03-30 07:51:16 [auto1.de] INFO: Found listing with ID: NA39997
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NA39997%27 HTTP/1.1" 200 None
2026-03-30 07:51:16 [auto1.de] INFO: Scrape type for NA39997: 0
2026-03-30 07:51:16 [auto1.de] INFO: Found listing with ID: DA58180
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA58180%27 HTTP/1.1" 200 None
2026-03-30 07:51:16 [auto1.de] INFO: Scrape type for DA58180: 2
2026-03-30 07:51:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e028f885-b500-5342-b8c8-cbd80f609bbd with identifier: DA58180
2026-03-30 07:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e028f885-b500-5342-b8c8-cbd80f609bbd with scrape type 2
2026-03-30 07:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e028f885-b500-5342-b8c8-cbd80f609bbd with scrape type 2
2026-03-30 07:51:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e028f885-b500-5342-b8c8-cbd80f609bbd, identifier: DA58180
2026-03-30 07:51:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6ef64d3a-9d1a-5dca-b149-d4b7764f0166 with identifier: SS31762
2026-03-30 07:51:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6ef64d3a-9d1a-5dca-b149-d4b7764f0166 with identifier: SS31762
2026-03-30 07:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6ef64d3a-9d1a-5dca-b149-d4b7764f0166 with identifier: SS31762 to the API
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:15:05Z',
 'fuel_type': 'petrol',
 'id': '6ef64d3a-9d1a-5dca-b149-d4b7764f0166',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS31762',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500X',
 'odometer': 89871,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-27',
 'seller_name': None,
 'title': 'Fiat 500X 1.4 Turbo Pop Star',
 'transmission': 'manual',
 'trim': 'Pop Star',
 'year': 2017}
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS31762%27 HTTP/1.1" 200 None
2026-03-30 07:51:16 [auto1.de] INFO: Saving data for SS31762: {'auction_closing_time': 1774883705.0, 'created_time': 1774639883.084186, 'last_price_update_time': 1774857076.484704}
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SS31762') HTTP/1.1" 204 0
2026-03-30 07:51:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e028f885-b500-5342-b8c8-cbd80f609bbd with identifier: DA58180
2026-03-30 07:51:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e028f885-b500-5342-b8c8-cbd80f609bbd with identifier: DA58180
2026-03-30 07:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e028f885-b500-5342-b8c8-cbd80f609bbd with identifier: DA58180 to the API
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:36:13Z',
 'fuel_type': 'petrol',
 'id': 'e028f885-b500-5342-b8c8-cbd80f609bbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA58180',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 219559,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-28',
 'seller_name': None,
 'title': 'Mazda 6 2.0 Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2011}
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA58180%27 HTTP/1.1" 200 None
2026-03-30 07:51:16 [auto1.de] INFO: Saving data for DA58180: {'auction_closing_time': 1774884973.0, 'created_time': 1774638820.602286, 'last_price_update_time': 1774857076.763378}
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DA58180') HTTP/1.1" 204 0
2026-03-30 07:51:16 [auto1.de] INFO: Found listing with ID: VR01853
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01853%27 HTTP/1.1" 200 None
2026-03-30 07:51:16 [auto1.de] INFO: Scrape type for VR01853: 2
2026-03-30 07:51:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6b64b36-1f9a-50bb-91ff-769999fcaa1b with identifier: VR01853
2026-03-30 07:51:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6b64b36-1f9a-50bb-91ff-769999fcaa1b with scrape type 2
2026-03-30 07:51:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6b64b36-1f9a-50bb-91ff-769999fcaa1b with scrape type 2
2026-03-30 07:51:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b6b64b36-1f9a-50bb-91ff-769999fcaa1b, identifier: VR01853
2026-03-30 07:51:16 [auto1.de] INFO: Found listing with ID: SR34905
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR34905%27 HTTP/1.1" 200 None
2026-03-30 07:51:16 [auto1.de] INFO: Scrape type for SR34905: 0
2026-03-30 07:51:16 [auto1.de] INFO: Found listing with ID: KV56224
2026-03-30 07:51:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b6b64b36-1f9a-50bb-91ff-769999fcaa1b with identifier: VR01853
2026-03-30 07:51:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b6b64b36-1f9a-50bb-91ff-769999fcaa1b with identifier: VR01853
2026-03-30 07:51:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b6b64b36-1f9a-50bb-91ff-769999fcaa1b with identifier: VR01853 to the API
2026-03-30 07:51:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:03:17Z',
 'fuel_type': 'diesel',
 'id': 'b6b64b36-1f9a-50bb-91ff-769999fcaa1b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR01853',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 220322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-22',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Soleil 4x4',
 'transmission': 'automatic',
 'trim': 'Soleil 4x4',
 'year': 2019}
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR01853%27 HTTP/1.1" 200 None
2026-03-30 07:51:17 [auto1.de] INFO: Saving data for VR01853: {'auction_closing_time': 1774882997.0, 'created_time': 1774640039.393612, 'last_price_update_time': 1774857077.193992}
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VR01853') HTTP/1.1" 204 0
2026-03-30 07:51:17 [auto1.de] INFO: Found listing with ID: FJ09626
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ09626%27 HTTP/1.1" 200 None
2026-03-30 07:51:17 [auto1.de] INFO: Scrape type for FJ09626: 2
2026-03-30 07:51:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 260ac118-0df0-50fb-b1fe-c054fc938c1f with identifier: FJ09626
2026-03-30 07:51:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 260ac118-0df0-50fb-b1fe-c054fc938c1f with scrape type 2
2026-03-30 07:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 260ac118-0df0-50fb-b1fe-c054fc938c1f with scrape type 2
2026-03-30 07:51:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 260ac118-0df0-50fb-b1fe-c054fc938c1f, identifier: FJ09626
2026-03-30 07:51:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 260ac118-0df0-50fb-b1fe-c054fc938c1f with identifier: FJ09626
2026-03-30 07:51:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 260ac118-0df0-50fb-b1fe-c054fc938c1f with identifier: FJ09626
2026-03-30 07:51:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 260ac118-0df0-50fb-b1fe-c054fc938c1f with identifier: FJ09626 to the API
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:14:31Z',
 'fuel_type': 'petrol',
 'id': '260ac118-0df0-50fb-b1fe-c054fc938c1f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ09626',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 53076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-11-25',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Cool Edition',
 'transmission': 'manual',
 'trim': 'Cool Edition',
 'year': 2015}
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ09626%27 HTTP/1.1" 200 None
2026-03-30 07:51:17 [auto1.de] INFO: Saving data for FJ09626: {'auction_closing_time': 1774883671.0, 'created_time': 1774553212.630963, 'last_price_update_time': 1774857077.682211}
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FJ09626') HTTP/1.1" 204 0
2026-03-30 07:51:17 [auto1.de] INFO: Found listing with ID: CW50467
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW50467%27 HTTP/1.1" 200 None
2026-03-30 07:51:17 [auto1.de] INFO: Scrape type for CW50467: 0
2026-03-30 07:51:17 [auto1.de] INFO: Found listing with ID: LJ58036
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ58036%27 HTTP/1.1" 200 None
2026-03-30 07:51:17 [auto1.de] INFO: Scrape type for LJ58036: 0
2026-03-30 07:51:17 [auto1.de] INFO: Found listing with ID: UL59525
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL59525%27 HTTP/1.1" 200 None
2026-03-30 07:51:17 [auto1.de] INFO: Scrape type for UL59525: 0
2026-03-30 07:51:17 [auto1.de] INFO: Found listing with ID: GH08686
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH08686%27 HTTP/1.1" 200 None
2026-03-30 07:51:17 [auto1.de] INFO: Scrape type for GH08686: 2
2026-03-30 07:51:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8bfac6f-2127-5c5c-9b3f-6a1180888086 with identifier: GH08686
2026-03-30 07:51:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8bfac6f-2127-5c5c-9b3f-6a1180888086 with scrape type 2
2026-03-30 07:51:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8bfac6f-2127-5c5c-9b3f-6a1180888086 with scrape type 2
2026-03-30 07:51:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c8bfac6f-2127-5c5c-9b3f-6a1180888086, identifier: GH08686
2026-03-30 07:51:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c8bfac6f-2127-5c5c-9b3f-6a1180888086 with identifier: GH08686
2026-03-30 07:51:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c8bfac6f-2127-5c5c-9b3f-6a1180888086 with identifier: GH08686
2026-03-30 07:51:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c8bfac6f-2127-5c5c-9b3f-6a1180888086 with identifier: GH08686 to the API
2026-03-30 07:51:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:54:20Z',
 'fuel_type': 'diesel',
 'id': 'c8bfac6f-2127-5c5c-9b3f-6a1180888086',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GH08686',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 199716,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-23',
 'seller_name': None,
 'title': 'Mazda CX-5 2.2 Turbodiesel Center-Line 2WD',
 'transmission': 'manual',
 'trim': 'Center-Line 2WD',
 'year': 2018}
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GH08686%27 HTTP/1.1" 200 None
2026-03-30 07:51:18 [auto1.de] INFO: Saving data for GH08686: {'auction_closing_time': 1774886060.0, 'created_time': 1774638579.153034, 'last_price_update_time': 1774857078.132166}
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GH08686') HTTP/1.1" 204 0
2026-03-30 07:51:18 [auto1.de] INFO: Found listing with ID: XB90216
2026-03-30 07:51:18 [auto1.de] INFO: Found listing with ID: HH06694
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06694%27 HTTP/1.1" 200 None
2026-03-30 07:51:18 [auto1.de] INFO: Scrape type for HH06694: 2
2026-03-30 07:51:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e215100-83b1-5dca-89fc-cc545d2a09ce with identifier: HH06694
2026-03-30 07:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e215100-83b1-5dca-89fc-cc545d2a09ce with scrape type 2
2026-03-30 07:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e215100-83b1-5dca-89fc-cc545d2a09ce with scrape type 2
2026-03-30 07:51:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e215100-83b1-5dca-89fc-cc545d2a09ce, identifier: HH06694
2026-03-30 07:51:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e215100-83b1-5dca-89fc-cc545d2a09ce with identifier: HH06694
2026-03-30 07:51:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e215100-83b1-5dca-89fc-cc545d2a09ce with identifier: HH06694
2026-03-30 07:51:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e215100-83b1-5dca-89fc-cc545d2a09ce with identifier: HH06694 to the API
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:56:38Z',
 'fuel_type': 'petrol',
 'id': '9e215100-83b1-5dca-89fc-cc545d2a09ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH06694',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 81379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-27',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2013}
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HH06694%27 HTTP/1.1" 200 None
2026-03-30 07:51:18 [auto1.de] INFO: Saving data for HH06694: {'auction_closing_time': 1774886198.0, 'created_time': 1774637210.450746, 'last_price_update_time': 1774857078.551633}
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HH06694') HTTP/1.1" 204 0
2026-03-30 07:51:18 [auto1.de] INFO: Found listing with ID: CM33145
2026-03-30 07:51:18 [auto1.de] INFO: Found listing with ID: GR02584
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GR02584%27 HTTP/1.1" 200 None
2026-03-30 07:51:18 [auto1.de] INFO: Scrape type for GR02584: 0
2026-03-30 07:51:18 [auto1.de] INFO: Found listing with ID: EV68047
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EV68047%27 HTTP/1.1" 200 None
2026-03-30 07:51:18 [auto1.de] INFO: Scrape type for EV68047: 0
2026-03-30 07:51:18 [auto1.de] INFO: Found listing with ID: MT67219
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT67219%27 HTTP/1.1" 200 None
2026-03-30 07:51:18 [auto1.de] INFO: Scrape type for MT67219: 2
2026-03-30 07:51:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1862b99-7bd0-5f83-b0d0-d5015ee8da5e with identifier: MT67219
2026-03-30 07:51:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1862b99-7bd0-5f83-b0d0-d5015ee8da5e with scrape type 2
2026-03-30 07:51:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1862b99-7bd0-5f83-b0d0-d5015ee8da5e with scrape type 2
2026-03-30 07:51:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f1862b99-7bd0-5f83-b0d0-d5015ee8da5e, identifier: MT67219
2026-03-30 07:51:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f1862b99-7bd0-5f83-b0d0-d5015ee8da5e with identifier: MT67219
2026-03-30 07:51:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f1862b99-7bd0-5f83-b0d0-d5015ee8da5e with identifier: MT67219
2026-03-30 07:51:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f1862b99-7bd0-5f83-b0d0-d5015ee8da5e with identifier: MT67219 to the API
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:44:51Z',
 'fuel_type': 'petrol',
 'id': 'f1862b99-7bd0-5f83-b0d0-d5015ee8da5e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MT67219',
 'listing': 'auction',
 'make': 'Jeep',
 'model': 'Compass',
 'odometer': 124694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-23',
 'seller_name': None,
 'title': 'Jeep Compass 2.4 Limited 4x4',
 'transmission': 'automatic',
 'trim': 'Limited 4x4',
 'year': 2011}
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MT67219%27 HTTP/1.1" 200 None
2026-03-30 07:51:18 [auto1.de] INFO: Saving data for MT67219: {'auction_closing_time': 1774885491.0, 'created_time': 1774639613.6571, 'last_price_update_time': 1774857078.962848}
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MT67219') HTTP/1.1" 204 0
2026-03-30 07:51:19 [auto1.de] INFO: Found listing with ID: CZ44674
2026-03-30 07:51:19 [auto1.de] INFO: Found listing with ID: HP53076
2026-03-30 07:51:19 [auto1.de] INFO: Found listing with ID: NL93561
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NL93561%27 HTTP/1.1" 200 None
2026-03-30 07:51:19 [auto1.de] INFO: Scrape type for NL93561: 0
2026-03-30 07:51:19 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED94101%27 HTTP/1.1" 200 None
2026-03-30 07:51:19 [auto1.de] INFO: Scrape type for ED94101: 2
2026-03-30 07:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8be8bb19-b84f-5882-8825-f4acb815fc9b with identifier: ED94101
2026-03-30 07:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8be8bb19-b84f-5882-8825-f4acb815fc9b with scrape type 2
2026-03-30 07:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8be8bb19-b84f-5882-8825-f4acb815fc9b with scrape type 2
2026-03-30 07:51:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8be8bb19-b84f-5882-8825-f4acb815fc9b, identifier: ED94101
2026-03-30 07:51:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8be8bb19-b84f-5882-8825-f4acb815fc9b with identifier: ED94101
2026-03-30 07:51:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8be8bb19-b84f-5882-8825-f4acb815fc9b with identifier: ED94101
2026-03-30 07:51:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8be8bb19-b84f-5882-8825-f4acb815fc9b with identifier: ED94101 to the API
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:21:54Z',
 'fuel_type': 'diesel',
 'id': '8be8bb19-b84f-5882-8825-f4acb815fc9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED94101',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Sharan',
 'odometer': 500991,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Volkswagen Sharan 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2017}
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED94101%27 HTTP/1.1" 200 None
2026-03-30 07:51:19 [auto1.de] INFO: Saving data for ED94101: {'auction_closing_time': 1774884114.0, 'created_time': 1774551262.967739, 'last_price_update_time': 1774857079.46796}
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED94101') HTTP/1.1" 204 0
2026-03-30 07:51:19 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV90195%27 HTTP/1.1" 200 None
2026-03-30 07:51:19 [auto1.de] INFO: Scrape type for VV90195: 2
2026-03-30 07:51:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4040f35-fa58-58c3-8721-0484cc2d5d24 with identifier: VV90195
2026-03-30 07:51:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4040f35-fa58-58c3-8721-0484cc2d5d24 with scrape type 2
2026-03-30 07:51:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4040f35-fa58-58c3-8721-0484cc2d5d24 with scrape type 2
2026-03-30 07:51:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c4040f35-fa58-58c3-8721-0484cc2d5d24, identifier: VV90195
2026-03-30 07:51:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c4040f35-fa58-58c3-8721-0484cc2d5d24 with identifier: VV90195
2026-03-30 07:51:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c4040f35-fa58-58c3-8721-0484cc2d5d24 with identifier: VV90195
2026-03-30 07:51:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c4040f35-fa58-58c3-8721-0484cc2d5d24 with identifier: VV90195 to the API
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:29:59Z',
 'fuel_type': 'diesel',
 'id': 'c4040f35-fa58-58c3-8721-0484cc2d5d24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV90195',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 124319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-30',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2011}
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV90195%27 HTTP/1.1" 200 None
2026-03-30 07:51:19 [auto1.de] INFO: Saving data for VV90195: {'auction_closing_time': 1774884599.0, 'created_time': 1773383815.67588, 'last_price_update_time': 1774857079.885749}
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VV90195') HTTP/1.1" 204 0
2026-03-30 07:51:19 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-30 07:51:19 [auto1.de] INFO: Scrape type for FR95379: 0
2026-03-30 07:51:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:51:47 [auto1.de] INFO: Channel: 24h | Page: 176 | totalHits: 8418 | hits on page: 40
2026-03-30 07:51:47 [auto1.de] INFO: Found listing with ID: ED94101
2026-03-30 07:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED94101%27 HTTP/1.1" 200 None
2026-03-30 07:51:47 [auto1.de] INFO: Scrape type for ED94101: 0
2026-03-30 07:51:47 [auto1.de] INFO: Found listing with ID: VV90195
2026-03-30 07:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VV90195%27 HTTP/1.1" 200 None
2026-03-30 07:51:47 [auto1.de] INFO: Scrape type for VV90195: 0
2026-03-30 07:51:47 [auto1.de] INFO: Found listing with ID: FR95379
2026-03-30 07:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FR95379%27 HTTP/1.1" 200 None
2026-03-30 07:51:47 [auto1.de] INFO: Scrape type for FR95379: 0
2026-03-30 07:51:47 [auto1.de] INFO: Found listing with ID: HV99123
2026-03-30 07:51:47 [auto1.de] INFO: Found listing with ID: NV40301
2026-03-30 07:51:47 [auto1.de] INFO: Found listing with ID: HK09580
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK09580%27 HTTP/1.1" 200 None
2026-03-30 07:51:48 [auto1.de] INFO: Scrape type for HK09580: 0
2026-03-30 07:51:48 [auto1.de] INFO: Found listing with ID: XP92221
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP92221%27 HTTP/1.1" 200 None
2026-03-30 07:51:48 [auto1.de] INFO: Scrape type for XP92221: 2
2026-03-30 07:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with identifier: XP92221
2026-03-30 07:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with scrape type 2
2026-03-30 07:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with scrape type 2
2026-03-30 07:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 17ddd9b0-3008-5777-aab4-758d0fc42bf6, identifier: XP92221
2026-03-30 07:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with identifier: XP92221
2026-03-30 07:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with identifier: XP92221
2026-03-30 07:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 17ddd9b0-3008-5777-aab4-758d0fc42bf6 with identifier: XP92221 to the API
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:25:14Z',
 'fuel_type': 'petrol',
 'id': '17ddd9b0-3008-5777-aab4-758d0fc42bf6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP92221',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 130825,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-08',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 Best of',
 'transmission': 'manual',
 'trim': 'Best of',
 'year': 2009}
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP92221%27 HTTP/1.1" 200 None
2026-03-30 07:51:48 [auto1.de] INFO: Saving data for XP92221: {'auction_closing_time': 1774884314.0, 'created_time': 1774589752.960207, 'last_price_update_time': 1774857108.458048}
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XP92221') HTTP/1.1" 204 0
2026-03-30 07:51:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:51:48 [auto1.de] INFO: Found listing with ID: SG08680
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08680%27 HTTP/1.1" 200 None
2026-03-30 07:51:48 [auto1.de] INFO: Scrape type for SG08680: 2
2026-03-30 07:51:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with identifier: SG08680
2026-03-30 07:51:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with scrape type 2
2026-03-30 07:51:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with scrape type 2
2026-03-30 07:51:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47, identifier: SG08680
2026-03-30 07:51:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with identifier: SG08680
2026-03-30 07:51:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with identifier: SG08680
2026-03-30 07:51:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 95d659b7-d6a6-54fa-8a5c-8c85eaa55a47 with identifier: SG08680 to the API
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-30T15:38:13Z',
 'fuel_type': 'diesel',
 'id': '95d659b7-d6a6-54fa-8a5c-8c85eaa55a47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG08680',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 372220,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-12-07',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.5 TDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2004}
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG08680%27 HTTP/1.1" 200 None
2026-03-30 07:51:48 [auto1.de] INFO: Saving data for SG08680: {'auction_closing_time': 1774885093.0, 'created_time': 1773946867.65972, 'last_price_update_time': 1774857108.991837}
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG08680') HTTP/1.1" 204 0
2026-03-30 07:51:49 [auto1.de] INFO: Found listing with ID: HG24809
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG24809%27 HTTP/1.1" 200 None
2026-03-30 07:51:49 [auto1.de] INFO: Scrape type for HG24809: 2
2026-03-30 07:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d03d44a-e8f2-5507-8c81-d932c7a28aa3 with identifier: HG24809
2026-03-30 07:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d03d44a-e8f2-5507-8c81-d932c7a28aa3 with scrape type 2
2026-03-30 07:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d03d44a-e8f2-5507-8c81-d932c7a28aa3 with scrape type 2
2026-03-30 07:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9d03d44a-e8f2-5507-8c81-d932c7a28aa3, identifier: HG24809
2026-03-30 07:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9d03d44a-e8f2-5507-8c81-d932c7a28aa3 with identifier: HG24809
2026-03-30 07:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9d03d44a-e8f2-5507-8c81-d932c7a28aa3 with identifier: HG24809
2026-03-30 07:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9d03d44a-e8f2-5507-8c81-d932c7a28aa3 with identifier: HG24809 to the API
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:54:18Z',
 'fuel_type': 'diesel',
 'id': '9d03d44a-e8f2-5507-8c81-d932c7a28aa3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HG24809',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Pulsar',
 'odometer': 251348,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-09-30',
 'seller_name': None,
 'title': 'Nissan Pulsar 1.5 Turbodiesel Acenta Launch Edition',
 'transmission': 'manual',
 'trim': 'Acenta Launch Edition',
 'year': 2014}
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HG24809%27 HTTP/1.1" 200 None
2026-03-30 07:51:49 [auto1.de] INFO: Saving data for HG24809: {'auction_closing_time': 1774886058.0, 'created_time': 1774639740.573905, 'last_price_update_time': 1774857109.404913}
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HG24809') HTTP/1.1" 204 0
2026-03-30 07:51:49 [auto1.de] INFO: Found listing with ID: KP72135
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KP72135%27 HTTP/1.1" 200 None
2026-03-30 07:51:49 [auto1.de] INFO: Scrape type for KP72135: 0
2026-03-30 07:51:49 [auto1.de] INFO: Found listing with ID: ZE10872
2026-03-30 07:51:49 [auto1.de] INFO: Found listing with ID: TN09859
2026-03-30 07:51:49 [auto1.de] INFO: Found listing with ID: BH21613
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH21613%27 HTTP/1.1" 200 None
2026-03-30 07:51:49 [auto1.de] INFO: Scrape type for BH21613: 0
2026-03-30 07:51:49 [auto1.de] INFO: Found listing with ID: LL82276
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL82276%27 HTTP/1.1" 200 None
2026-03-30 07:51:49 [auto1.de] INFO: Scrape type for LL82276: 2
2026-03-30 07:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f26f037c-8331-513b-84b2-877a26abf720 with identifier: LL82276
2026-03-30 07:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f26f037c-8331-513b-84b2-877a26abf720 with scrape type 2
2026-03-30 07:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f26f037c-8331-513b-84b2-877a26abf720 with scrape type 2
2026-03-30 07:51:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: f26f037c-8331-513b-84b2-877a26abf720, identifier: LL82276
2026-03-30 07:51:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: f26f037c-8331-513b-84b2-877a26abf720 with identifier: LL82276
2026-03-30 07:51:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: f26f037c-8331-513b-84b2-877a26abf720 with identifier: LL82276
2026-03-30 07:51:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: f26f037c-8331-513b-84b2-877a26abf720 with identifier: LL82276 to the API
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:46:19Z',
 'fuel_type': 'diesel',
 'id': 'f26f037c-8331-513b-84b2-877a26abf720',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LL82276',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 193457,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-03',
 'seller_name': None,
 'title': 'Ford Focus 1.6 TDCi Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LL82276%27 HTTP/1.1" 200 None
2026-03-30 07:51:49 [auto1.de] INFO: Saving data for LL82276: {'auction_closing_time': 1774885579.0, 'created_time': 1774638508.219997, 'last_price_update_time': 1774857109.888471}
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LL82276') HTTP/1.1" 204 0
2026-03-30 07:51:49 [auto1.de] INFO: Found listing with ID: AB05978
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05978%27 HTTP/1.1" 200 None
2026-03-30 07:51:49 [auto1.de] INFO: Scrape type for AB05978: 2
2026-03-30 07:51:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with identifier: AB05978
2026-03-30 07:51:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with scrape type 2
2026-03-30 07:51:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with scrape type 2
2026-03-30 07:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344, identifier: AB05978
2026-03-30 07:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with identifier: AB05978
2026-03-30 07:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with identifier: AB05978
2026-03-30 07:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 94a43c6c-3af8-5b3f-b325-b7c8cf9d7344 with identifier: AB05978 to the API
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:52:00Z',
 'fuel_type': 'petrol',
 'id': '94a43c6c-3af8-5b3f-b325-b7c8cf9d7344',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB05978',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 134740,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-10',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TSI Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2016}
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB05978%27 HTTP/1.1" 200 None
2026-03-30 07:51:50 [auto1.de] INFO: Saving data for AB05978: {'auction_closing_time': 1774885920.0, 'created_time': 1774552464.906415, 'last_price_update_time': 1774857110.291026}
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AB05978') HTTP/1.1" 204 0
2026-03-30 07:51:50 [auto1.de] INFO: Found listing with ID: ZL89473
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZL89473%27 HTTP/1.1" 200 None
2026-03-30 07:51:50 [auto1.de] INFO: Scrape type for ZL89473: 0
2026-03-30 07:51:50 [auto1.de] INFO: Found listing with ID: GN37925
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN37925%27 HTTP/1.1" 200 None
2026-03-30 07:51:50 [auto1.de] INFO: Scrape type for GN37925: 2
2026-03-30 07:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd7fec58-a001-5335-b52e-5d210682c995 with identifier: GN37925
2026-03-30 07:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd7fec58-a001-5335-b52e-5d210682c995 with scrape type 2
2026-03-30 07:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dd7fec58-a001-5335-b52e-5d210682c995 with scrape type 2
2026-03-30 07:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dd7fec58-a001-5335-b52e-5d210682c995, identifier: GN37925
2026-03-30 07:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dd7fec58-a001-5335-b52e-5d210682c995 with identifier: GN37925
2026-03-30 07:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dd7fec58-a001-5335-b52e-5d210682c995 with identifier: GN37925
2026-03-30 07:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dd7fec58-a001-5335-b52e-5d210682c995 with identifier: GN37925 to the API
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:25:20Z',
 'fuel_type': 'petrol',
 'id': 'dd7fec58-a001-5335-b52e-5d210682c995',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN37925',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 131290,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-10',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Spirit 2WD',
 'transmission': 'manual',
 'trim': 'Spirit 2WD',
 'year': 2012}
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN37925%27 HTTP/1.1" 200 None
2026-03-30 07:51:50 [auto1.de] INFO: Saving data for GN37925: {'auction_closing_time': 1774884320.0, 'created_time': 1774638943.509799, 'last_price_update_time': 1774857110.695155}
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GN37925') HTTP/1.1" 204 0
2026-03-30 07:51:50 [auto1.de] INFO: Found listing with ID: AY38359
2026-03-30 07:51:50 [auto1.de] INFO: Found listing with ID: BX19940
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX19940%27 HTTP/1.1" 200 None
2026-03-30 07:51:50 [auto1.de] INFO: Scrape type for BX19940: 0
2026-03-30 07:51:50 [auto1.de] INFO: Found listing with ID: ZF02079
2026-03-30 07:51:50 [auto1.de] INFO: Found listing with ID: BX27927
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27927%27 HTTP/1.1" 200 None
2026-03-30 07:51:50 [auto1.de] INFO: Scrape type for BX27927: 2
2026-03-30 07:51:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12f85f01-71cb-5aa1-8088-b6c0e679de88 with identifier: BX27927
2026-03-30 07:51:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f85f01-71cb-5aa1-8088-b6c0e679de88 with scrape type 2
2026-03-30 07:51:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12f85f01-71cb-5aa1-8088-b6c0e679de88 with scrape type 2
2026-03-30 07:51:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 12f85f01-71cb-5aa1-8088-b6c0e679de88, identifier: BX27927
2026-03-30 07:51:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 12f85f01-71cb-5aa1-8088-b6c0e679de88 with identifier: BX27927
2026-03-30 07:51:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 12f85f01-71cb-5aa1-8088-b6c0e679de88 with identifier: BX27927
2026-03-30 07:51:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 12f85f01-71cb-5aa1-8088-b6c0e679de88 with identifier: BX27927 to the API
2026-03-30 07:51:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:48:05Z',
 'fuel_type': 'diesel',
 'id': '12f85f01-71cb-5aa1-8088-b6c0e679de88',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX27927',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 263788,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2016}
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BX27927%27 HTTP/1.1" 200 None
2026-03-30 07:51:51 [auto1.de] INFO: Saving data for BX27927: {'auction_closing_time': 1774885685.0, 'created_time': 1774639613.97343, 'last_price_update_time': 1774857111.134032}
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='BX27927') HTTP/1.1" 204 0
2026-03-30 07:51:51 [auto1.de] INFO: Found listing with ID: WS31989
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS31989%27 HTTP/1.1" 200 None
2026-03-30 07:51:51 [auto1.de] INFO: Scrape type for WS31989: 0
2026-03-30 07:51:51 [auto1.de] INFO: Found listing with ID: FZ40219
2026-03-30 07:51:51 [auto1.de] INFO: Found listing with ID: AY73359
2026-03-30 07:51:51 [auto1.de] INFO: Found listing with ID: LR15690
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR15690%27 HTTP/1.1" 200 None
2026-03-30 07:51:51 [auto1.de] INFO: Scrape type for LR15690: 2
2026-03-30 07:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29774bec-84cc-5f2e-a726-6542944213a9 with identifier: LR15690
2026-03-30 07:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 29774bec-84cc-5f2e-a726-6542944213a9 with scrape type 2
2026-03-30 07:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 29774bec-84cc-5f2e-a726-6542944213a9 with scrape type 2
2026-03-30 07:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 29774bec-84cc-5f2e-a726-6542944213a9, identifier: LR15690
2026-03-30 07:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 29774bec-84cc-5f2e-a726-6542944213a9 with identifier: LR15690
2026-03-30 07:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 29774bec-84cc-5f2e-a726-6542944213a9 with identifier: LR15690
2026-03-30 07:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 29774bec-84cc-5f2e-a726-6542944213a9 with identifier: LR15690 to the API
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:03:00Z',
 'fuel_type': 'petrol',
 'id': '29774bec-84cc-5f2e-a726-6542944213a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR15690',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 99074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-28',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2017}
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR15690%27 HTTP/1.1" 200 None
2026-03-30 07:51:51 [auto1.de] INFO: Saving data for LR15690: {'auction_closing_time': 1774882980.0, 'created_time': 1774637028.615455, 'last_price_update_time': 1774857111.642594}
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LR15690') HTTP/1.1" 204 0
2026-03-30 07:51:51 [auto1.de] INFO: Found listing with ID: MD58686
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD58686%27 HTTP/1.1" 200 None
2026-03-30 07:51:51 [auto1.de] INFO: Scrape type for MD58686: 2
2026-03-30 07:51:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd95a08a-220e-5cc1-95ae-6836fa0149f6 with identifier: MD58686
2026-03-30 07:51:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd95a08a-220e-5cc1-95ae-6836fa0149f6 with scrape type 2
2026-03-30 07:51:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd95a08a-220e-5cc1-95ae-6836fa0149f6 with scrape type 2
2026-03-30 07:51:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd95a08a-220e-5cc1-95ae-6836fa0149f6, identifier: MD58686
2026-03-30 07:51:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd95a08a-220e-5cc1-95ae-6836fa0149f6 with identifier: MD58686
2026-03-30 07:51:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd95a08a-220e-5cc1-95ae-6836fa0149f6 with identifier: MD58686
2026-03-30 07:51:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd95a08a-220e-5cc1-95ae-6836fa0149f6 with identifier: MD58686 to the API
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:57:41Z',
 'fuel_type': 'petrol',
 'id': 'cd95a08a-220e-5cc1-95ae-6836fa0149f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD58686',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'ix35',
 'odometer': 170641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-19',
 'seller_name': None,
 'title': 'Hyundai ix35 1.6 5 Star Edition 2WD',
 'transmission': 'manual',
 'trim': '5 Star Edition 2WD',
 'year': 2013}
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD58686%27 HTTP/1.1" 200 None
2026-03-30 07:51:52 [auto1.de] INFO: Saving data for MD58686: {'auction_closing_time': 1774886261.0, 'created_time': 1774552706.872112, 'last_price_update_time': 1774857112.050132}
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MD58686') HTTP/1.1" 204 0
2026-03-30 07:51:52 [auto1.de] INFO: Found listing with ID: SG38319
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG38319%27 HTTP/1.1" 200 None
2026-03-30 07:51:52 [auto1.de] INFO: Scrape type for SG38319: 2
2026-03-30 07:51:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecbef80c-3749-5475-898a-56d6d9ee56de with identifier: SG38319
2026-03-30 07:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbef80c-3749-5475-898a-56d6d9ee56de with scrape type 2
2026-03-30 07:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecbef80c-3749-5475-898a-56d6d9ee56de with scrape type 2
2026-03-30 07:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ecbef80c-3749-5475-898a-56d6d9ee56de, identifier: SG38319
2026-03-30 07:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ecbef80c-3749-5475-898a-56d6d9ee56de with identifier: SG38319
2026-03-30 07:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ecbef80c-3749-5475-898a-56d6d9ee56de with identifier: SG38319
2026-03-30 07:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ecbef80c-3749-5475-898a-56d6d9ee56de with identifier: SG38319 to the API
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:56:35Z',
 'fuel_type': 'petrol',
 'id': 'ecbef80c-3749-5475-898a-56d6d9ee56de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG38319',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 164539,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-01-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.4 Elegance',
 'transmission': 'manual',
 'trim': 'Elegance',
 'year': 2004}
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG38319%27 HTTP/1.1" 200 None
2026-03-30 07:51:52 [auto1.de] INFO: Saving data for SG38319: {'auction_closing_time': 1774886195.0, 'created_time': 1774351335.08232, 'last_price_update_time': 1774857112.452739}
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SG38319') HTTP/1.1" 204 0
2026-03-30 07:51:52 [auto1.de] INFO: Found listing with ID: SB81454
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB81454%27 HTTP/1.1" 200 None
2026-03-30 07:51:52 [auto1.de] INFO: Scrape type for SB81454: 0
2026-03-30 07:51:52 [auto1.de] INFO: Found listing with ID: DZ84842
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ84842%27 HTTP/1.1" 200 None
2026-03-30 07:51:52 [auto1.de] INFO: Scrape type for DZ84842: 2
2026-03-30 07:51:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bdb2252-f0d3-5bf5-90d0-1ff5f47800e6 with identifier: DZ84842
2026-03-30 07:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bdb2252-f0d3-5bf5-90d0-1ff5f47800e6 with scrape type 2
2026-03-30 07:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bdb2252-f0d3-5bf5-90d0-1ff5f47800e6 with scrape type 2
2026-03-30 07:51:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4bdb2252-f0d3-5bf5-90d0-1ff5f47800e6, identifier: DZ84842
2026-03-30 07:51:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4bdb2252-f0d3-5bf5-90d0-1ff5f47800e6 with identifier: DZ84842
2026-03-30 07:51:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4bdb2252-f0d3-5bf5-90d0-1ff5f47800e6 with identifier: DZ84842
2026-03-30 07:51:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4bdb2252-f0d3-5bf5-90d0-1ff5f47800e6 with identifier: DZ84842 to the API
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:59:37Z',
 'fuel_type': 'diesel',
 'id': '4bdb2252-f0d3-5bf5-90d0-1ff5f47800e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ84842',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 184855,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-11',
 'seller_name': None,
 'title': 'Audi A4 2.0 TDI Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ84842%27 HTTP/1.1" 200 None
2026-03-30 07:51:52 [auto1.de] INFO: Saving data for DZ84842: {'auction_closing_time': 1774886377.0, 'created_time': 1774639928.949124, 'last_price_update_time': 1774857112.864952}
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DZ84842') HTTP/1.1" 204 0
2026-03-30 07:51:52 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:51:52 [auto1.de] INFO: Found listing with ID: PR96123
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR96123%27 HTTP/1.1" 200 None
2026-03-30 07:51:52 [auto1.de] INFO: Scrape type for PR96123: 0
2026-03-30 07:51:52 [auto1.de] INFO: Found listing with ID: SN98432
2026-03-30 07:51:52 [auto1.de] INFO: Found listing with ID: AR79819
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR79819%27 HTTP/1.1" 200 None
2026-03-30 07:51:52 [auto1.de] INFO: Scrape type for AR79819: 0
2026-03-30 07:51:52 [auto1.de] INFO: Found listing with ID: JS15071
2026-03-30 07:51:52 [auto1.de] INFO: Found listing with ID: KS57096
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS57096%27 HTTP/1.1" 200 None
2026-03-30 07:51:52 [auto1.de] INFO: Scrape type for KS57096: 2
2026-03-30 07:51:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a1436b0-8ac4-5021-8de4-50aeaf152996 with identifier: KS57096
2026-03-30 07:51:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a1436b0-8ac4-5021-8de4-50aeaf152996 with scrape type 2
2026-03-30 07:51:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a1436b0-8ac4-5021-8de4-50aeaf152996 with scrape type 2
2026-03-30 07:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8a1436b0-8ac4-5021-8de4-50aeaf152996, identifier: KS57096
2026-03-30 07:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8a1436b0-8ac4-5021-8de4-50aeaf152996 with identifier: KS57096
2026-03-30 07:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8a1436b0-8ac4-5021-8de4-50aeaf152996 with identifier: KS57096
2026-03-30 07:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8a1436b0-8ac4-5021-8de4-50aeaf152996 with identifier: KS57096 to the API
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 152,
 'expiration_date': '2026-03-30T15:33:08Z',
 'fuel_type': 'diesel',
 'id': '8a1436b0-8ac4-5021-8de4-50aeaf152996',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS57096',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 144764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-26',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 CRDi Mild-Hybrid Trend 2WD',
 'transmission': 'manual',
 'trim': 'Trend 2WD',
 'year': 2020}
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS57096%27 HTTP/1.1" 200 None
2026-03-30 07:51:53 [auto1.de] INFO: Saving data for KS57096: {'auction_closing_time': 1774884788.0, 'created_time': 1773775259.764669, 'last_price_update_time': 1774857113.299182}
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS57096') HTTP/1.1" 204 0
2026-03-30 07:51:53 [auto1.de] INFO: Found listing with ID: CZ58938
2026-03-30 07:51:53 [auto1.de] INFO: Found listing with ID: FV65723
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV65723%27 HTTP/1.1" 200 None
2026-03-30 07:51:53 [auto1.de] INFO: Scrape type for FV65723: 2
2026-03-30 07:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6fc2f0d-6498-526d-8353-9ca8812dfb90 with identifier: FV65723
2026-03-30 07:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6fc2f0d-6498-526d-8353-9ca8812dfb90 with scrape type 2
2026-03-30 07:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6fc2f0d-6498-526d-8353-9ca8812dfb90 with scrape type 2
2026-03-30 07:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: e6fc2f0d-6498-526d-8353-9ca8812dfb90, identifier: FV65723
2026-03-30 07:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: e6fc2f0d-6498-526d-8353-9ca8812dfb90 with identifier: FV65723
2026-03-30 07:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: e6fc2f0d-6498-526d-8353-9ca8812dfb90 with identifier: FV65723
2026-03-30 07:51:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: e6fc2f0d-6498-526d-8353-9ca8812dfb90 with identifier: FV65723 to the API
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-30T15:49:22Z',
 'fuel_type': 'petrol',
 'id': 'e6fc2f0d-6498-526d-8353-9ca8812dfb90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FV65723',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 67400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-04',
 'seller_name': None,
 'title': 'BMW X4 M40i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2016}
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FV65723%27 HTTP/1.1" 200 None
2026-03-30 07:51:53 [auto1.de] INFO: Saving data for FV65723: {'auction_closing_time': 1774885762.0, 'created_time': 1774551045.332384, 'last_price_update_time': 1774857113.80896}
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FV65723') HTTP/1.1" 204 0
2026-03-30 07:51:53 [auto1.de] INFO: Channel: 24h | Page: 177 | totalHits: 8418 | hits on page: 40
2026-03-30 07:51:53 [auto1.de] INFO: Found listing with ID: FW41048
2026-03-30 07:51:53 [auto1.de] INFO: Found listing with ID: XT08525
2026-03-30 07:51:53 [auto1.de] INFO: Found listing with ID: GL59385
2026-03-30 07:51:53 [auto1.de] INFO: Found listing with ID: GE53934
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE53934%27 HTTP/1.1" 200 None
2026-03-30 07:51:53 [auto1.de] INFO: Scrape type for GE53934: 2
2026-03-30 07:51:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5a78fc0-7b7f-5f0b-b3ff-acc343baac38 with identifier: GE53934
2026-03-30 07:51:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5a78fc0-7b7f-5f0b-b3ff-acc343baac38 with scrape type 2
2026-03-30 07:51:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5a78fc0-7b7f-5f0b-b3ff-acc343baac38 with scrape type 2
2026-03-30 07:51:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c5a78fc0-7b7f-5f0b-b3ff-acc343baac38, identifier: GE53934
2026-03-30 07:51:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c5a78fc0-7b7f-5f0b-b3ff-acc343baac38 with identifier: GE53934
2026-03-30 07:51:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c5a78fc0-7b7f-5f0b-b3ff-acc343baac38 with identifier: GE53934
2026-03-30 07:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c5a78fc0-7b7f-5f0b-b3ff-acc343baac38 with identifier: GE53934 to the API
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:56:41Z',
 'fuel_type': 'petrol',
 'id': 'c5a78fc0-7b7f-5f0b-b3ff-acc343baac38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GE53934',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 163058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-04',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Edition+',
 'transmission': 'manual',
 'trim': 'Edition+',
 'year': 2010}
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE53934%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Saving data for GE53934: {'auction_closing_time': 1774886201.0, 'created_time': 1774639008.032005, 'last_price_update_time': 1774857114.229186}
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GE53934') HTTP/1.1" 204 0
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: MA47632
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: FL14438
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: MZ82429
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MZ82429%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Scrape type for MZ82429: 0
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: UB05903
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB05903%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Scrape type for UB05903: 2
2026-03-30 07:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e3f5aeb-6a72-552e-ac24-604e008603a3 with identifier: UB05903
2026-03-30 07:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e3f5aeb-6a72-552e-ac24-604e008603a3 with scrape type 2
2026-03-30 07:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e3f5aeb-6a72-552e-ac24-604e008603a3 with scrape type 2
2026-03-30 07:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9e3f5aeb-6a72-552e-ac24-604e008603a3, identifier: UB05903
2026-03-30 07:51:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9e3f5aeb-6a72-552e-ac24-604e008603a3 with identifier: UB05903
2026-03-30 07:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9e3f5aeb-6a72-552e-ac24-604e008603a3 with identifier: UB05903
2026-03-30 07:51:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9e3f5aeb-6a72-552e-ac24-604e008603a3 with identifier: UB05903 to the API
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:58:38Z',
 'fuel_type': 'petrol',
 'id': '9e3f5aeb-6a72-552e-ac24-604e008603a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UB05903',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 78050,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-03',
 'seller_name': None,
 'title': 'BMW 3er 328i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2014}
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB05903%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Saving data for UB05903: {'auction_closing_time': 1774886318.0, 'created_time': 1774638971.671431, 'last_price_update_time': 1774857114.733118}
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UB05903') HTTP/1.1" 204 0
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: HX75388
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: LU16486
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: AB05570
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: AP13896
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: GX10720
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX10720%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Scrape type for GX10720: 0
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: AP92874
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: XP03484
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XP03484%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Scrape type for XP03484: 0
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: KA14077
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KA14077%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Scrape type for KA14077: 0
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: CL18387
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL18387%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Scrape type for CL18387: 0
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: TV60687
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: KE73798
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE73798%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Scrape type for KE73798: 0
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: KJ75418
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: WD47381
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD47381%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Scrape type for WD47381: 0
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: EP39271
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP39271%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Scrape type for EP39271: 0
2026-03-30 07:51:54 [auto1.de] INFO: Found listing with ID: PN41265
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN41265%27 HTTP/1.1" 200 None
2026-03-30 07:51:54 [auto1.de] INFO: Scrape type for PN41265: 2
2026-03-30 07:51:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9637219f-bc46-548a-9370-5dd6dd40d976 with identifier: PN41265
2026-03-30 07:51:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9637219f-bc46-548a-9370-5dd6dd40d976 with scrape type 2
2026-03-30 07:51:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9637219f-bc46-548a-9370-5dd6dd40d976 with scrape type 2
2026-03-30 07:51:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 9637219f-bc46-548a-9370-5dd6dd40d976, identifier: PN41265
2026-03-30 07:51:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 9637219f-bc46-548a-9370-5dd6dd40d976 with identifier: PN41265
2026-03-30 07:51:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 9637219f-bc46-548a-9370-5dd6dd40d976 with identifier: PN41265
2026-03-30 07:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 9637219f-bc46-548a-9370-5dd6dd40d976 with identifier: PN41265 to the API
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:11:37Z',
 'fuel_type': 'petrol',
 'id': '9637219f-bc46-548a-9370-5dd6dd40d976',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN41265',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 96799,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-07',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency',
 'transmission': 'manual',
 'trim': 'BlueEfficiency',
 'year': 2015}
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PN41265%27 HTTP/1.1" 200 None
2026-03-30 07:51:55 [auto1.de] INFO: Saving data for PN41265: {'auction_closing_time': 1774883497.0, 'created_time': 1774640214.114574, 'last_price_update_time': 1774857115.23911}
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PN41265') HTTP/1.1" 204 0
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: PT15230
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT15230%27 HTTP/1.1" 200 None
2026-03-30 07:51:55 [auto1.de] INFO: Scrape type for PT15230: 2
2026-03-30 07:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b55028ee-52c7-5b04-9d94-24b43e31d24b with identifier: PT15230
2026-03-30 07:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b55028ee-52c7-5b04-9d94-24b43e31d24b with scrape type 2
2026-03-30 07:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b55028ee-52c7-5b04-9d94-24b43e31d24b with scrape type 2
2026-03-30 07:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b55028ee-52c7-5b04-9d94-24b43e31d24b, identifier: PT15230
2026-03-30 07:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b55028ee-52c7-5b04-9d94-24b43e31d24b with identifier: PT15230
2026-03-30 07:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b55028ee-52c7-5b04-9d94-24b43e31d24b with identifier: PT15230
2026-03-30 07:51:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b55028ee-52c7-5b04-9d94-24b43e31d24b with identifier: PT15230 to the API
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:57:01Z',
 'fuel_type': 'petrol',
 'id': 'b55028ee-52c7-5b04-9d94-24b43e31d24b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PT15230',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 154836,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-02-25',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI T BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'T BlueEfficiency Avantgarde',
 'year': 2013}
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT15230%27 HTTP/1.1" 200 None
2026-03-30 07:51:55 [auto1.de] INFO: Saving data for PT15230: {'auction_closing_time': 1774886221.0, 'created_time': 1774553081.531024, 'last_price_update_time': 1774857115.72155}
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PT15230') HTTP/1.1" 204 0
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: RH12349
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RH12349%27 HTTP/1.1" 200 None
2026-03-30 07:51:55 [auto1.de] INFO: Scrape type for RH12349: 0
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: SX40224
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX40224%27 HTTP/1.1" 200 None
2026-03-30 07:51:55 [auto1.de] INFO: Scrape type for SX40224: 0
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: CA50565
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: PR23658
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: SK86846
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK86846%27 HTTP/1.1" 200 None
2026-03-30 07:51:55 [auto1.de] INFO: Scrape type for SK86846: 0
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: LX68947
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: XN42361
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: GE73392
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: PF90530
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: XB16241
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB16241%27 HTTP/1.1" 200 None
2026-03-30 07:51:55 [auto1.de] INFO: Scrape type for XB16241: 0
2026-03-30 07:51:55 [auto1.de] INFO: Found listing with ID: JY30583
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY30583%27 HTTP/1.1" 200 None
2026-03-30 07:51:55 [auto1.de] INFO: Scrape type for JY30583: 2
2026-03-30 07:51:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c96b2e4-e566-58d3-9165-ddceb98df928 with identifier: JY30583
2026-03-30 07:51:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c96b2e4-e566-58d3-9165-ddceb98df928 with scrape type 2
2026-03-30 07:51:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c96b2e4-e566-58d3-9165-ddceb98df928 with scrape type 2
2026-03-30 07:51:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4c96b2e4-e566-58d3-9165-ddceb98df928, identifier: JY30583
2026-03-30 07:51:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4c96b2e4-e566-58d3-9165-ddceb98df928 with identifier: JY30583
2026-03-30 07:51:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4c96b2e4-e566-58d3-9165-ddceb98df928 with identifier: JY30583
2026-03-30 07:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4c96b2e4-e566-58d3-9165-ddceb98df928 with identifier: JY30583 to the API
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:04:12Z',
 'fuel_type': 'diesel',
 'id': '4c96b2e4-e566-58d3-9165-ddceb98df928',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY30583',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLE-Klasse',
 'odometer': 49147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-04',
 'seller_name': None,
 'title': 'Mercedes-Benz GLE-Klasse GLE 300 d Mild-Hybrid 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2023}
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY30583%27 HTTP/1.1" 200 None
2026-03-30 07:51:56 [auto1.de] INFO: Saving data for JY30583: {'auction_closing_time': 1774883052.0, 'created_time': 1774639634.478267, 'last_price_update_time': 1774857116.185927}
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JY30583') HTTP/1.1" 204 0
2026-03-30 07:51:56 [auto1.de] INFO: Found listing with ID: ZW26780
2026-03-30 07:51:56 [auto1.de] INFO: Found listing with ID: VN58705
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN58705%27 HTTP/1.1" 200 None
2026-03-30 07:51:56 [auto1.de] INFO: Scrape type for VN58705: 2
2026-03-30 07:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1820bf96-00ea-5ca1-a98e-e0bc09ecf886 with identifier: VN58705
2026-03-30 07:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1820bf96-00ea-5ca1-a98e-e0bc09ecf886 with scrape type 2
2026-03-30 07:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1820bf96-00ea-5ca1-a98e-e0bc09ecf886 with scrape type 2
2026-03-30 07:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1820bf96-00ea-5ca1-a98e-e0bc09ecf886, identifier: VN58705
2026-03-30 07:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1820bf96-00ea-5ca1-a98e-e0bc09ecf886 with identifier: VN58705
2026-03-30 07:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1820bf96-00ea-5ca1-a98e-e0bc09ecf886 with identifier: VN58705
2026-03-30 07:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1820bf96-00ea-5ca1-a98e-e0bc09ecf886 with identifier: VN58705 to the API
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 97,
 'expiration_date': '2026-03-30T15:42:10Z',
 'fuel_type': 'petrol',
 'id': '1820bf96-00ea-5ca1-a98e-e0bc09ecf886',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VN58705',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 212233,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-14',
 'seller_name': None,
 'title': 'Toyota Corolla 1.4 Compact Edition',
 'transmission': 'manual',
 'trim': 'Compact Edition',
 'year': 2006}
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VN58705%27 HTTP/1.1" 200 None
2026-03-30 07:51:56 [auto1.de] INFO: Saving data for VN58705: {'auction_closing_time': 1774885330.0, 'created_time': 1774640194.627478, 'last_price_update_time': 1774857116.699161}
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VN58705') HTTP/1.1" 204 0
2026-03-30 07:51:56 [auto1.de] INFO: Found listing with ID: DC45431
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC45431%27 HTTP/1.1" 200 None
2026-03-30 07:51:56 [auto1.de] INFO: Scrape type for DC45431: 2
2026-03-30 07:51:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55c7e48e-96e1-5b8d-ac5c-0b5e8a3c7f78 with identifier: DC45431
2026-03-30 07:51:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55c7e48e-96e1-5b8d-ac5c-0b5e8a3c7f78 with scrape type 2
2026-03-30 07:51:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55c7e48e-96e1-5b8d-ac5c-0b5e8a3c7f78 with scrape type 2
2026-03-30 07:51:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 55c7e48e-96e1-5b8d-ac5c-0b5e8a3c7f78, identifier: DC45431
2026-03-30 07:51:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 55c7e48e-96e1-5b8d-ac5c-0b5e8a3c7f78 with identifier: DC45431
2026-03-30 07:51:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 55c7e48e-96e1-5b8d-ac5c-0b5e8a3c7f78 with identifier: DC45431
2026-03-30 07:51:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 55c7e48e-96e1-5b8d-ac5c-0b5e8a3c7f78 with identifier: DC45431 to the API
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:57:00Z',
 'fuel_type': 'petrol',
 'id': '55c7e48e-96e1-5b8d-ac5c-0b5e8a3c7f78',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC45431',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 92078,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-24',
 'seller_name': None,
 'title': 'Ford Fiesta 1.3 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2007}
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC45431%27 HTTP/1.1" 200 None
2026-03-30 07:51:57 [auto1.de] INFO: Saving data for DC45431: {'auction_closing_time': 1774886220.0, 'created_time': 1774639556.869766, 'last_price_update_time': 1774857117.10966}
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DC45431') HTTP/1.1" 204 0
2026-03-30 07:51:57 [auto1.de] INFO: Found listing with ID: WL45042
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45042%27 HTTP/1.1" 200 None
2026-03-30 07:51:57 [auto1.de] INFO: Scrape type for WL45042: 2
2026-03-30 07:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd12225a-b3fd-5a2d-ad2b-eff906f6f0cb with identifier: WL45042
2026-03-30 07:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd12225a-b3fd-5a2d-ad2b-eff906f6f0cb with scrape type 2
2026-03-30 07:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd12225a-b3fd-5a2d-ad2b-eff906f6f0cb with scrape type 2
2026-03-30 07:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd12225a-b3fd-5a2d-ad2b-eff906f6f0cb, identifier: WL45042
2026-03-30 07:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd12225a-b3fd-5a2d-ad2b-eff906f6f0cb with identifier: WL45042
2026-03-30 07:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd12225a-b3fd-5a2d-ad2b-eff906f6f0cb with identifier: WL45042
2026-03-30 07:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd12225a-b3fd-5a2d-ad2b-eff906f6f0cb with identifier: WL45042 to the API
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:10:48Z',
 'fuel_type': 'petrol',
 'id': 'cd12225a-b3fd-5a2d-ad2b-eff906f6f0cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL45042',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 163813,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.4 TSI Team',
 'transmission': 'manual',
 'trim': 'Team',
 'year': 2010}
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL45042%27 HTTP/1.1" 200 None
2026-03-30 07:51:57 [auto1.de] INFO: Saving data for WL45042: {'auction_closing_time': 1774883448.0, 'created_time': 1774637044.640511, 'last_price_update_time': 1774857117.502983}
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WL45042') HTTP/1.1" 204 0
2026-03-30 07:51:57 [auto1.de] INFO: Found listing with ID: FS06029
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FS06029%27 HTTP/1.1" 200 None
2026-03-30 07:51:57 [auto1.de] INFO: Scrape type for FS06029: 0
2026-03-30 07:51:57 [auto1.de] INFO: Found listing with ID: CT18435
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT18435%27 HTTP/1.1" 200 None
2026-03-30 07:51:57 [auto1.de] INFO: Scrape type for CT18435: 0
2026-03-30 07:51:57 [auto1.de] INFO: Found listing with ID: TE62268
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE62268%27 HTTP/1.1" 200 None
2026-03-30 07:51:57 [auto1.de] INFO: Scrape type for TE62268: 2
2026-03-30 07:51:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6c5d86e-994a-5ba0-9267-dd80b5080079 with identifier: TE62268
2026-03-30 07:51:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6c5d86e-994a-5ba0-9267-dd80b5080079 with scrape type 2
2026-03-30 07:51:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6c5d86e-994a-5ba0-9267-dd80b5080079 with scrape type 2
2026-03-30 07:51:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6c5d86e-994a-5ba0-9267-dd80b5080079, identifier: TE62268
2026-03-30 07:51:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:51:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6c5d86e-994a-5ba0-9267-dd80b5080079 with identifier: TE62268
2026-03-30 07:51:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6c5d86e-994a-5ba0-9267-dd80b5080079 with identifier: TE62268
2026-03-30 07:51:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6c5d86e-994a-5ba0-9267-dd80b5080079 with identifier: TE62268 to the API
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 238,
 'expiration_date': '2026-03-30T15:20:51Z',
 'fuel_type': 'diesel',
 'id': 'd6c5d86e-994a-5ba0-9267-dd80b5080079',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE62268',
 'listing': 'auction',
 'make': 'Infiniti',
 'model': 'M-Serie',
 'odometer': 229445,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-13',
 'seller_name': None,
 'title': 'Infiniti M-Serie M30d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE62268%27 HTTP/1.1" 200 None
2026-03-30 07:51:57 [auto1.de] INFO: Saving data for TE62268: {'auction_closing_time': 1774884051.0, 'created_time': 1774639554.403078, 'last_price_update_time': 1774857117.942942}
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TE62268') HTTP/1.1" 204 0
2026-03-30 07:51:57 [auto1.de] INFO: Found listing with ID: VX06464
2026-03-30 07:51:57 [auto1.de] INFO: Found listing with ID: DA75557
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA75557%27 HTTP/1.1" 200 None
2026-03-30 07:51:57 [auto1.de] INFO: Scrape type for DA75557: 0
2026-03-30 07:51:57 [auto1.de] INFO: Channel: 24h | Page: 178 | totalHits: 8418 | hits on page: 40
2026-03-30 07:51:57 [auto1.de] INFO: Found listing with ID: PU37095
2026-03-30 07:51:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU37095%27 HTTP/1.1" 200 None
2026-03-30 07:51:58 [auto1.de] INFO: Scrape type for PU37095: 0
2026-03-30 07:51:58 [auto1.de] INFO: Found listing with ID: MC25913
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC25913%27 HTTP/1.1" 200 None
2026-03-30 07:51:58 [auto1.de] INFO: Scrape type for MC25913: 2
2026-03-30 07:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fa62ea0-5b54-506e-a89a-9a6b30978451 with identifier: MC25913
2026-03-30 07:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fa62ea0-5b54-506e-a89a-9a6b30978451 with scrape type 2
2026-03-30 07:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fa62ea0-5b54-506e-a89a-9a6b30978451 with scrape type 2
2026-03-30 07:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 6fa62ea0-5b54-506e-a89a-9a6b30978451, identifier: MC25913
2026-03-30 07:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 6fa62ea0-5b54-506e-a89a-9a6b30978451 with identifier: MC25913
2026-03-30 07:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 6fa62ea0-5b54-506e-a89a-9a6b30978451 with identifier: MC25913
2026-03-30 07:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 6fa62ea0-5b54-506e-a89a-9a6b30978451 with identifier: MC25913 to the API
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:50:37Z',
 'fuel_type': 'diesel',
 'id': '6fa62ea0-5b54-506e-a89a-9a6b30978451',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MC25913',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'V-Klasse',
 'odometer': 149649,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-02',
 'seller_name': None,
 'title': 'Mercedes-Benz V-Klasse V 220 d lang BlueTEC Avantgarde Edition',
 'transmission': 'automatic',
 'trim': 'lang BlueTEC Avantgarde Edition',
 'year': 2019}
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC25913%27 HTTP/1.1" 200 None
2026-03-30 07:51:58 [auto1.de] INFO: Saving data for MC25913: {'auction_closing_time': 1774885837.0, 'created_time': 1774552850.693101, 'last_price_update_time': 1774857118.383723}
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MC25913') HTTP/1.1" 204 0
2026-03-30 07:51:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:51:58 [auto1.de] INFO: Found listing with ID: JA93486
2026-03-30 07:51:58 [auto1.de] INFO: Found listing with ID: DV26733
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV26733%27 HTTP/1.1" 200 None
2026-03-30 07:51:58 [auto1.de] INFO: Scrape type for DV26733: 2
2026-03-30 07:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d686311b-d9e4-5027-b565-f9eda3005a07 with identifier: DV26733
2026-03-30 07:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d686311b-d9e4-5027-b565-f9eda3005a07 with scrape type 2
2026-03-30 07:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d686311b-d9e4-5027-b565-f9eda3005a07 with scrape type 2
2026-03-30 07:51:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d686311b-d9e4-5027-b565-f9eda3005a07, identifier: DV26733
2026-03-30 07:51:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d686311b-d9e4-5027-b565-f9eda3005a07 with identifier: DV26733
2026-03-30 07:51:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d686311b-d9e4-5027-b565-f9eda3005a07 with identifier: DV26733
2026-03-30 07:51:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d686311b-d9e4-5027-b565-f9eda3005a07 with identifier: DV26733 to the API
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:42:37Z',
 'fuel_type': 'petrol',
 'id': 'd686311b-d9e4-5027-b565-f9eda3005a07',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DV26733',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Mokka X',
 'odometer': 149070,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-20',
 'seller_name': None,
 'title': 'Opel Mokka X 1.4 Turbo Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV26733%27 HTTP/1.1" 200 None
2026-03-30 07:51:58 [auto1.de] INFO: Saving data for DV26733: {'auction_closing_time': 1774885357.0, 'created_time': 1774552675.149742, 'last_price_update_time': 1774857118.874316}
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DV26733') HTTP/1.1" 204 0
2026-03-30 07:51:58 [auto1.de] INFO: Found listing with ID: DB69488
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB69488%27 HTTP/1.1" 200 None
2026-03-30 07:51:58 [auto1.de] INFO: Scrape type for DB69488: 2
2026-03-30 07:51:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with identifier: DB69488
2026-03-30 07:51:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with scrape type 2
2026-03-30 07:51:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with scrape type 2
2026-03-30 07:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c, identifier: DB69488
2026-03-30 07:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with identifier: DB69488
2026-03-30 07:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with identifier: DB69488
2026-03-30 07:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d9b6ea1b-ce44-5a65-9b13-9fcddf65c36c with identifier: DB69488 to the API
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 310,
 'expiration_date': '2026-03-30T15:49:27Z',
 'fuel_type': 'petrol',
 'id': 'd9b6ea1b-ce44-5a65-9b13-9fcddf65c36c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB69488',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S3 Sportback',
 'odometer': 25507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-25',
 'seller_name': None,
 'title': 'Audi S3 Sportback 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2023}
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DB69488%27 HTTP/1.1" 200 None
2026-03-30 07:51:59 [auto1.de] INFO: Saving data for DB69488: {'auction_closing_time': 1774885767.0, 'created_time': 1774553084.797057, 'last_price_update_time': 1774857119.273431}
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DB69488') HTTP/1.1" 204 0
2026-03-30 07:51:59 [auto1.de] INFO: Found listing with ID: UC09176
2026-03-30 07:51:59 [auto1.de] INFO: Found listing with ID: WJ52581
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52581%27 HTTP/1.1" 200 None
2026-03-30 07:51:59 [auto1.de] INFO: Scrape type for WJ52581: 2
2026-03-30 07:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53697742-7c6b-572b-8592-e1036551db9b with identifier: WJ52581
2026-03-30 07:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53697742-7c6b-572b-8592-e1036551db9b with scrape type 2
2026-03-30 07:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53697742-7c6b-572b-8592-e1036551db9b with scrape type 2
2026-03-30 07:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53697742-7c6b-572b-8592-e1036551db9b, identifier: WJ52581
2026-03-30 07:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53697742-7c6b-572b-8592-e1036551db9b with identifier: WJ52581
2026-03-30 07:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53697742-7c6b-572b-8592-e1036551db9b with identifier: WJ52581
2026-03-30 07:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53697742-7c6b-572b-8592-e1036551db9b with identifier: WJ52581 to the API
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:51:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:38:26Z',
 'fuel_type': 'diesel',
 'id': '53697742-7c6b-572b-8592-e1036551db9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ52581',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 364676,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-18',
 'seller_name': None,
 'title': 'Ford Grand C-Max 2.0 TDCi Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2012}
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ52581%27 HTTP/1.1" 200 None
2026-03-30 07:51:59 [auto1.de] INFO: Saving data for WJ52581: {'auction_closing_time': 1774885106.0, 'created_time': 1774639712.897417, 'last_price_update_time': 1774857119.687792}
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WJ52581') HTTP/1.1" 204 0
2026-03-30 07:51:59 [auto1.de] INFO: Found listing with ID: GJ53227
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ53227%27 HTTP/1.1" 200 None
2026-03-30 07:51:59 [auto1.de] INFO: Scrape type for GJ53227: 2
2026-03-30 07:51:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acff37a5-ade0-5097-aee9-5e18fe831074 with identifier: GJ53227
2026-03-30 07:51:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acff37a5-ade0-5097-aee9-5e18fe831074 with scrape type 2
2026-03-30 07:51:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acff37a5-ade0-5097-aee9-5e18fe831074 with scrape type 2
2026-03-30 07:51:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: acff37a5-ade0-5097-aee9-5e18fe831074, identifier: GJ53227
2026-03-30 07:51:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: acff37a5-ade0-5097-aee9-5e18fe831074 with identifier: GJ53227
2026-03-30 07:51:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: acff37a5-ade0-5097-aee9-5e18fe831074 with identifier: GJ53227
2026-03-30 07:51:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: acff37a5-ade0-5097-aee9-5e18fe831074 with identifier: GJ53227 to the API
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:51:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 231,
 'expiration_date': '2026-03-30T15:19:22Z',
 'fuel_type': 'diesel',
 'id': 'acff37a5-ade0-5097-aee9-5e18fe831074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ53227',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 150872,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-31',
 'seller_name': None,
 'title': 'Audi A6 45 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2018}
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ53227%27 HTTP/1.1" 200 None
2026-03-30 07:52:00 [auto1.de] INFO: Saving data for GJ53227: {'auction_closing_time': 1774883962.0, 'created_time': 1774553056.173358, 'last_price_update_time': 1774857120.107242}
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GJ53227') HTTP/1.1" 204 0
2026-03-30 07:52:00 [auto1.de] INFO: Found listing with ID: XS07294
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XS07294%27 HTTP/1.1" 200 None
2026-03-30 07:52:00 [auto1.de] INFO: Scrape type for XS07294: 0
2026-03-30 07:52:00 [auto1.de] INFO: Found listing with ID: MH48828
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH48828%27 HTTP/1.1" 200 None
2026-03-30 07:52:00 [auto1.de] INFO: Scrape type for MH48828: 2
2026-03-30 07:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3923e807-192a-5292-bca9-26ef1f323668 with identifier: MH48828
2026-03-30 07:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3923e807-192a-5292-bca9-26ef1f323668 with scrape type 2
2026-03-30 07:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3923e807-192a-5292-bca9-26ef1f323668 with scrape type 2
2026-03-30 07:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3923e807-192a-5292-bca9-26ef1f323668, identifier: MH48828
2026-03-30 07:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3923e807-192a-5292-bca9-26ef1f323668 with identifier: MH48828
2026-03-30 07:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3923e807-192a-5292-bca9-26ef1f323668 with identifier: MH48828
2026-03-30 07:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3923e807-192a-5292-bca9-26ef1f323668 with identifier: MH48828 to the API
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:53:40Z',
 'fuel_type': 'petrol',
 'id': '3923e807-192a-5292-bca9-26ef1f323668',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MH48828',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X4',
 'odometer': 106061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-08',
 'seller_name': None,
 'title': 'BMW X4 xDrive 30i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH48828%27 HTTP/1.1" 200 None
2026-03-30 07:52:00 [auto1.de] INFO: Saving data for MH48828: {'auction_closing_time': 1774886020.0, 'created_time': 1774553139.634284, 'last_price_update_time': 1774857120.516443}
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MH48828') HTTP/1.1" 204 0
2026-03-30 07:52:00 [auto1.de] INFO: Found listing with ID: MU28825
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU28825%27 HTTP/1.1" 200 None
2026-03-30 07:52:00 [auto1.de] INFO: Scrape type for MU28825: 2
2026-03-30 07:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d5148d8-b8ff-5d8f-9a33-1290ba150a5a with identifier: MU28825
2026-03-30 07:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d5148d8-b8ff-5d8f-9a33-1290ba150a5a with scrape type 2
2026-03-30 07:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d5148d8-b8ff-5d8f-9a33-1290ba150a5a with scrape type 2
2026-03-30 07:52:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4d5148d8-b8ff-5d8f-9a33-1290ba150a5a, identifier: MU28825
2026-03-30 07:52:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4d5148d8-b8ff-5d8f-9a33-1290ba150a5a with identifier: MU28825
2026-03-30 07:52:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4d5148d8-b8ff-5d8f-9a33-1290ba150a5a with identifier: MU28825
2026-03-30 07:52:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4d5148d8-b8ff-5d8f-9a33-1290ba150a5a with identifier: MU28825 to the API
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-30T15:38:28Z',
 'fuel_type': 'petrol',
 'id': '4d5148d8-b8ff-5d8f-9a33-1290ba150a5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU28825',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 62551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-26',
 'seller_name': None,
 'title': 'Renault Megane 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2017}
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU28825%27 HTTP/1.1" 200 None
2026-03-30 07:52:00 [auto1.de] INFO: Saving data for MU28825: {'auction_closing_time': 1774885108.0, 'created_time': 1774639483.951389, 'last_price_update_time': 1774857120.957828}
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MU28825') HTTP/1.1" 204 0
2026-03-30 07:52:00 [auto1.de] INFO: Found listing with ID: HR12459
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR12459%27 HTTP/1.1" 200 None
2026-03-30 07:52:00 [auto1.de] INFO: Scrape type for HR12459: 2
2026-03-30 07:52:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459
2026-03-30 07:52:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b79dba0d-9a6f-594c-853e-b12b81f7cf86 with scrape type 2
2026-03-30 07:52:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b79dba0d-9a6f-594c-853e-b12b81f7cf86 with scrape type 2
2026-03-30 07:52:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b79dba0d-9a6f-594c-853e-b12b81f7cf86, identifier: HR12459
2026-03-30 07:52:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459
2026-03-30 07:52:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459
2026-03-30 07:52:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b79dba0d-9a6f-594c-853e-b12b81f7cf86 with identifier: HR12459 to the API
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:37:06Z',
 'fuel_type': 'diesel',
 'id': 'b79dba0d-9a6f-594c-853e-b12b81f7cf86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR12459',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 309344,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-27',
 'seller_name': None,
 'title': 'Audi A6 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2013}
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR12459%27 HTTP/1.1" 200 None
2026-03-30 07:52:01 [auto1.de] INFO: Saving data for HR12459: {'auction_closing_time': 1774885026.0, 'created_time': 1773946005.349615, 'last_price_update_time': 1774857121.892855}
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR12459') HTTP/1.1" 204 0
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: DE09566
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: VY02082
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: HD78649
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: PH00058
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH00058%27 HTTP/1.1" 200 None
2026-03-30 07:52:01 [auto1.de] INFO: Scrape type for PH00058: 0
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: KU48054
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU48054%27 HTTP/1.1" 200 None
2026-03-30 07:52:01 [auto1.de] INFO: Scrape type for KU48054: 0
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: KA69017
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: UG82717
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: SF51688
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF51688%27 HTTP/1.1" 200 None
2026-03-30 07:52:01 [auto1.de] INFO: Scrape type for SF51688: 0
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: KR60146
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: JH22526
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: WC14239
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC14239%27 HTTP/1.1" 200 None
2026-03-30 07:52:01 [auto1.de] INFO: Scrape type for WC14239: 0
2026-03-30 07:52:01 [auto1.de] INFO: Found listing with ID: VW78119
2026-03-30 07:52:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW78119%27 HTTP/1.1" 200 None
2026-03-30 07:52:02 [auto1.de] INFO: Scrape type for VW78119: 2
2026-03-30 07:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea056208-3de1-57fd-85f3-fd1bc0f851db with identifier: VW78119
2026-03-30 07:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea056208-3de1-57fd-85f3-fd1bc0f851db with scrape type 2
2026-03-30 07:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea056208-3de1-57fd-85f3-fd1bc0f851db with scrape type 2
2026-03-30 07:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: ea056208-3de1-57fd-85f3-fd1bc0f851db, identifier: VW78119
2026-03-30 07:52:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: ea056208-3de1-57fd-85f3-fd1bc0f851db with identifier: VW78119
2026-03-30 07:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: ea056208-3de1-57fd-85f3-fd1bc0f851db with identifier: VW78119
2026-03-30 07:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: ea056208-3de1-57fd-85f3-fd1bc0f851db with identifier: VW78119 to the API
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:16:08Z',
 'fuel_type': 'petrol',
 'id': 'ea056208-3de1-57fd-85f3-fd1bc0f851db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW78119',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 164126,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-25',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.4 TSI ACT Sound BlueMotion',
 'transmission': 'automatic',
 'trim': 'Sound BlueMotion',
 'year': 2017}
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW78119%27 HTTP/1.1" 200 None
2026-03-30 07:52:02 [auto1.de] INFO: Saving data for VW78119: {'auction_closing_time': 1774883768.0, 'created_time': 1774638546.600043, 'last_price_update_time': 1774857122.394049}
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VW78119') HTTP/1.1" 204 0
2026-03-30 07:52:02 [auto1.de] INFO: Found listing with ID: DG34410
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG34410%27 HTTP/1.1" 200 None
2026-03-30 07:52:02 [auto1.de] INFO: Scrape type for DG34410: 0
2026-03-30 07:52:02 [auto1.de] INFO: Found listing with ID: UP16968
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP16968%27 HTTP/1.1" 200 None
2026-03-30 07:52:02 [auto1.de] INFO: Scrape type for UP16968: 0
2026-03-30 07:52:02 [auto1.de] INFO: Found listing with ID: AT56964
2026-03-30 07:52:02 [auto1.de] INFO: Found listing with ID: XH60803
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH60803%27 HTTP/1.1" 200 None
2026-03-30 07:52:02 [auto1.de] INFO: Scrape type for XH60803: 0
2026-03-30 07:52:02 [auto1.de] INFO: Found listing with ID: UG36008
2026-03-30 07:52:02 [auto1.de] INFO: Found listing with ID: TM50766
2026-03-30 07:52:02 [auto1.de] INFO: Found listing with ID: YH55403
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YH55403%27 HTTP/1.1" 200 None
2026-03-30 07:52:02 [auto1.de] INFO: Scrape type for YH55403: 0
2026-03-30 07:52:02 [auto1.de] INFO: Found listing with ID: CN67479
2026-03-30 07:52:02 [auto1.de] INFO: Found listing with ID: TG50792
2026-03-30 07:52:02 [auto1.de] INFO: Found listing with ID: ED54075
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED54075%27 HTTP/1.1" 200 None
2026-03-30 07:52:02 [auto1.de] INFO: Scrape type for ED54075: 2
2026-03-30 07:52:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 114dc39d-095c-5474-937f-75f7fa36d414 with identifier: ED54075
2026-03-30 07:52:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 114dc39d-095c-5474-937f-75f7fa36d414 with scrape type 2
2026-03-30 07:52:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 114dc39d-095c-5474-937f-75f7fa36d414 with scrape type 2
2026-03-30 07:52:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 114dc39d-095c-5474-937f-75f7fa36d414, identifier: ED54075
2026-03-30 07:52:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 114dc39d-095c-5474-937f-75f7fa36d414 with identifier: ED54075
2026-03-30 07:52:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 114dc39d-095c-5474-937f-75f7fa36d414 with identifier: ED54075
2026-03-30 07:52:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 114dc39d-095c-5474-937f-75f7fa36d414 with identifier: ED54075 to the API
2026-03-30 07:52:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-30T15:06:52Z',
 'fuel_type': 'petrol',
 'id': '114dc39d-095c-5474-937f-75f7fa36d414',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED54075',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 84052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-29',
 'seller_name': None,
 'title': 'Ford Focus 1.5 EcoBoost ST-Line',
 'transmission': 'automatic',
 'trim': 'ST-Line',
 'year': 2017}
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED54075%27 HTTP/1.1" 200 None
2026-03-30 07:52:03 [auto1.de] INFO: Saving data for ED54075: {'auction_closing_time': 1774883212.0, 'created_time': 1774639130.367966, 'last_price_update_time': 1774857123.370562}
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ED54075') HTTP/1.1" 204 0
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: KV45181
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: LG62730
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: XB63697
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB63697%27 HTTP/1.1" 200 None
2026-03-30 07:52:03 [auto1.de] INFO: Scrape type for XB63697: 0
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: XS50717
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: TK47054
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: PE74408
2026-03-30 07:52:03 [auto1.de] INFO: Channel: 24h | Page: 179 | totalHits: 8418 | hits on page: 40
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: AA34634
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AA34634%27 HTTP/1.1" 200 None
2026-03-30 07:52:03 [auto1.de] INFO: Scrape type for AA34634: 0
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: LM30127
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: TR13972
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR13972%27 HTTP/1.1" 200 None
2026-03-30 07:52:03 [auto1.de] INFO: Scrape type for TR13972: 0
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: VX15000
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: GK82878
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK82878%27 HTTP/1.1" 200 None
2026-03-30 07:52:03 [auto1.de] INFO: Scrape type for GK82878: 0
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: AH76263
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH76263%27 HTTP/1.1" 200 None
2026-03-30 07:52:03 [auto1.de] INFO: Scrape type for AH76263: 0
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: RW09760
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: TB72166
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB72166%27 HTTP/1.1" 200 None
2026-03-30 07:52:03 [auto1.de] INFO: Scrape type for TB72166: 2
2026-03-30 07:52:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0487d739-9ddd-5138-9505-32816f7c7491 with identifier: TB72166
2026-03-30 07:52:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0487d739-9ddd-5138-9505-32816f7c7491 with scrape type 2
2026-03-30 07:52:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0487d739-9ddd-5138-9505-32816f7c7491 with scrape type 2
2026-03-30 07:52:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0487d739-9ddd-5138-9505-32816f7c7491, identifier: TB72166
2026-03-30 07:52:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0487d739-9ddd-5138-9505-32816f7c7491 with identifier: TB72166
2026-03-30 07:52:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0487d739-9ddd-5138-9505-32816f7c7491 with identifier: TB72166
2026-03-30 07:52:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0487d739-9ddd-5138-9505-32816f7c7491 with identifier: TB72166 to the API
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:16:07Z',
 'fuel_type': 'diesel',
 'id': '0487d739-9ddd-5138-9505-32816f7c7491',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TB72166',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 305614,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-22',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.6 TDI Team BlueMotion',
 'transmission': 'manual',
 'trim': 'Team BlueMotion',
 'year': 2010}
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB72166%27 HTTP/1.1" 200 None
2026-03-30 07:52:03 [auto1.de] INFO: Saving data for TB72166: {'auction_closing_time': 1774883767.0, 'created_time': 1774640126.488084, 'last_price_update_time': 1774857123.871211}
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TB72166') HTTP/1.1" 204 0
2026-03-30 07:52:03 [auto1.de] INFO: Found listing with ID: XF69711
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF69711%27 HTTP/1.1" 200 None
2026-03-30 07:52:04 [auto1.de] INFO: Scrape type for XF69711: 2
2026-03-30 07:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with identifier: XF69711
2026-03-30 07:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with scrape type 2
2026-03-30 07:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with scrape type 2
2026-03-30 07:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5859ba65-7950-5548-88d1-6d9d4cf35eb6, identifier: XF69711
2026-03-30 07:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with identifier: XF69711
2026-03-30 07:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with identifier: XF69711
2026-03-30 07:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5859ba65-7950-5548-88d1-6d9d4cf35eb6 with identifier: XF69711 to the API
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-30T15:59:57Z',
 'fuel_type': 'petrol',
 'id': '5859ba65-7950-5548-88d1-6d9d4cf35eb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF69711',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 169038,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-07-25',
 'seller_name': None,
 'title': 'BMW 1er 118i',
 'transmission': 'manual',
 'trim': '',
 'year': 2012}
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF69711%27 HTTP/1.1" 200 None
2026-03-30 07:52:04 [auto1.de] INFO: Saving data for XF69711: {'auction_closing_time': 1774886397.0, 'created_time': 1773945945.433902, 'last_price_update_time': 1774857124.416108}
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF69711') HTTP/1.1" 204 0
2026-03-30 07:52:04 [auto1.de] INFO: Found listing with ID: RE17291
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE17291%27 HTTP/1.1" 200 None
2026-03-30 07:52:04 [auto1.de] INFO: Scrape type for RE17291: 0
2026-03-30 07:52:04 [auto1.de] INFO: Found listing with ID: FW17566
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW17566%27 HTTP/1.1" 200 None
2026-03-30 07:52:04 [auto1.de] INFO: Scrape type for FW17566: 2
2026-03-30 07:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b928a7ae-5718-549b-ac32-1ace672d25a3 with identifier: FW17566
2026-03-30 07:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b928a7ae-5718-549b-ac32-1ace672d25a3 with scrape type 2
2026-03-30 07:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b928a7ae-5718-549b-ac32-1ace672d25a3 with scrape type 2
2026-03-30 07:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b928a7ae-5718-549b-ac32-1ace672d25a3, identifier: FW17566
2026-03-30 07:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b928a7ae-5718-549b-ac32-1ace672d25a3 with identifier: FW17566
2026-03-30 07:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b928a7ae-5718-549b-ac32-1ace672d25a3 with identifier: FW17566
2026-03-30 07:52:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b928a7ae-5718-549b-ac32-1ace672d25a3 with identifier: FW17566 to the API
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 239,
 'expiration_date': '2026-03-30T15:38:28Z',
 'fuel_type': 'diesel',
 'id': 'b928a7ae-5718-549b-ac32-1ace672d25a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW17566',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 57864,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-15',
 'seller_name': None,
 'title': 'Skoda Kodiaq 2.0 BiTDI RS 4x4',
 'transmission': 'automatic',
 'trim': 'RS 4x4',
 'year': 2020}
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW17566%27 HTTP/1.1" 200 None
2026-03-30 07:52:04 [auto1.de] INFO: Saving data for FW17566: {'auction_closing_time': 1774885108.0, 'created_time': 1774638251.591626, 'last_price_update_time': 1774857124.848412}
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FW17566') HTTP/1.1" 204 0
2026-03-30 07:52:04 [auto1.de] INFO: Found listing with ID: KZ08446
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KZ08446%27 HTTP/1.1" 200 None
2026-03-30 07:52:04 [auto1.de] INFO: Scrape type for KZ08446: 0
2026-03-30 07:52:04 [auto1.de] INFO: Found listing with ID: JE63209
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE63209%27 HTTP/1.1" 200 None
2026-03-30 07:52:04 [auto1.de] INFO: Scrape type for JE63209: 2
2026-03-30 07:52:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd36b3e8-0d41-5176-b245-040b13e484af with identifier: JE63209
2026-03-30 07:52:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd36b3e8-0d41-5176-b245-040b13e484af with scrape type 2
2026-03-30 07:52:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd36b3e8-0d41-5176-b245-040b13e484af with scrape type 2
2026-03-30 07:52:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cd36b3e8-0d41-5176-b245-040b13e484af, identifier: JE63209
2026-03-30 07:52:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cd36b3e8-0d41-5176-b245-040b13e484af with identifier: JE63209
2026-03-30 07:52:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cd36b3e8-0d41-5176-b245-040b13e484af with identifier: JE63209
2026-03-30 07:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cd36b3e8-0d41-5176-b245-040b13e484af with identifier: JE63209 to the API
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:40:15Z',
 'fuel_type': 'petrol',
 'id': 'cd36b3e8-0d41-5176-b245-040b13e484af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JE63209',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '3',
 'odometer': 98301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-11',
 'seller_name': None,
 'title': 'Mazda 3 2.0 Center-Line',
 'transmission': 'manual',
 'trim': 'Center-Line',
 'year': 2016}
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE63209%27 HTTP/1.1" 200 None
2026-03-30 07:52:05 [auto1.de] INFO: Saving data for JE63209: {'auction_closing_time': 1774885215.0, 'created_time': 1774553171.387025, 'last_price_update_time': 1774857125.250815}
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JE63209') HTTP/1.1" 204 0
2026-03-30 07:52:05 [auto1.de] INFO: Found listing with ID: BU80975
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU80975%27 HTTP/1.1" 200 None
2026-03-30 07:52:05 [auto1.de] INFO: Scrape type for BU80975: 0
2026-03-30 07:52:05 [auto1.de] INFO: Found listing with ID: BB37977
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BB37977%27 HTTP/1.1" 200 None
2026-03-30 07:52:05 [auto1.de] INFO: Scrape type for BB37977: 0
2026-03-30 07:52:05 [auto1.de] INFO: Found listing with ID: BF92726
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF92726%27 HTTP/1.1" 200 None
2026-03-30 07:52:05 [auto1.de] INFO: Scrape type for BF92726: 0
2026-03-30 07:52:05 [auto1.de] INFO: Found listing with ID: WK73067
2026-03-30 07:52:05 [auto1.de] INFO: Found listing with ID: DP00162
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP00162%27 HTTP/1.1" 200 None
2026-03-30 07:52:05 [auto1.de] INFO: Scrape type for DP00162: 0
2026-03-30 07:52:05 [auto1.de] INFO: Found listing with ID: CC75051
2026-03-30 07:52:05 [auto1.de] INFO: Found listing with ID: LG14715
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG14715%27 HTTP/1.1" 200 None
2026-03-30 07:52:05 [auto1.de] INFO: Scrape type for LG14715: 2
2026-03-30 07:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b00aecf-e023-5e6e-9da8-230c0f5c0027 with identifier: LG14715
2026-03-30 07:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b00aecf-e023-5e6e-9da8-230c0f5c0027 with scrape type 2
2026-03-30 07:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b00aecf-e023-5e6e-9da8-230c0f5c0027 with scrape type 2
2026-03-30 07:52:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1b00aecf-e023-5e6e-9da8-230c0f5c0027, identifier: LG14715
2026-03-30 07:52:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1b00aecf-e023-5e6e-9da8-230c0f5c0027 with identifier: LG14715
2026-03-30 07:52:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1b00aecf-e023-5e6e-9da8-230c0f5c0027 with identifier: LG14715
2026-03-30 07:52:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1b00aecf-e023-5e6e-9da8-230c0f5c0027 with identifier: LG14715 to the API
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 255,
 'expiration_date': '2026-03-30T15:18:59Z',
 'fuel_type': 'petrol',
 'id': '1b00aecf-e023-5e6e-9da8-230c0f5c0027',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG14715',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 127914,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-13',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T5 Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2017}
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG14715%27 HTTP/1.1" 200 None
2026-03-30 07:52:05 [auto1.de] INFO: Saving data for LG14715: {'auction_closing_time': 1774883939.0, 'created_time': 1774550170.97716, 'last_price_update_time': 1774857125.71078}
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LG14715') HTTP/1.1" 204 0
2026-03-30 07:52:05 [auto1.de] INFO: Found listing with ID: MK34658
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK34658%27 HTTP/1.1" 200 None
2026-03-30 07:52:05 [auto1.de] INFO: Scrape type for MK34658: 2
2026-03-30 07:52:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97293db3-935d-5c3e-a3d5-9b8b26779866 with identifier: MK34658
2026-03-30 07:52:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97293db3-935d-5c3e-a3d5-9b8b26779866 with scrape type 2
2026-03-30 07:52:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97293db3-935d-5c3e-a3d5-9b8b26779866 with scrape type 2
2026-03-30 07:52:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 97293db3-935d-5c3e-a3d5-9b8b26779866, identifier: MK34658
2026-03-30 07:52:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 97293db3-935d-5c3e-a3d5-9b8b26779866 with identifier: MK34658
2026-03-30 07:52:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 97293db3-935d-5c3e-a3d5-9b8b26779866 with identifier: MK34658
2026-03-30 07:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 97293db3-935d-5c3e-a3d5-9b8b26779866 with identifier: MK34658 to the API
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:46:32Z',
 'fuel_type': 'petrol',
 'id': '97293db3-935d-5c3e-a3d5-9b8b26779866',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK34658',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 40818,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-24',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Cool&Connect',
 'transmission': 'automatic',
 'trim': 'Cool&Connect',
 'year': 2019}
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK34658%27 HTTP/1.1" 200 None
2026-03-30 07:52:06 [auto1.de] INFO: Saving data for MK34658: {'auction_closing_time': 1774885592.0, 'created_time': 1774639502.421704, 'last_price_update_time': 1774857126.201689}
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MK34658') HTTP/1.1" 204 0
2026-03-30 07:52:06 [auto1.de] INFO: Found listing with ID: YV93929
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV93929%27 HTTP/1.1" 200 None
2026-03-30 07:52:06 [auto1.de] INFO: Scrape type for YV93929: 0
2026-03-30 07:52:06 [auto1.de] INFO: Found listing with ID: XR27730
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR27730%27 HTTP/1.1" 200 None
2026-03-30 07:52:06 [auto1.de] INFO: Scrape type for XR27730: 2
2026-03-30 07:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61985093-c388-5ccb-9bc2-321b855e1b7f with identifier: XR27730
2026-03-30 07:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61985093-c388-5ccb-9bc2-321b855e1b7f with scrape type 2
2026-03-30 07:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61985093-c388-5ccb-9bc2-321b855e1b7f with scrape type 2
2026-03-30 07:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 61985093-c388-5ccb-9bc2-321b855e1b7f, identifier: XR27730
2026-03-30 07:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 61985093-c388-5ccb-9bc2-321b855e1b7f with identifier: XR27730
2026-03-30 07:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 61985093-c388-5ccb-9bc2-321b855e1b7f with identifier: XR27730
2026-03-30 07:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 61985093-c388-5ccb-9bc2-321b855e1b7f with identifier: XR27730 to the API
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-30T15:28:25Z',
 'fuel_type': 'petrol',
 'id': '61985093-c388-5ccb-9bc2-321b855e1b7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR27730',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4 Allroad',
 'odometer': 57087,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-30',
 'seller_name': None,
 'title': 'Audi A4 Allroad 45 TFSI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR27730%27 HTTP/1.1" 200 None
2026-03-30 07:52:06 [auto1.de] INFO: Saving data for XR27730: {'auction_closing_time': 1774884505.0, 'created_time': 1774639213.449398, 'last_price_update_time': 1774857126.622998}
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XR27730') HTTP/1.1" 204 0
2026-03-30 07:52:06 [auto1.de] INFO: Found listing with ID: TR29242
2026-03-30 07:52:06 [auto1.de] INFO: Found listing with ID: YZ02891
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ02891%27 HTTP/1.1" 200 None
2026-03-30 07:52:06 [auto1.de] INFO: Scrape type for YZ02891: 2
2026-03-30 07:52:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with identifier: YZ02891
2026-03-30 07:52:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with scrape type 2
2026-03-30 07:52:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with scrape type 2
2026-03-30 07:52:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd, identifier: YZ02891
2026-03-30 07:52:06 [scrapy.extensions.logstats] INFO: Crawled 375 pages (at 6 pages/min), scraped 1373 items (at 68 items/min)
2026-03-30 07:52:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:52:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with identifier: YZ02891
2026-03-30 07:52:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with identifier: YZ02891
2026-03-30 07:52:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd with identifier: YZ02891 to the API
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 360,
 'expiration_date': '2026-03-30T15:48:16Z',
 'fuel_type': 'petrol',
 'id': '770b3305-6e28-5cd2-b8fe-eef9b9ad3fbd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ02891',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 235118,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-28',
 'seller_name': None,
 'title': 'Porsche Macan GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2017}
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ02891%27 HTTP/1.1" 200 None
2026-03-30 07:52:07 [auto1.de] INFO: Saving data for YZ02891: {'auction_closing_time': 1774885696.0, 'created_time': 1774553148.407623, 'last_price_update_time': 1774857127.035137}
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YZ02891') HTTP/1.1" 204 0
2026-03-30 07:52:07 [auto1.de] INFO: Found listing with ID: EH74831
2026-03-30 07:52:07 [auto1.de] INFO: Found listing with ID: BN99160
2026-03-30 07:52:07 [auto1.de] INFO: Found listing with ID: ZK28238
2026-03-30 07:52:07 [auto1.de] INFO: Found listing with ID: XE05980
2026-03-30 07:52:07 [auto1.de] INFO: Found listing with ID: KY14800
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY14800%27 HTTP/1.1" 200 None
2026-03-30 07:52:07 [auto1.de] INFO: Scrape type for KY14800: 0
2026-03-30 07:52:07 [auto1.de] INFO: Found listing with ID: LV90463
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV90463%27 HTTP/1.1" 200 None
2026-03-30 07:52:07 [auto1.de] INFO: Scrape type for LV90463: 2
2026-03-30 07:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53ac20dc-29f0-57d8-b564-734743c3fcdf with identifier: LV90463
2026-03-30 07:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53ac20dc-29f0-57d8-b564-734743c3fcdf with scrape type 2
2026-03-30 07:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53ac20dc-29f0-57d8-b564-734743c3fcdf with scrape type 2
2026-03-30 07:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53ac20dc-29f0-57d8-b564-734743c3fcdf, identifier: LV90463
2026-03-30 07:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53ac20dc-29f0-57d8-b564-734743c3fcdf with identifier: LV90463
2026-03-30 07:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53ac20dc-29f0-57d8-b564-734743c3fcdf with identifier: LV90463
2026-03-30 07:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53ac20dc-29f0-57d8-b564-734743c3fcdf with identifier: LV90463 to the API
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:44:11Z',
 'fuel_type': 'petrol',
 'id': '53ac20dc-29f0-57d8-b564-734743c3fcdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LV90463',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Rio',
 'odometer': 138525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-11-27',
 'seller_name': None,
 'title': 'Kia Rio 1.4 Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2014}
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV90463%27 HTTP/1.1" 200 None
2026-03-30 07:52:07 [auto1.de] INFO: Saving data for LV90463: {'auction_closing_time': 1774885451.0, 'created_time': 1774638657.212488, 'last_price_update_time': 1774857127.45091}
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LV90463') HTTP/1.1" 204 0
2026-03-30 07:52:07 [auto1.de] INFO: Found listing with ID: XL60244
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL60244%27 HTTP/1.1" 200 None
2026-03-30 07:52:07 [auto1.de] INFO: Scrape type for XL60244: 2
2026-03-30 07:52:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 658ebfd8-23ae-51e9-a1f5-0e9e6f11efaa with identifier: XL60244
2026-03-30 07:52:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 658ebfd8-23ae-51e9-a1f5-0e9e6f11efaa with scrape type 2
2026-03-30 07:52:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 658ebfd8-23ae-51e9-a1f5-0e9e6f11efaa with scrape type 2
2026-03-30 07:52:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 658ebfd8-23ae-51e9-a1f5-0e9e6f11efaa, identifier: XL60244
2026-03-30 07:52:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 658ebfd8-23ae-51e9-a1f5-0e9e6f11efaa with identifier: XL60244
2026-03-30 07:52:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 658ebfd8-23ae-51e9-a1f5-0e9e6f11efaa with identifier: XL60244
2026-03-30 07:52:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 658ebfd8-23ae-51e9-a1f5-0e9e6f11efaa with identifier: XL60244 to the API
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:47:05Z',
 'fuel_type': 'petrol',
 'id': '658ebfd8-23ae-51e9-a1f5-0e9e6f11efaa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL60244',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 125198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-05-07',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2009}
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL60244%27 HTTP/1.1" 200 None
2026-03-30 07:52:07 [auto1.de] INFO: Saving data for XL60244: {'auction_closing_time': 1774885625.0, 'created_time': 1774550643.077739, 'last_price_update_time': 1774857127.967511}
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XL60244') HTTP/1.1" 204 0
2026-03-30 07:52:07 [auto1.de] INFO: Found listing with ID: ND58698
2026-03-30 07:52:07 [auto1.de] INFO: Found listing with ID: NB05774
2026-03-30 07:52:07 [auto1.de] INFO: Found listing with ID: NM28513
2026-03-30 07:52:07 [auto1.de] INFO: Found listing with ID: TE33138
2026-03-30 07:52:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE33138%27 HTTP/1.1" 200 None
2026-03-30 07:52:08 [auto1.de] INFO: Scrape type for TE33138: 0
2026-03-30 07:52:08 [auto1.de] INFO: Found listing with ID: XB85812
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85812%27 HTTP/1.1" 200 None
2026-03-30 07:52:08 [auto1.de] INFO: Scrape type for XB85812: 2
2026-03-30 07:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de38cc7f-cfd0-5856-a3b7-1451a592c03b with identifier: XB85812
2026-03-30 07:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de38cc7f-cfd0-5856-a3b7-1451a592c03b with scrape type 2
2026-03-30 07:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item de38cc7f-cfd0-5856-a3b7-1451a592c03b with scrape type 2
2026-03-30 07:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: de38cc7f-cfd0-5856-a3b7-1451a592c03b, identifier: XB85812
2026-03-30 07:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: de38cc7f-cfd0-5856-a3b7-1451a592c03b with identifier: XB85812
2026-03-30 07:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: de38cc7f-cfd0-5856-a3b7-1451a592c03b with identifier: XB85812
2026-03-30 07:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: de38cc7f-cfd0-5856-a3b7-1451a592c03b with identifier: XB85812 to the API
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:35:18Z',
 'fuel_type': 'diesel',
 'id': 'de38cc7f-cfd0-5856-a3b7-1451a592c03b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB85812',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 214091,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-05',
 'seller_name': None,
 'title': 'Audi A3 Sportback 2.0 TDI Sport',
 'transmission': 'manual',
 'trim': 'Sport',
 'year': 2017}
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XB85812%27 HTTP/1.1" 200 None
2026-03-30 07:52:08 [auto1.de] INFO: Saving data for XB85812: {'auction_closing_time': 1774884918.0, 'created_time': 1773226614.359727, 'last_price_update_time': 1774857128.431516}
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XB85812') HTTP/1.1" 204 0
2026-03-30 07:52:08 [auto1.de] INFO: Found listing with ID: FZ45055
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ45055%27 HTTP/1.1" 200 None
2026-03-30 07:52:08 [auto1.de] INFO: Scrape type for FZ45055: 0
2026-03-30 07:52:08 [auto1.de] INFO: Found listing with ID: SX16558
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX16558%27 HTTP/1.1" 200 None
2026-03-30 07:52:08 [auto1.de] INFO: Scrape type for SX16558: 2
2026-03-30 07:52:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with identifier: SX16558
2026-03-30 07:52:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with scrape type 2
2026-03-30 07:52:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with scrape type 2
2026-03-30 07:52:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a, identifier: SX16558
2026-03-30 07:52:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with identifier: SX16558
2026-03-30 07:52:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with identifier: SX16558
2026-03-30 07:52:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a with identifier: SX16558 to the API
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:33:45Z',
 'fuel_type': 'petrol',
 'id': '4f2bc679-9cb7-5277-83d3-3eaf0c7eb34a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX16558',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 79697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-23',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Allstar BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Allstar BlueMotion Tech',
 'year': 2017}
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX16558%27 HTTP/1.1" 200 None
2026-03-30 07:52:08 [auto1.de] INFO: Saving data for SX16558: {'auction_closing_time': 1774884825.0, 'created_time': 1774550994.509455, 'last_price_update_time': 1774857128.849011}
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SX16558') HTTP/1.1" 204 0
2026-03-30 07:52:08 [auto1.de] INFO: Found listing with ID: YM60509
2026-03-30 07:52:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:08 [auto1.de] INFO: Channel: 24h | Page: 180 | totalHits: 8418 | hits on page: 40
2026-03-30 07:52:08 [auto1.de] INFO: Found listing with ID: XK59182
2026-03-30 07:52:08 [auto1.de] INFO: Found listing with ID: EA13561
2026-03-30 07:52:08 [auto1.de] INFO: Found listing with ID: JL71783
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JL71783%27 HTTP/1.1" 200 None
2026-03-30 07:52:08 [auto1.de] INFO: Scrape type for JL71783: 0
2026-03-30 07:52:08 [auto1.de] INFO: Found listing with ID: HA69467
2026-03-30 07:52:08 [auto1.de] INFO: Found listing with ID: UL30875
2026-03-30 07:52:08 [auto1.de] INFO: Found listing with ID: AZ50044
2026-03-30 07:52:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ50044%27 HTTP/1.1" 200 None
2026-03-30 07:52:09 [auto1.de] INFO: Scrape type for AZ50044: 0
2026-03-30 07:52:09 [auto1.de] INFO: Found listing with ID: GT00768
2026-03-30 07:52:09 [auto1.de] INFO: Found listing with ID: WZ21973
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WZ21973%27 HTTP/1.1" 200 None
2026-03-30 07:52:09 [auto1.de] INFO: Scrape type for WZ21973: 0
2026-03-30 07:52:09 [auto1.de] INFO: Found listing with ID: DX61886
2026-03-30 07:52:09 [auto1.de] INFO: Found listing with ID: CF91602
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF91602%27 HTTP/1.1" 200 None
2026-03-30 07:52:09 [auto1.de] INFO: Scrape type for CF91602: 2
2026-03-30 07:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with identifier: CF91602
2026-03-30 07:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with scrape type 2
2026-03-30 07:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with scrape type 2
2026-03-30 07:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 640ed6bf-5115-501a-a2e8-a88aae1a5d69, identifier: CF91602
2026-03-30 07:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with identifier: CF91602
2026-03-30 07:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with identifier: CF91602
2026-03-30 07:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 640ed6bf-5115-501a-a2e8-a88aae1a5d69 with identifier: CF91602 to the API
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:38:43Z',
 'fuel_type': 'diesel',
 'id': '640ed6bf-5115-501a-a2e8-a88aae1a5d69',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF91602',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Expert',
 'odometer': 165651,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-12',
 'seller_name': None,
 'title': 'Peugeot Expert 1.5 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2021}
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CF91602%27 HTTP/1.1" 200 None
2026-03-30 07:52:09 [auto1.de] INFO: Saving data for CF91602: {'auction_closing_time': 1774885123.0, 'created_time': 1774552917.269156, 'last_price_update_time': 1774857129.431542}
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CF91602') HTTP/1.1" 204 0
2026-03-30 07:52:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:09 [auto1.de] INFO: Found listing with ID: SG91001
2026-03-30 07:52:09 [auto1.de] INFO: Found listing with ID: MR38870
2026-03-30 07:52:09 [auto1.de] INFO: Found listing with ID: ZN01973
2026-03-30 07:52:09 [auto1.de] INFO: Found listing with ID: CS24568
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS24568%27 HTTP/1.1" 200 None
2026-03-30 07:52:09 [auto1.de] INFO: Scrape type for CS24568: 0
2026-03-30 07:52:09 [auto1.de] INFO: Found listing with ID: YS21206
2026-03-30 07:52:09 [auto1.de] INFO: Found listing with ID: YT11339
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT11339%27 HTTP/1.1" 200 None
2026-03-30 07:52:09 [auto1.de] INFO: Scrape type for YT11339: 2
2026-03-30 07:52:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aae20eda-ede5-525a-a78b-a982512d59ba with identifier: YT11339
2026-03-30 07:52:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aae20eda-ede5-525a-a78b-a982512d59ba with scrape type 2
2026-03-30 07:52:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aae20eda-ede5-525a-a78b-a982512d59ba with scrape type 2
2026-03-30 07:52:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: aae20eda-ede5-525a-a78b-a982512d59ba, identifier: YT11339
2026-03-30 07:52:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: aae20eda-ede5-525a-a78b-a982512d59ba with identifier: YT11339
2026-03-30 07:52:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: aae20eda-ede5-525a-a78b-a982512d59ba with identifier: YT11339
2026-03-30 07:52:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: aae20eda-ede5-525a-a78b-a982512d59ba with identifier: YT11339 to the API
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 290,
 'expiration_date': '2026-03-30T15:24:11Z',
 'fuel_type': 'petrol',
 'id': 'aae20eda-ede5-525a-a78b-a982512d59ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT11339',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 50437,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-19',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TSI GTI TCR',
 'transmission': 'automatic',
 'trim': 'GTI TCR',
 'year': 2019}
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YT11339%27 HTTP/1.1" 200 None
2026-03-30 07:52:09 [auto1.de] INFO: Saving data for YT11339: {'auction_closing_time': 1774884251.0, 'created_time': 1774553045.797867, 'last_price_update_time': 1774857129.96277}
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YT11339') HTTP/1.1" 204 0
2026-03-30 07:52:09 [auto1.de] INFO: Found listing with ID: NW97614
2026-03-30 07:52:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW97614%27 HTTP/1.1" 200 None
2026-03-30 07:52:10 [auto1.de] INFO: Scrape type for NW97614: 2
2026-03-30 07:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 452aecca-a2b7-52b9-90ed-820fd4fac213 with identifier: NW97614
2026-03-30 07:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 452aecca-a2b7-52b9-90ed-820fd4fac213 with scrape type 2
2026-03-30 07:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 452aecca-a2b7-52b9-90ed-820fd4fac213 with scrape type 2
2026-03-30 07:52:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 452aecca-a2b7-52b9-90ed-820fd4fac213, identifier: NW97614
2026-03-30 07:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 452aecca-a2b7-52b9-90ed-820fd4fac213 with identifier: NW97614
2026-03-30 07:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 452aecca-a2b7-52b9-90ed-820fd4fac213 with identifier: NW97614
2026-03-30 07:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 452aecca-a2b7-52b9-90ed-820fd4fac213 with identifier: NW97614 to the API
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:59:30Z',
 'fuel_type': 'petrol',
 'id': '452aecca-a2b7-52b9-90ed-820fd4fac213',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW97614',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 167301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-06-15',
 'seller_name': None,
 'title': 'Opel Astra 1.4 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2009}
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW97614%27 HTTP/1.1" 200 None
2026-03-30 07:52:10 [auto1.de] INFO: Saving data for NW97614: {'auction_closing_time': 1774886370.0, 'created_time': 1774638589.019302, 'last_price_update_time': 1774857130.362374}
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NW97614') HTTP/1.1" 204 0
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: LD79531
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: YY92615
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YY92615%27 HTTP/1.1" 200 None
2026-03-30 07:52:10 [auto1.de] INFO: Scrape type for YY92615: 0
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: VY67119
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: UX52309
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: SS86318
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS86318%27 HTTP/1.1" 200 None
2026-03-30 07:52:10 [auto1.de] INFO: Scrape type for SS86318: 0
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: ML67017
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ML67017%27 HTTP/1.1" 200 None
2026-03-30 07:52:10 [auto1.de] INFO: Scrape type for ML67017: 0
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: MH24339
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: LS92843
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LS92843%27 HTTP/1.1" 200 None
2026-03-30 07:52:10 [auto1.de] INFO: Scrape type for LS92843: 0
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: LD63966
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: PB28144
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB28144%27 HTTP/1.1" 200 None
2026-03-30 07:52:10 [auto1.de] INFO: Scrape type for PB28144: 0
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: PT52067
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: XS74936
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: PX71275
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: RG95107
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG95107%27 HTTP/1.1" 200 None
2026-03-30 07:52:10 [auto1.de] INFO: Scrape type for RG95107: 0
2026-03-30 07:52:10 [auto1.de] INFO: Found listing with ID: AD21201
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD21201%27 HTTP/1.1" 200 None
2026-03-30 07:52:10 [auto1.de] INFO: Scrape type for AD21201: 2
2026-03-30 07:52:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 618ce3a1-458b-5b03-9b51-dcf319158009 with identifier: AD21201
2026-03-30 07:52:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 618ce3a1-458b-5b03-9b51-dcf319158009 with scrape type 2
2026-03-30 07:52:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 618ce3a1-458b-5b03-9b51-dcf319158009 with scrape type 2
2026-03-30 07:52:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 618ce3a1-458b-5b03-9b51-dcf319158009, identifier: AD21201
2026-03-30 07:52:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 618ce3a1-458b-5b03-9b51-dcf319158009 with identifier: AD21201
2026-03-30 07:52:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 618ce3a1-458b-5b03-9b51-dcf319158009 with identifier: AD21201
2026-03-30 07:52:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 618ce3a1-458b-5b03-9b51-dcf319158009 with identifier: AD21201 to the API
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:51:58Z',
 'fuel_type': 'petrol',
 'id': '618ce3a1-458b-5b03-9b51-dcf319158009',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AD21201',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 55143,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-31',
 'seller_name': None,
 'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
 'transmission': 'automatic',
 'trim': 'Micro Hybrid Drive passion',
 'year': 2013}
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD21201%27 HTTP/1.1" 200 None
2026-03-30 07:52:10 [auto1.de] INFO: Saving data for AD21201: {'auction_closing_time': 1774885918.0, 'created_time': 1774002196.528088, 'last_price_update_time': 1774857130.934146}
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='AD21201') HTTP/1.1" 204 0
2026-03-30 07:52:11 [auto1.de] INFO: Found listing with ID: SV60739
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SV60739%27 HTTP/1.1" 200 None
2026-03-30 07:52:11 [auto1.de] INFO: Scrape type for SV60739: 0
2026-03-30 07:52:11 [auto1.de] INFO: Found listing with ID: ZD67638
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD67638%27 HTTP/1.1" 200 None
2026-03-30 07:52:11 [auto1.de] INFO: Scrape type for ZD67638: 0
2026-03-30 07:52:11 [auto1.de] INFO: Found listing with ID: KW39556
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW39556%27 HTTP/1.1" 200 None
2026-03-30 07:52:11 [auto1.de] INFO: Scrape type for KW39556: 0
2026-03-30 07:52:11 [auto1.de] INFO: Found listing with ID: UB59521
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB59521%27 HTTP/1.1" 200 None
2026-03-30 07:52:11 [auto1.de] INFO: Scrape type for UB59521: 0
2026-03-30 07:52:11 [auto1.de] INFO: Found listing with ID: FH60355
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH60355%27 HTTP/1.1" 200 None
2026-03-30 07:52:11 [auto1.de] INFO: Scrape type for FH60355: 2
2026-03-30 07:52:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc44f719-871b-5fcd-b0d2-50c388ca1f4a with identifier: FH60355
2026-03-30 07:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc44f719-871b-5fcd-b0d2-50c388ca1f4a with scrape type 2
2026-03-30 07:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc44f719-871b-5fcd-b0d2-50c388ca1f4a with scrape type 2
2026-03-30 07:52:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: fc44f719-871b-5fcd-b0d2-50c388ca1f4a, identifier: FH60355
2026-03-30 07:52:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: fc44f719-871b-5fcd-b0d2-50c388ca1f4a with identifier: FH60355
2026-03-30 07:52:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: fc44f719-871b-5fcd-b0d2-50c388ca1f4a with identifier: FH60355
2026-03-30 07:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: fc44f719-871b-5fcd-b0d2-50c388ca1f4a with identifier: FH60355 to the API
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:33:46Z',
 'fuel_type': 'diesel',
 'id': 'fc44f719-871b-5fcd-b0d2-50c388ca1f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH60355',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 101546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': None,
 'title': 'BMW X2 xDrive 18d Advantage',
 'transmission': 'automatic',
 'trim': 'Advantage',
 'year': 2019}
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH60355%27 HTTP/1.1" 200 None
2026-03-30 07:52:11 [auto1.de] INFO: Saving data for FH60355: {'auction_closing_time': 1774884826.0, 'created_time': 1774550607.226633, 'last_price_update_time': 1774857131.582835}
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='FH60355') HTTP/1.1" 204 0
2026-03-30 07:52:11 [auto1.de] INFO: Found listing with ID: GT58505
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT58505%27 HTTP/1.1" 200 None
2026-03-30 07:52:11 [auto1.de] INFO: Scrape type for GT58505: 2
2026-03-30 07:52:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80575c14-2724-516a-b461-11717f3f23a2 with identifier: GT58505
2026-03-30 07:52:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80575c14-2724-516a-b461-11717f3f23a2 with scrape type 2
2026-03-30 07:52:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80575c14-2724-516a-b461-11717f3f23a2 with scrape type 2
2026-03-30 07:52:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 80575c14-2724-516a-b461-11717f3f23a2, identifier: GT58505
2026-03-30 07:52:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 80575c14-2724-516a-b461-11717f3f23a2 with identifier: GT58505
2026-03-30 07:52:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 80575c14-2724-516a-b461-11717f3f23a2 with identifier: GT58505
2026-03-30 07:52:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 80575c14-2724-516a-b461-11717f3f23a2 with identifier: GT58505 to the API
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:53:36Z',
 'fuel_type': 'diesel',
 'id': '80575c14-2724-516a-b461-11717f3f23a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT58505',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 177752,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.6 TDI Comfortline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion Tech',
 'year': 2013}
2026-03-30 07:52:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GT58505%27 HTTP/1.1" 200 None
2026-03-30 07:52:12 [auto1.de] INFO: Saving data for GT58505: {'auction_closing_time': 1774886016.0, 'created_time': 1774002039.9985, 'last_price_update_time': 1774857132.001221}
2026-03-30 07:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GT58505') HTTP/1.1" 204 0
2026-03-30 07:52:12 [auto1.de] INFO: Found listing with ID: RZ07739
2026-03-30 07:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ07739%27 HTTP/1.1" 200 None
2026-03-30 07:52:12 [auto1.de] INFO: Scrape type for RZ07739: 0
2026-03-30 07:52:12 [auto1.de] INFO: Found listing with ID: EC44311
2026-03-30 07:52:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:12 [auto1.de] INFO: Channel: 24h | Page: 181 | totalHits: 8418 | hits on page: 40
2026-03-30 07:52:12 [auto1.de] INFO: Found listing with ID: TV17454
2026-03-30 07:52:12 [auto1.de] INFO: Found listing with ID: BD92511
2026-03-30 07:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD92511%27 HTTP/1.1" 200 None
2026-03-30 07:52:12 [auto1.de] INFO: Scrape type for BD92511: 0
2026-03-30 07:52:12 [auto1.de] INFO: Found listing with ID: EL23730
2026-03-30 07:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL23730%27 HTTP/1.1" 200 None
2026-03-30 07:52:12 [auto1.de] INFO: Scrape type for EL23730: 2
2026-03-30 07:52:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 654f64d8-ab3e-5432-80ba-a407a66855cc with identifier: EL23730
2026-03-30 07:52:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 654f64d8-ab3e-5432-80ba-a407a66855cc with scrape type 2
2026-03-30 07:52:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 654f64d8-ab3e-5432-80ba-a407a66855cc with scrape type 2
2026-03-30 07:52:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 654f64d8-ab3e-5432-80ba-a407a66855cc, identifier: EL23730
2026-03-30 07:52:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 654f64d8-ab3e-5432-80ba-a407a66855cc with identifier: EL23730
2026-03-30 07:52:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 654f64d8-ab3e-5432-80ba-a407a66855cc with identifier: EL23730
2026-03-30 07:52:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 654f64d8-ab3e-5432-80ba-a407a66855cc with identifier: EL23730 to the API
2026-03-30 07:52:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:56:56Z',
 'fuel_type': 'petrol',
 'id': '654f64d8-ab3e-5432-80ba-a407a66855cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EL23730',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 123197,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-08-25',
 'seller_name': None,
 'title': 'Hyundai i30 1.4 FIFA WM Edition',
 'transmission': 'manual',
 'trim': 'FIFA WM Edition',
 'year': 2010}
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL23730%27 HTTP/1.1" 200 None
2026-03-30 07:52:13 [auto1.de] INFO: Saving data for EL23730: {'auction_closing_time': 1774886216.0, 'created_time': 1774638936.337625, 'last_price_update_time': 1774857133.053857}
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EL23730') HTTP/1.1" 204 0
2026-03-30 07:52:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:13 [auto1.de] INFO: Found listing with ID: TX33214
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX33214%27 HTTP/1.1" 200 None
2026-03-30 07:52:13 [auto1.de] INFO: Scrape type for TX33214: 2
2026-03-30 07:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dac5be22-1be2-5c47-9937-aab9bb5d011c with identifier: TX33214
2026-03-30 07:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac5be22-1be2-5c47-9937-aab9bb5d011c with scrape type 2
2026-03-30 07:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dac5be22-1be2-5c47-9937-aab9bb5d011c with scrape type 2
2026-03-30 07:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dac5be22-1be2-5c47-9937-aab9bb5d011c, identifier: TX33214
2026-03-30 07:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dac5be22-1be2-5c47-9937-aab9bb5d011c with identifier: TX33214
2026-03-30 07:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dac5be22-1be2-5c47-9937-aab9bb5d011c with identifier: TX33214
2026-03-30 07:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dac5be22-1be2-5c47-9937-aab9bb5d011c with identifier: TX33214 to the API
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:02:11Z',
 'fuel_type': 'diesel',
 'id': 'dac5be22-1be2-5c47-9937-aab9bb5d011c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TX33214',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 239209,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-08-09',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2007}
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TX33214%27 HTTP/1.1" 200 None
2026-03-30 07:52:13 [auto1.de] INFO: Saving data for TX33214: {'auction_closing_time': 1774882931.0, 'created_time': 1774550167.77655, 'last_price_update_time': 1774857133.547893}
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='TX33214') HTTP/1.1" 204 0
2026-03-30 07:52:13 [auto1.de] INFO: Found listing with ID: CJ94447
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94447%27 HTTP/1.1" 200 None
2026-03-30 07:52:13 [auto1.de] INFO: Scrape type for CJ94447: 2
2026-03-30 07:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f9b8ed6-e2b7-51f4-9b3e-6e45230fc216 with identifier: CJ94447
2026-03-30 07:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f9b8ed6-e2b7-51f4-9b3e-6e45230fc216 with scrape type 2
2026-03-30 07:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f9b8ed6-e2b7-51f4-9b3e-6e45230fc216 with scrape type 2
2026-03-30 07:52:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3f9b8ed6-e2b7-51f4-9b3e-6e45230fc216, identifier: CJ94447
2026-03-30 07:52:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3f9b8ed6-e2b7-51f4-9b3e-6e45230fc216 with identifier: CJ94447
2026-03-30 07:52:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3f9b8ed6-e2b7-51f4-9b3e-6e45230fc216 with identifier: CJ94447
2026-03-30 07:52:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3f9b8ed6-e2b7-51f4-9b3e-6e45230fc216 with identifier: CJ94447 to the API
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:50:20Z',
 'fuel_type': 'diesel',
 'id': '3f9b8ed6-e2b7-51f4-9b3e-6e45230fc216',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ94447',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 54147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-16',
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Style Maxi',
 'transmission': 'automatic',
 'trim': 'Style Maxi',
 'year': 2022}
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CJ94447%27 HTTP/1.1" 200 None
2026-03-30 07:52:13 [auto1.de] INFO: Saving data for CJ94447: {'auction_closing_time': 1774885820.0, 'created_time': 1774640070.792169, 'last_price_update_time': 1774857133.933829}
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CJ94447') HTTP/1.1" 204 0
2026-03-30 07:52:13 [auto1.de] INFO: Found listing with ID: UV35373
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV35373%27 HTTP/1.1" 200 None
2026-03-30 07:52:13 [auto1.de] INFO: Scrape type for UV35373: 0
2026-03-30 07:52:13 [auto1.de] INFO: Found listing with ID: ED19748
2026-03-30 07:52:13 [auto1.de] INFO: Found listing with ID: KW65379
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW65379%27 HTTP/1.1" 200 None
2026-03-30 07:52:13 [auto1.de] INFO: Scrape type for KW65379: 2
2026-03-30 07:52:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b203d46a-669f-593f-90fe-ecf07a320e76 with identifier: KW65379
2026-03-30 07:52:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b203d46a-669f-593f-90fe-ecf07a320e76 with scrape type 2
2026-03-30 07:52:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b203d46a-669f-593f-90fe-ecf07a320e76 with scrape type 2
2026-03-30 07:52:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b203d46a-669f-593f-90fe-ecf07a320e76, identifier: KW65379
2026-03-30 07:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b203d46a-669f-593f-90fe-ecf07a320e76 with identifier: KW65379
2026-03-30 07:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b203d46a-669f-593f-90fe-ecf07a320e76 with identifier: KW65379
2026-03-30 07:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b203d46a-669f-593f-90fe-ecf07a320e76 with identifier: KW65379 to the API
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:50:37Z',
 'fuel_type': 'petrol',
 'id': 'b203d46a-669f-593f-90fe-ecf07a320e76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW65379',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '2',
 'odometer': 110131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-03',
 'seller_name': None,
 'title': 'Mazda 2 1.4 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2007}
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KW65379%27 HTTP/1.1" 200 None
2026-03-30 07:52:14 [auto1.de] INFO: Saving data for KW65379: {'auction_closing_time': 1774885837.0, 'created_time': 1774349974.390922, 'last_price_update_time': 1774857134.394812}
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KW65379') HTTP/1.1" 204 0
2026-03-30 07:52:14 [auto1.de] INFO: Found listing with ID: BP44038
2026-03-30 07:52:14 [auto1.de] INFO: Found listing with ID: LG11243
2026-03-30 07:52:14 [auto1.de] INFO: Found listing with ID: AB49272
2026-03-30 07:52:14 [auto1.de] INFO: Found listing with ID: EE25450
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE25450%27 HTTP/1.1" 200 None
2026-03-30 07:52:14 [auto1.de] INFO: Scrape type for EE25450: 0
2026-03-30 07:52:14 [auto1.de] INFO: Found listing with ID: TT34897
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT34897%27 HTTP/1.1" 200 None
2026-03-30 07:52:14 [auto1.de] INFO: Scrape type for TT34897: 0
2026-03-30 07:52:14 [auto1.de] INFO: Found listing with ID: UC35648
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC35648%27 HTTP/1.1" 200 None
2026-03-30 07:52:14 [auto1.de] INFO: Scrape type for UC35648: 2
2026-03-30 07:52:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 347001a2-db4b-527e-9dd2-773c638aa9b1 with identifier: UC35648
2026-03-30 07:52:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 347001a2-db4b-527e-9dd2-773c638aa9b1 with scrape type 2
2026-03-30 07:52:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 347001a2-db4b-527e-9dd2-773c638aa9b1 with scrape type 2
2026-03-30 07:52:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 347001a2-db4b-527e-9dd2-773c638aa9b1, identifier: UC35648
2026-03-30 07:52:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 347001a2-db4b-527e-9dd2-773c638aa9b1 with identifier: UC35648
2026-03-30 07:52:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 347001a2-db4b-527e-9dd2-773c638aa9b1 with identifier: UC35648
2026-03-30 07:52:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 347001a2-db4b-527e-9dd2-773c638aa9b1 with identifier: UC35648 to the API
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-30T15:04:47Z',
 'fuel_type': 'petrol',
 'id': '347001a2-db4b-527e-9dd2-773c638aa9b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC35648',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo X',
 'odometer': 12656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-19',
 'seller_name': None,
 'title': 'Toyota Aygo X 1.0 UNDERCOVER',
 'transmission': 'automatic',
 'trim': 'UNDERCOVER',
 'year': 2023}
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UC35648%27 HTTP/1.1" 200 None
2026-03-30 07:52:14 [auto1.de] INFO: Saving data for UC35648: {'auction_closing_time': 1774883087.0, 'created_time': 1774001908.563036, 'last_price_update_time': 1774857134.917113}
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UC35648') HTTP/1.1" 204 0
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: GJ71101
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: KU38253
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU38253%27 HTTP/1.1" 200 None
2026-03-30 07:52:15 [auto1.de] INFO: Scrape type for KU38253: 0
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: NG37948
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: UA95146
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: GG27070
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: WP81367
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: GW03247
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW03247%27 HTTP/1.1" 200 None
2026-03-30 07:52:15 [auto1.de] INFO: Scrape type for GW03247: 2
2026-03-30 07:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde068ff-b87a-582d-84c2-e02e193c5be9 with identifier: GW03247
2026-03-30 07:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde068ff-b87a-582d-84c2-e02e193c5be9 with scrape type 2
2026-03-30 07:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cde068ff-b87a-582d-84c2-e02e193c5be9 with scrape type 2
2026-03-30 07:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cde068ff-b87a-582d-84c2-e02e193c5be9, identifier: GW03247
2026-03-30 07:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cde068ff-b87a-582d-84c2-e02e193c5be9 with identifier: GW03247
2026-03-30 07:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cde068ff-b87a-582d-84c2-e02e193c5be9 with identifier: GW03247
2026-03-30 07:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cde068ff-b87a-582d-84c2-e02e193c5be9 with identifier: GW03247 to the API
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 211,
 'expiration_date': '2026-03-30T15:23:32Z',
 'fuel_type': 'diesel',
 'id': 'cde068ff-b87a-582d-84c2-e02e193c5be9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW03247',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 66922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-08-05',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 B4 Diesel Mild-Hybrid Inscription AWD',
 'transmission': 'automatic',
 'trim': 'Inscription AWD',
 'year': 2020}
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW03247%27 HTTP/1.1" 200 None
2026-03-30 07:52:15 [auto1.de] INFO: Saving data for GW03247: {'auction_closing_time': 1774884212.0, 'created_time': 1774639528.086733, 'last_price_update_time': 1774857135.440471}
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GW03247') HTTP/1.1" 204 0
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: RC84625
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: GS33010
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: PB99961
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: TN24608
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN24608%27 HTTP/1.1" 200 None
2026-03-30 07:52:15 [auto1.de] INFO: Scrape type for TN24608: 0
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: VF40931
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: HD35365
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: VS86742
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: TB14981
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TB14981%27 HTTP/1.1" 200 None
2026-03-30 07:52:15 [auto1.de] INFO: Scrape type for TB14981: 0
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: GC05156
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: CU13937
2026-03-30 07:52:15 [auto1.de] INFO: Found listing with ID: ER30285
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER30285%27 HTTP/1.1" 200 None
2026-03-30 07:52:15 [auto1.de] INFO: Scrape type for ER30285: 2
2026-03-30 07:52:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f184dbd-5b9c-50e3-8148-bf242c6f8a77 with identifier: ER30285
2026-03-30 07:52:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f184dbd-5b9c-50e3-8148-bf242c6f8a77 with scrape type 2
2026-03-30 07:52:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1f184dbd-5b9c-50e3-8148-bf242c6f8a77 with scrape type 2
2026-03-30 07:52:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1f184dbd-5b9c-50e3-8148-bf242c6f8a77, identifier: ER30285
2026-03-30 07:52:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1f184dbd-5b9c-50e3-8148-bf242c6f8a77 with identifier: ER30285
2026-03-30 07:52:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1f184dbd-5b9c-50e3-8148-bf242c6f8a77 with identifier: ER30285
2026-03-30 07:52:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1f184dbd-5b9c-50e3-8148-bf242c6f8a77 with identifier: ER30285 to the API
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 347,
 'expiration_date': '2026-03-30T15:20:02Z',
 'fuel_type': 'diesel',
 'id': '1f184dbd-5b9c-50e3-8148-bf242c6f8a77',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ER30285',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'SQ5',
 'odometer': 71821,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-04-13',
 'seller_name': None,
 'title': 'Audi SQ5 3.0 TDI Mild-Hybrid quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2020}
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER30285%27 HTTP/1.1" 200 None
2026-03-30 07:52:15 [auto1.de] INFO: Saving data for ER30285: {'auction_closing_time': 1774884002.0, 'created_time': 1773831165.367365, 'last_price_update_time': 1774857135.895801}
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='ER30285') HTTP/1.1" 204 0
2026-03-30 07:52:16 [auto1.de] INFO: Found listing with ID: HS66521
2026-03-30 07:52:16 [auto1.de] INFO: Found listing with ID: MJ96775
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MJ96775%27 HTTP/1.1" 200 None
2026-03-30 07:52:16 [auto1.de] INFO: Scrape type for MJ96775: 0
2026-03-30 07:52:16 [auto1.de] INFO: Found listing with ID: KS41473
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41473%27 HTTP/1.1" 200 None
2026-03-30 07:52:16 [auto1.de] INFO: Scrape type for KS41473: 2
2026-03-30 07:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39e46149-a690-5911-b61a-fdb81dbf7aa0 with identifier: KS41473
2026-03-30 07:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39e46149-a690-5911-b61a-fdb81dbf7aa0 with scrape type 2
2026-03-30 07:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39e46149-a690-5911-b61a-fdb81dbf7aa0 with scrape type 2
2026-03-30 07:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 39e46149-a690-5911-b61a-fdb81dbf7aa0, identifier: KS41473
2026-03-30 07:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 39e46149-a690-5911-b61a-fdb81dbf7aa0 with identifier: KS41473
2026-03-30 07:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 39e46149-a690-5911-b61a-fdb81dbf7aa0 with identifier: KS41473
2026-03-30 07:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 39e46149-a690-5911-b61a-fdb81dbf7aa0 with identifier: KS41473 to the API
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:26:22Z',
 'fuel_type': 'petrol',
 'id': '39e46149-a690-5911-b61a-fdb81dbf7aa0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KS41473',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 111019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-28',
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI FR',
 'transmission': 'manual',
 'trim': 'FR',
 'year': 2013}
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KS41473%27 HTTP/1.1" 200 None
2026-03-30 07:52:16 [auto1.de] INFO: Saving data for KS41473: {'auction_closing_time': 1774884382.0, 'created_time': 1774553230.302543, 'last_price_update_time': 1774857136.423868}
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KS41473') HTTP/1.1" 204 0
2026-03-30 07:52:16 [auto1.de] INFO: Found listing with ID: GL30880
2026-03-30 07:52:16 [auto1.de] INFO: Found listing with ID: WC36574
2026-03-30 07:52:16 [auto1.de] INFO: Found listing with ID: YT67181
2026-03-30 07:52:16 [auto1.de] INFO: Found listing with ID: NU47228
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NU47228%27 HTTP/1.1" 200 None
2026-03-30 07:52:16 [auto1.de] INFO: Scrape type for NU47228: 0
2026-03-30 07:52:16 [auto1.de] INFO: Found listing with ID: PU26229
2026-03-30 07:52:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:16 [auto1.de] INFO: Channel: 24h | Page: 182 | totalHits: 8418 | hits on page: 40
2026-03-30 07:52:16 [auto1.de] INFO: Found listing with ID: EA40469
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EA40469%27 HTTP/1.1" 200 None
2026-03-30 07:52:16 [auto1.de] INFO: Scrape type for EA40469: 0
2026-03-30 07:52:16 [auto1.de] INFO: Found listing with ID: LB77280
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB77280%27 HTTP/1.1" 200 None
2026-03-30 07:52:16 [auto1.de] INFO: Scrape type for LB77280: 2
2026-03-30 07:52:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d38b927-1596-5744-a904-b6a169c0de3c with identifier: LB77280
2026-03-30 07:52:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d38b927-1596-5744-a904-b6a169c0de3c with scrape type 2
2026-03-30 07:52:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d38b927-1596-5744-a904-b6a169c0de3c with scrape type 2
2026-03-30 07:52:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5d38b927-1596-5744-a904-b6a169c0de3c, identifier: LB77280
2026-03-30 07:52:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5d38b927-1596-5744-a904-b6a169c0de3c with identifier: LB77280
2026-03-30 07:52:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5d38b927-1596-5744-a904-b6a169c0de3c with identifier: LB77280
2026-03-30 07:52:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5d38b927-1596-5744-a904-b6a169c0de3c with identifier: LB77280 to the API
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:13:12Z',
 'fuel_type': 'petrol',
 'id': '5d38b927-1596-5744-a904-b6a169c0de3c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LB77280',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 97670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-15',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB77280%27 HTTP/1.1" 200 None
2026-03-30 07:52:16 [auto1.de] INFO: Saving data for LB77280: {'auction_closing_time': 1774883592.0, 'created_time': 1774552731.026042, 'last_price_update_time': 1774857136.99029}
2026-03-30 07:52:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LB77280') HTTP/1.1" 204 0
2026-03-30 07:52:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: ZF63164
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: SR33990
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: GM00936
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: MA09266
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: ET23804
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ET23804%27 HTTP/1.1" 200 None
2026-03-30 07:52:17 [auto1.de] INFO: Scrape type for ET23804: 0
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: RW93776
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: NF13899
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: NX83651
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX83651%27 HTTP/1.1" 200 None
2026-03-30 07:52:17 [auto1.de] INFO: Scrape type for NX83651: 0
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: FZ16195
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ16195%27 HTTP/1.1" 200 None
2026-03-30 07:52:17 [auto1.de] INFO: Scrape type for FZ16195: 0
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: SS79198
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SS79198%27 HTTP/1.1" 200 None
2026-03-30 07:52:17 [auto1.de] INFO: Scrape type for SS79198: 0
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: SD88360
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: TL42173
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: EK21596
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: EC36203
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: NP30819
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP30819%27 HTTP/1.1" 200 None
2026-03-30 07:52:17 [auto1.de] INFO: Scrape type for NP30819: 2
2026-03-30 07:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with identifier: NP30819
2026-03-30 07:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with scrape type 2
2026-03-30 07:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with scrape type 2
2026-03-30 07:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c, identifier: NP30819
2026-03-30 07:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with identifier: NP30819
2026-03-30 07:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with identifier: NP30819
2026-03-30 07:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d8cec16a-0eaa-5568-a7b3-c88b3b0bd42c with identifier: NP30819 to the API
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:58:48Z',
 'fuel_type': 'petrol',
 'id': 'd8cec16a-0eaa-5568-a7b3-c88b3b0bd42c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NP30819',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 105903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-18',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.2 TSI Lounge BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Lounge BlueMotion Tech',
 'year': 2015}
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP30819%27 HTTP/1.1" 200 None
2026-03-30 07:52:17 [auto1.de] INFO: Saving data for NP30819: {'auction_closing_time': 1774886328.0, 'created_time': 1774551848.120793, 'last_price_update_time': 1774857137.470328}
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NP30819') HTTP/1.1" 204 0
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: WK96887
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK96887%27 HTTP/1.1" 200 None
2026-03-30 07:52:17 [auto1.de] INFO: Scrape type for WK96887: 2
2026-03-30 07:52:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c3fe221-d544-5142-89d3-b378a768e257 with identifier: WK96887
2026-03-30 07:52:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c3fe221-d544-5142-89d3-b378a768e257 with scrape type 2
2026-03-30 07:52:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c3fe221-d544-5142-89d3-b378a768e257 with scrape type 2
2026-03-30 07:52:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 3c3fe221-d544-5142-89d3-b378a768e257, identifier: WK96887
2026-03-30 07:52:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 3c3fe221-d544-5142-89d3-b378a768e257 with identifier: WK96887
2026-03-30 07:52:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 3c3fe221-d544-5142-89d3-b378a768e257 with identifier: WK96887
2026-03-30 07:52:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 3c3fe221-d544-5142-89d3-b378a768e257 with identifier: WK96887 to the API
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:44:34Z',
 'fuel_type': 'diesel',
 'id': '3c3fe221-d544-5142-89d3-b378a768e257',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK96887',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'SX4',
 'odometer': 311977,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-10-14',
 'seller_name': None,
 'title': 'Suzuki SX4 1.9 DDiS Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2010}
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK96887%27 HTTP/1.1" 200 None
2026-03-30 07:52:17 [auto1.de] INFO: Saving data for WK96887: {'auction_closing_time': 1774885474.0, 'created_time': 1774639915.637745, 'last_price_update_time': 1774857137.959143}
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='WK96887') HTTP/1.1" 204 0
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: PU13127
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: DF28851
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: XX31179
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: JH61376
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JH61376%27 HTTP/1.1" 200 None
2026-03-30 07:52:17 [auto1.de] INFO: Scrape type for JH61376: 0
2026-03-30 07:52:17 [auto1.de] INFO: Found listing with ID: KK39591
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KK39591%27 HTTP/1.1" 200 None
2026-03-30 07:52:18 [auto1.de] INFO: Scrape type for KK39591: 0
2026-03-30 07:52:18 [auto1.de] INFO: Found listing with ID: UC83378
2026-03-30 07:52:18 [auto1.de] INFO: Found listing with ID: LU75285
2026-03-30 07:52:18 [auto1.de] INFO: Found listing with ID: MW22662
2026-03-30 07:52:18 [auto1.de] INFO: Found listing with ID: UT28734
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT28734%27 HTTP/1.1" 200 None
2026-03-30 07:52:18 [auto1.de] INFO: Scrape type for UT28734: 2
2026-03-30 07:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with identifier: UT28734
2026-03-30 07:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with scrape type 2
2026-03-30 07:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with scrape type 2
2026-03-30 07:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 69b0be66-4ad9-5d50-b17a-3c3a11f3256d, identifier: UT28734
2026-03-30 07:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with identifier: UT28734
2026-03-30 07:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with identifier: UT28734
2026-03-30 07:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 69b0be66-4ad9-5d50-b17a-3c3a11f3256d with identifier: UT28734 to the API
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:29:33Z',
 'fuel_type': 'diesel',
 'id': '69b0be66-4ad9-5d50-b17a-3c3a11f3256d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UT28734',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 274121,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-19',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 350 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2011}
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT28734%27 HTTP/1.1" 200 None
2026-03-30 07:52:18 [auto1.de] INFO: Saving data for UT28734: {'auction_closing_time': 1774884573.0, 'created_time': 1774034805.640405, 'last_price_update_time': 1774857138.422336}
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UT28734') HTTP/1.1" 204 0
2026-03-30 07:52:18 [auto1.de] INFO: Found listing with ID: SD45668
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SD45668%27 HTTP/1.1" 200 None
2026-03-30 07:52:18 [auto1.de] INFO: Scrape type for SD45668: 0
2026-03-30 07:52:18 [auto1.de] INFO: Found listing with ID: CF68220
2026-03-30 07:52:18 [auto1.de] INFO: Found listing with ID: FP92588
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FP92588%27 HTTP/1.1" 200 None
2026-03-30 07:52:18 [auto1.de] INFO: Scrape type for FP92588: 0
2026-03-30 07:52:18 [auto1.de] INFO: Found listing with ID: ZA74026
2026-03-30 07:52:18 [auto1.de] INFO: Found listing with ID: KH38301
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KH38301%27 HTTP/1.1" 200 None
2026-03-30 07:52:18 [auto1.de] INFO: Scrape type for KH38301: 0
2026-03-30 07:52:18 [auto1.de] INFO: Found listing with ID: XV47877
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV47877%27 HTTP/1.1" 200 None
2026-03-30 07:52:18 [auto1.de] INFO: Scrape type for XV47877: 2
2026-03-30 07:52:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0a67295-a79a-5dbf-9073-07a39002c599 with identifier: XV47877
2026-03-30 07:52:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0a67295-a79a-5dbf-9073-07a39002c599 with scrape type 2
2026-03-30 07:52:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0a67295-a79a-5dbf-9073-07a39002c599 with scrape type 2
2026-03-30 07:52:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c0a67295-a79a-5dbf-9073-07a39002c599, identifier: XV47877
2026-03-30 07:52:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c0a67295-a79a-5dbf-9073-07a39002c599 with identifier: XV47877
2026-03-30 07:52:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c0a67295-a79a-5dbf-9073-07a39002c599 with identifier: XV47877
2026-03-30 07:52:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c0a67295-a79a-5dbf-9073-07a39002c599 with identifier: XV47877 to the API
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:52:28Z',
 'fuel_type': 'diesel',
 'id': 'c0a67295-a79a-5dbf-9073-07a39002c599',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV47877',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 195939,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-04',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.9 TDI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2009}
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV47877%27 HTTP/1.1" 200 None
2026-03-30 07:52:18 [auto1.de] INFO: Saving data for XV47877: {'auction_closing_time': 1774885948.0, 'created_time': 1774639699.46596, 'last_price_update_time': 1774857138.891062}
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XV47877') HTTP/1.1" 204 0
2026-03-30 07:52:19 [auto1.de] INFO: Found listing with ID: SP00408
2026-03-30 07:52:19 [auto1.de] INFO: Found listing with ID: XF17671
2026-03-30 07:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF17671%27 HTTP/1.1" 200 None
2026-03-30 07:52:19 [auto1.de] INFO: Scrape type for XF17671: 2
2026-03-30 07:52:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5380bbe6-f814-5331-aba9-8d8623b7b8c4 with identifier: XF17671
2026-03-30 07:52:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5380bbe6-f814-5331-aba9-8d8623b7b8c4 with scrape type 2
2026-03-30 07:52:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5380bbe6-f814-5331-aba9-8d8623b7b8c4 with scrape type 2
2026-03-30 07:52:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 5380bbe6-f814-5331-aba9-8d8623b7b8c4, identifier: XF17671
2026-03-30 07:52:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 5380bbe6-f814-5331-aba9-8d8623b7b8c4 with identifier: XF17671
2026-03-30 07:52:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 5380bbe6-f814-5331-aba9-8d8623b7b8c4 with identifier: XF17671
2026-03-30 07:52:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 5380bbe6-f814-5331-aba9-8d8623b7b8c4 with identifier: XF17671 to the API
2026-03-30 07:52:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 87,
 'expiration_date': '2026-03-30T15:53:01Z',
 'fuel_type': 'petrol',
 'id': '5380bbe6-f814-5331-aba9-8d8623b7b8c4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF17671',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 84865,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-01',
 'seller_name': None,
 'title': 'Hyundai i10 1.2 FIFA World Cup Edition',
 'transmission': 'manual',
 'trim': 'FIFA World Cup Edition',
 'year': 2015}
2026-03-30 07:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XF17671%27 HTTP/1.1" 200 None
2026-03-30 07:52:19 [auto1.de] INFO: Saving data for XF17671: {'auction_closing_time': 1774885981.0, 'created_time': 1774639750.093765, 'last_price_update_time': 1774857139.443051}
2026-03-30 07:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='XF17671') HTTP/1.1" 204 0
2026-03-30 07:52:19 [auto1.de] INFO: Found listing with ID: ZT05209
2026-03-30 07:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT05209%27 HTTP/1.1" 200 None
2026-03-30 07:52:19 [auto1.de] INFO: Scrape type for ZT05209: 0
2026-03-30 07:52:19 [auto1.de] INFO: Found listing with ID: GC30737
2026-03-30 07:52:19 [auto1.de] INFO: Found listing with ID: GB76211
2026-03-30 07:52:19 [auto1.de] INFO: Found listing with ID: EC58383
2026-03-30 07:52:19 [auto1.de] INFO: Found listing with ID: HL77146
2026-03-30 07:52:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:20 [auto1.de] INFO: Channel: 24h | Page: 183 | totalHits: 8418 | hits on page: 40
2026-03-30 07:52:20 [auto1.de] INFO: Found listing with ID: BD21444
2026-03-30 07:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BD21444%27 HTTP/1.1" 200 None
2026-03-30 07:52:20 [auto1.de] INFO: Scrape type for BD21444: 0
2026-03-30 07:52:20 [auto1.de] INFO: Found listing with ID: NB45839
2026-03-30 07:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB45839%27 HTTP/1.1" 200 None
2026-03-30 07:52:20 [auto1.de] INFO: Scrape type for NB45839: 2
2026-03-30 07:52:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f58a000-6cc8-56a9-81f7-db2939dfb81c with identifier: NB45839
2026-03-30 07:52:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f58a000-6cc8-56a9-81f7-db2939dfb81c with scrape type 2
2026-03-30 07:52:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f58a000-6cc8-56a9-81f7-db2939dfb81c with scrape type 2
2026-03-30 07:52:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7f58a000-6cc8-56a9-81f7-db2939dfb81c, identifier: NB45839
2026-03-30 07:52:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7f58a000-6cc8-56a9-81f7-db2939dfb81c with identifier: NB45839
2026-03-30 07:52:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7f58a000-6cc8-56a9-81f7-db2939dfb81c with identifier: NB45839
2026-03-30 07:52:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7f58a000-6cc8-56a9-81f7-db2939dfb81c with identifier: NB45839 to the API
2026-03-30 07:52:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-30T15:52:21Z',
 'fuel_type': 'diesel',
 'id': '7f58a000-6cc8-56a9-81f7-db2939dfb81c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB45839',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 281153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.6 TDI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2018}
2026-03-30 07:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NB45839%27 HTTP/1.1" 200 None
2026-03-30 07:52:20 [auto1.de] INFO: Saving data for NB45839: {'auction_closing_time': 1774885941.0, 'created_time': 1774552877.911765, 'last_price_update_time': 1774857140.986208}
2026-03-30 07:52:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NB45839') HTTP/1.1" 204 0
2026-03-30 07:52:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: VE08810
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE08810%27 HTTP/1.1" 200 None
2026-03-30 07:52:21 [auto1.de] INFO: Scrape type for VE08810: 2
2026-03-30 07:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4c4f346-9754-570a-9cd3-6eb6442f9f43 with identifier: VE08810
2026-03-30 07:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4c4f346-9754-570a-9cd3-6eb6442f9f43 with scrape type 2
2026-03-30 07:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4c4f346-9754-570a-9cd3-6eb6442f9f43 with scrape type 2
2026-03-30 07:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a4c4f346-9754-570a-9cd3-6eb6442f9f43, identifier: VE08810
2026-03-30 07:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a4c4f346-9754-570a-9cd3-6eb6442f9f43 with identifier: VE08810
2026-03-30 07:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a4c4f346-9754-570a-9cd3-6eb6442f9f43 with identifier: VE08810
2026-03-30 07:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a4c4f346-9754-570a-9cd3-6eb6442f9f43 with identifier: VE08810 to the API
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:35:35Z',
 'fuel_type': 'electro',
 'id': 'a4c4f346-9754-570a-9cd3-6eb6442f9f43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VE08810',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 53052,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': None,
 'title': 'Opel Corsa electric drive 100 kW Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2020}
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VE08810%27 HTTP/1.1" 200 None
2026-03-30 07:52:21 [auto1.de] INFO: Saving data for VE08810: {'auction_closing_time': 1774884935.0, 'created_time': 1774550436.293509, 'last_price_update_time': 1774857141.394415}
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='VE08810') HTTP/1.1" 204 0
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: XW71594
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XW71594%27 HTTP/1.1" 200 None
2026-03-30 07:52:21 [auto1.de] INFO: Scrape type for XW71594: 0
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: WH58707
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH58707%27 HTTP/1.1" 200 None
2026-03-30 07:52:21 [auto1.de] INFO: Scrape type for WH58707: 0
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: TM06695
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: DP78752
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DP78752%27 HTTP/1.1" 200 None
2026-03-30 07:52:21 [auto1.de] INFO: Scrape type for DP78752: 0
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: PZ33404
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PZ33404%27 HTTP/1.1" 200 None
2026-03-30 07:52:21 [auto1.de] INFO: Scrape type for PZ33404: 0
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: XR58128
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: ST45837
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: MK98498
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK98498%27 HTTP/1.1" 200 None
2026-03-30 07:52:21 [auto1.de] INFO: Scrape type for MK98498: 0
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: FH98757
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FH98757%27 HTTP/1.1" 200 None
2026-03-30 07:52:21 [auto1.de] INFO: Scrape type for FH98757: 0
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: VT41344
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VT41344%27 HTTP/1.1" 200 None
2026-03-30 07:52:21 [auto1.de] INFO: Scrape type for VT41344: 0
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: JU26227
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: MU44330
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: GV67460
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: NZ17394
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: YA68492
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: GH92253
2026-03-30 07:52:21 [auto1.de] INFO: Found listing with ID: CV09356
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV09356%27 HTTP/1.1" 200 None
2026-03-30 07:52:21 [auto1.de] INFO: Scrape type for CV09356: 2
2026-03-30 07:52:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a3e00b8-f23a-5d7c-a927-abd537058aad with identifier: CV09356
2026-03-30 07:52:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a3e00b8-f23a-5d7c-a927-abd537058aad with scrape type 2
2026-03-30 07:52:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a3e00b8-f23a-5d7c-a927-abd537058aad with scrape type 2
2026-03-30 07:52:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 1a3e00b8-f23a-5d7c-a927-abd537058aad, identifier: CV09356
2026-03-30 07:52:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 1a3e00b8-f23a-5d7c-a927-abd537058aad with identifier: CV09356
2026-03-30 07:52:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 1a3e00b8-f23a-5d7c-a927-abd537058aad with identifier: CV09356
2026-03-30 07:52:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 1a3e00b8-f23a-5d7c-a927-abd537058aad with identifier: CV09356 to the API
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:52:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:25:30Z',
 'fuel_type': 'petrol',
 'id': '1a3e00b8-f23a-5d7c-a927-abd537058aad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV09356',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 103812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-21',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Business Edition',
 'transmission': 'automatic',
 'trim': 'Business Edition',
 'year': 2017}
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV09356%27 HTTP/1.1" 200 None
2026-03-30 07:52:21 [auto1.de] INFO: Saving data for CV09356: {'auction_closing_time': 1774884330.0, 'created_time': 1774639207.760004, 'last_price_update_time': 1774857141.970551}
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CV09356') HTTP/1.1" 204 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: AC92366
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AC92366%27 HTTP/1.1" 200 None
2026-03-30 07:52:22 [auto1.de] INFO: Scrape type for AC92366: 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: VT94173
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: MY90175
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: NH48980
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: PW96816
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW96816%27 HTTP/1.1" 200 None
2026-03-30 07:52:22 [auto1.de] INFO: Scrape type for PW96816: 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: UZ14919
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: JU61936
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU61936%27 HTTP/1.1" 200 None
2026-03-30 07:52:22 [auto1.de] INFO: Scrape type for JU61936: 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: KC56991
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: FY38947
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FY38947%27 HTTP/1.1" 200 None
2026-03-30 07:52:22 [auto1.de] INFO: Scrape type for FY38947: 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: MU41228
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU41228%27 HTTP/1.1" 200 None
2026-03-30 07:52:22 [auto1.de] INFO: Scrape type for MU41228: 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: NG13141
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG13141%27 HTTP/1.1" 200 None
2026-03-30 07:52:22 [auto1.de] INFO: Scrape type for NG13141: 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: SP37211
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: BP15722
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP15722%27 HTTP/1.1" 200 None
2026-03-30 07:52:22 [auto1.de] INFO: Scrape type for BP15722: 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: ZJ20785
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: PG70940
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG70940%27 HTTP/1.1" 200 None
2026-03-30 07:52:22 [auto1.de] INFO: Scrape type for PG70940: 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: HJ15324
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: YJ96267
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YJ96267%27 HTTP/1.1" 200 None
2026-03-30 07:52:22 [auto1.de] INFO: Scrape type for YJ96267: 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: BH45975
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH45975%27 HTTP/1.1" 200 None
2026-03-30 07:52:22 [auto1.de] INFO: Scrape type for BH45975: 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: JS30878
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS30878%27 HTTP/1.1" 200 None
2026-03-30 07:52:22 [auto1.de] INFO: Scrape type for JS30878: 0
2026-03-30 07:52:22 [auto1.de] INFO: Found listing with ID: NL79635
2026-03-30 07:52:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:24 [auto1.de] INFO: Channel: 24h | Page: 184 | totalHits: 8418 | hits on page: 40
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: LF10236
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LF10236%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for LF10236: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: DP76469
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: ST53597
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST53597%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for ST53597: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: AD05986
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD05986%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for AD05986: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: LU20114
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: WT09019
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WT09019%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for WT09019: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: MA38279
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: PZ30496
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: CH12661
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: HC35889
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: AX97123
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX97123%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for AX97123: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: ZM69821
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: ZW92608
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZW92608%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for ZW92608: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: KF80964
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: CE00984
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE00984%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for CE00984: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: KR40526
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: NS83554
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: UV09635
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: CS70589
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CS70589%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for CS70589: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: MK47455
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK47455%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for MK47455: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: ND12794
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND12794%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for ND12794: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: TW63260
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TW63260%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for TW63260: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: SE34706
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SE34706%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for SE34706: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: LR83897
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: EX09851
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: RT47788
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: NM77711
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NM77711%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for NM77711: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: NF65308
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: SM15553
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SM15553%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for SM15553: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: RB21288
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: TL00985
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: WM78340
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WM78340%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for WM78340: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: NF79967
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF79967%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for NF79967: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: BP86172
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP86172%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for BP86172: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: SM64754
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: PL66942
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: LR99893
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR99893%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for LR99893: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: VG16481
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG16481%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for VG16481: 0
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: RU39212
2026-03-30 07:52:24 [auto1.de] INFO: Found listing with ID: PH19268
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PH19268%27 HTTP/1.1" 200 None
2026-03-30 07:52:24 [auto1.de] INFO: Scrape type for PH19268: 0
2026-03-30 07:52:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:25 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:25 [auto1.de] INFO: Channel: 24h | Page: 185 | totalHits: 8418 | hits on page: 40
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: ZS99681
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: PU80535
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PU80535%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for PU80535: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: AF19813
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AF19813%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for AF19813: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: AN91174
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AN91174%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for AN91174: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: DK08847
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK08847%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for DK08847: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: JB87569
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JB87569%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for JB87569: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: EE75447
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: RP15985
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: TA77613
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TA77613%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for TA77613: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: SP96955
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: DW77268
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW77268%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for DW77268: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: DJ18232
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DJ18232%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for DJ18232: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: RL54518
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL54518%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for RL54518: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: GS31332
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: GS03100
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GS03100%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for GS03100: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: FC21553
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FC21553%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for FC21553: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: CT45397
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT45397%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for CT45397: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: TH39634
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: MY94359
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: FZ92426
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ92426%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for FZ92426: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: RE77380
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE77380%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for RE77380: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: ZS85048
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: ZY92659
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: DK37949
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: ZY32657
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZY32657%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for ZY32657: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: RF12873
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: WK31693
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WK31693%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for WK31693: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: XR35811
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: WL69602
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WL69602%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for WL69602: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: NC71734
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: XU03488
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU03488%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for XU03488: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: JN07474
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: CT96582
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CT96582%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for CT96582: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: XZ21442
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: EK71515
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EK71515%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for EK71515: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: YE73742
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: CA87699
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: XU33519
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: HK31829
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK31829%27 HTTP/1.1" 200 None
2026-03-30 07:52:25 [auto1.de] INFO: Scrape type for HK31829: 0
2026-03-30 07:52:25 [auto1.de] INFO: Found listing with ID: NK26673
2026-03-30 07:52:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:27 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:27 [auto1.de] INFO: Channel: 24h | Page: 186 | totalHits: 8418 | hits on page: 40
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: XD40949
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD40949%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for XD40949: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: NM76791
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: HA62575
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA62575%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for HA62575: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: UN89180
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: YH18669
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: EL96080
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EL96080%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for EL96080: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: KD63113
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: FL46038
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: NX82618
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: ZD28041
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: LK56613
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: DS29172
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS29172%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for DS29172: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: WE31393
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE31393%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for WE31393: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: CC29120
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC29120%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for CC29120: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: FT90380
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FT90380%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for FT90380: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: SA04539
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA04539%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for SA04539: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: KV17598
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: TV41751
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TV41751%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for TV41751: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: HX78633
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: TE40935
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TE40935%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for TE40935: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: GY13468
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY13468%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for GY13468: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: GY83312
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: BG42804
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: GM83626
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM83626%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for GM83626: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: HG43188
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: CW85183
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: NP47731
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NP47731%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for NP47731: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: KV68719
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: GJ18953
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: GR83992
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: JJ86463
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ86463%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for JJ86463: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: BV89454
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: MX21840
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: DR45963
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: UB44378
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB44378%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for UB44378: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: CE18724
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE18724%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for CE18724: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: WN98696
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN98696%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for WN98696: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: RW68722
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: AJ11888
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ11888%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for AJ11888: 0
2026-03-30 07:52:27 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD40390%27 HTTP/1.1" 200 None
2026-03-30 07:52:27 [auto1.de] INFO: Scrape type for YD40390: 0
2026-03-30 07:52:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:29 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:29 [auto1.de] INFO: Channel: 24h | Page: 187 | totalHits: 8419 | hits on page: 40
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: YD40390
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD40390%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for YD40390: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: JX30830
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: EC85375
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: NN03303
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NN03303%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for NN03303: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: VX97978
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: LB43778
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LB43778%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for LB43778: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: ED69500
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: HC86157
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HC86157%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for HC86157: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: AN99140
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: FD40697
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: UK28270
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: TM32674
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM32674%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for TM32674: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: NY30954
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: UG29438
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: AJ75381
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AJ75381%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for AJ75381: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: HH84481
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: NZ79152
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: KA54911
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: TV53465
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: UP69379
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: TP61394
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: SG76993
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG76993%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for SG76993: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: EY95933
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EY95933%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for EY95933: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: KR30537
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR30537%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for KR30537: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: BU21003
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: JY00372
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY00372%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for JY00372: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: CG91765
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: NG66001
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: BP09693
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BP09693%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for BP09693: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: BT01554
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT01554%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for BT01554: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: BM00053
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BM00053%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for BM00053: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: MG61327
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MG61327%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for MG61327: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: MK22023
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MK22023%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for MK22023: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: EA38947
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: BG08845
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BG08845%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for BG08845: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: UL05357
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL05357%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for UL05357: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: TR37501
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TR37501%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for TR37501: 0
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: HZ69536
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: TK93923
2026-03-30 07:52:29 [auto1.de] INFO: Found listing with ID: LW29658
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LW29658%27 HTTP/1.1" 200 None
2026-03-30 07:52:29 [auto1.de] INFO: Scrape type for LW29658: 0
2026-03-30 07:52:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:30 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:30 [auto1.de] INFO: Channel: 24h | Page: 188 | totalHits: 8419 | hits on page: 40
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: DV23135
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV23135%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for DV23135: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: VR46217
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VR46217%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for VR46217: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: XH28612
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XH28612%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for XH28612: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: KJ41571
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ41571%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for KJ41571: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: UD70348
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UD70348%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for UD70348: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: CS73315
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: SE41978
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: NS35557
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: JJ64066
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JJ64066%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for JJ64066: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: MD22344
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MD22344%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for MD22344: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: LW95470
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: GN95458
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GN95458%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for GN95458: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: ZG18767
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG18767%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for ZG18767: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: GY54695
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: TM38106
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM38106%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for TM38106: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: TK68896
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK68896%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for TK68896: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: TV85934
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: YN89436
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YN89436%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for YN89436: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: YN15081
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: PR24120
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: WB47522
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: PM63573
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM63573%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for PM63573: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: JL46304
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: LL96634
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: HV52023
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: YT21216
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: YW86530
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW86530%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for YW86530: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: EH91304
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: WE57631
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE57631%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for WE57631: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: RR27166
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: SJ72548
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: XR20146
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR20146%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for XR20146: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: RL75454
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL75454%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for RL75454: 0
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: SY42721
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: RM21545
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: UC78524
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: WG52031
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: RY75144
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: BX11542
2026-03-30 07:52:30 [auto1.de] INFO: Found listing with ID: FL40114
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL40114%27 HTTP/1.1" 200 None
2026-03-30 07:52:30 [auto1.de] INFO: Scrape type for FL40114: 0
2026-03-30 07:52:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:32 [auto1.de] INFO: Channel: 24h | Page: 189 | totalHits: 8419 | hits on page: 40
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: DN27813
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: HZ35402
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: WA51516
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: VY12832
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY12832%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for VY12832: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: GA49917
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: CC10989
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: FW05091
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FW05091%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for FW05091: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: AZ02782
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ02782%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for AZ02782: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: MP53713
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: YA63127
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: YD24318
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YD24318%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for YD24318: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: FZ76900
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FZ76900%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for FZ76900: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: WK48382
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: PS79135
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS79135%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for PS79135: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: AN23805
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: VL97674
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: UT78656
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: JE05181
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JE05181%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for JE05181: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: LZ68363
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LZ68363%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for LZ68363: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: RT81127
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: XL66615
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL66615%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for XL66615: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: KK21790
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: TV45930
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: DZ20117
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: BR60141
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: UA53111
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UA53111%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for UA53111: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: YA36470
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: VR29597
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: LT01381
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: ZX19467
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: PL33602
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL33602%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for PL33602: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: BC54503
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: SN24216
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN24216%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for SN24216: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: PR44802
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR44802%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for PR44802: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: YR75150
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: TP97389
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: EC10607
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: LE99206
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: KJ49270
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KJ49270%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for KJ49270: 0
2026-03-30 07:52:32 [auto1.de] INFO: Found listing with ID: ZD15058
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD15058%27 HTTP/1.1" 200 None
2026-03-30 07:52:32 [auto1.de] INFO: Scrape type for ZD15058: 0
2026-03-30 07:52:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:33 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:33 [auto1.de] INFO: Channel: 24h | Page: 190 | totalHits: 8419 | hits on page: 40
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: PH13735
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: NR79425
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR79425%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for NR79425: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: CY46145
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: NC58057
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: UF03546
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UF03546%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for UF03546: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: TF03370
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: WU29396
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WU29396%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for WU29396: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: FF37262
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: UL28707
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: LM47126
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM47126%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for LM47126: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: FR17679
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: XG50299
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: MU09493
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MU09493%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for MU09493: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: VR85555
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: VB32886
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: EF60589
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EF60589%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for EF60589: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: MR72428
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR72428%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for MR72428: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: DC55349
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: UT14776
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT14776%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for UT14776: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: LR58414
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR58414%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for LR58414: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: HM04559
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: EN17555
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EN17555%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for EN17555: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: HN29475
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN29475%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for HN29475: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: UY60901
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY60901%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for UY60901: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: BE81625
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE81625%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for BE81625: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: CE21106
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: GY94515
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY94515%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for GY94515: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: LM12575
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM12575%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for LM12575: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: CV44457
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CV44457%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for CV44457: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: BN42758
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: ZH67756
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: PN96283
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: AZ23133
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AZ23133%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for AZ23133: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: XV62286
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62286%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for XV62286: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: ZS47010
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZS47010%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for ZS47010: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: KZ38664
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: MF03624
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX61417%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for FX61417: 0
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-30 07:52:33 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG89267%27 HTTP/1.1" 200 None
2026-03-30 07:52:33 [auto1.de] INFO: Scrape type for ZG89267: 0
2026-03-30 07:52:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:38 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:39 [auto1.de] INFO: Channel: 24h | Page: 191 | totalHits: 8422 | hits on page: 40
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: FX61417
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX61417%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for FX61417: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: EK32140
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: ZG89267
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG89267%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for ZG89267: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: WW30345
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW30345%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for WW30345: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: BH61935
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: TH50247
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH50247%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for TH50247: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: CV13370
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: GF54025
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: KK05104
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: DT00553
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: LR61927
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR61927%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for LR61927: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: PR38296
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR38296%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for PR38296: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: MN30135
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN30135%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for MN30135: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: GM93554
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: KC33777
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: JD18961
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: EU91257
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: YV19830
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV19830%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for YV19830: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: TF95367
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TF95367%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for TF95367: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: MJ24427
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: WE87104
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WE87104%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for WE87104: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: TY73105
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: ZC07667
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: RY65257
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: YC98449
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YC98449%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for YC98449: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: AN00284
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: XZ09557
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: PW75443
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: ZU51849
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: KD69831
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KD69831%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for KD69831: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: VS08295
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: DZ10370
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: YE71263
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YE71263%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for YE71263: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: PW03502
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PW03502%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for PW03502: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: LH85097
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: TZ90544
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TZ90544%27 HTTP/1.1" 200 None
2026-03-30 07:52:39 [auto1.de] INFO: Scrape type for TZ90544: 0
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: ZM06899
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: MW28967
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: ZB32219
2026-03-30 07:52:39 [auto1.de] INFO: Found listing with ID: HL71303
2026-03-30 07:52:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:40 [auto1.de] INFO: Channel: 24h | Page: 192 | totalHits: 8422 | hits on page: 40
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: BU00937
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU00937%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for BU00937: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: CB58662
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CB58662%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for CB58662: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: WN13628
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WN13628%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for WN13628: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: SC39619
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC39619%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for SC39619: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: HP58071
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: VW03364
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VW03364%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for VW03364: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: DN85056
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DN85056%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for DN85056: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: DZ90314
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: KV10415
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV10415%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for KV10415: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: SF76682
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SF76682%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for SF76682: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: CE35567
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE35567%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for CE35567: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: EC92138
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EC92138%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for EC92138: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: RN02934
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RN02934%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for RN02934: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: UY39264
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UY39264%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for UY39264: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: ZD05213
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: VL59163
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL59163%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for VL59163: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: AH54106
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AH54106%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for AH54106: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: WC53392
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: KB62882
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB62882%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for KB62882: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: JZ33625
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: SS01468
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: RX82336
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RX82336%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for RX82336: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: VU61436
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: KE07703
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE07703%27 HTTP/1.1" 200 None
2026-03-30 07:52:40 [auto1.de] INFO: Scrape type for KE07703: 0
2026-03-30 07:52:40 [auto1.de] INFO: Found listing with ID: EW87662
2026-03-30 07:52:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EW87662%27 HTTP/1.1" 200 None
2026-03-30 07:52:41 [auto1.de] INFO: Scrape type for EW87662: 0
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: YD79813
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: WS06165
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS06165%27 HTTP/1.1" 200 None
2026-03-30 07:52:41 [auto1.de] INFO: Scrape type for WS06165: 0
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: XE70546
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE70546%27 HTTP/1.1" 200 None
2026-03-30 07:52:41 [auto1.de] INFO: Scrape type for XE70546: 0
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: JR23306
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: FK29510
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK29510%27 HTTP/1.1" 200 None
2026-03-30 07:52:41 [auto1.de] INFO: Scrape type for FK29510: 0
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: YN71631
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: AP27322
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AP27322%27 HTTP/1.1" 200 None
2026-03-30 07:52:41 [auto1.de] INFO: Scrape type for AP27322: 0
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: NW52708
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW52708%27 HTTP/1.1" 200 None
2026-03-30 07:52:41 [auto1.de] INFO: Scrape type for NW52708: 0
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: NH18171
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH18171%27 HTTP/1.1" 200 None
2026-03-30 07:52:41 [auto1.de] INFO: Scrape type for NH18171: 0
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: EM86154
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: JN22818
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN22818%27 HTTP/1.1" 200 None
2026-03-30 07:52:41 [auto1.de] INFO: Scrape type for JN22818: 0
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: SK06184
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: SZ07968
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: RT44513
2026-03-30 07:52:41 [auto1.de] INFO: Found listing with ID: JB74543
2026-03-30 07:52:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:42 [auto1.de] INFO: Channel: 24h | Page: 193 | totalHits: 8422 | hits on page: 40
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: HX73394
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: ES38254
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: PU69799
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: BM68891
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: AN35443
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: XA64298
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA64298%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for XA64298: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: FU18032
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FU18032%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for FU18032: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: RT07537
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT07537%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for RT07537: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: CP64572
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: CA31284
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: JE64211
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: FJ20192
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FJ20192%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for FJ20192: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: ZV42561
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV42561%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for ZV42561: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: YZ24956
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YZ24956%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for YZ24956: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: RU51924
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: UM98970
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: PP81333
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: DG65550
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG65550%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for DG65550: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: SW06849
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SW06849%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for SW06849: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: GZ70356
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ70356%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for GZ70356: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: RS29828
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: WB65429
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: BV82977
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: XM98153
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XM98153%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for XM98153: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: ZV11386
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: TM97127
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM97127%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for TM97127: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: FW24707
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: ZB09378
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZB09378%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for ZB09378: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: NE29415
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: ES97586
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ES97586%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for ES97586: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: LF31183
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: RU06209
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: MW27042
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MW27042%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for MW27042: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: CN30644
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: VF79484
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VF79484%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for VF79484: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: PC42361
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: ZD03679
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: AJ68338
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: YS53721
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS53721%27 HTTP/1.1" 200 None
2026-03-30 07:52:42 [auto1.de] INFO: Scrape type for YS53721: 0
2026-03-30 07:52:42 [auto1.de] INFO: Found listing with ID: XY91311
2026-03-30 07:52:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:43 [auto1.de] INFO: Channel: 24h | Page: 194 | totalHits: 8422 | hits on page: 40
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: NX07210
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX07210%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for NX07210: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: UJ32060
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: LR70378
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR70378%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for LR70378: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: VX51529
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: ZX35580
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: MB10012
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: JB16135
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: WX88880
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: VG60095
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG60095%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for VG60095: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: AL99999
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: NW19977
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NW19977%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for NW19977: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: LD20816
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: FR59515
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: ND45572
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ND45572%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for ND45572: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: XK76650
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XK76650%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for XK76650: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: CL01053
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CL01053%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for CL01053: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: PB68045
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: TD36353
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD36353%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for TD36353: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: UX88157
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UX88157%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for UX88157: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: PS96436
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS96436%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for PS96436: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: CA26041
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA26041%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for CA26041: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: FK87134
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: AC64408
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: MS92853
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: HJ08295
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HJ08295%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for HJ08295: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: KJ96076
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: AL40501
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AL40501%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for AL40501: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: US66744
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: WF58596
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF58596%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for WF58596: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: HP30052
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP30052%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for HP30052: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: RT47702
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT47702%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for RT47702: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: GB90564
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: RL85498
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: NV50024
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: WB83413
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: NX27502
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: BY26931
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BY26931%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for BY26931: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: MF21991
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: MV86263
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV86263%27 HTTP/1.1" 200 None
2026-03-30 07:52:43 [auto1.de] INFO: Scrape type for MV86263: 0
2026-03-30 07:52:43 [auto1.de] INFO: Found listing with ID: XR92513
2026-03-30 07:52:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:45 [auto1.de] INFO: Channel: 24h | Page: 195 | totalHits: 8422 | hits on page: 40
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: GZ82101
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: MH61351
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MH61351%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for MH61351: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: FT59815
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: TT73177
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TT73177%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for TT73177: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: TN55271
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: DZ73228
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DZ73228%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for DZ73228: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: ZA78506
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: BT55955
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BT55955%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for BT55955: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: XT21551
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT21551%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for XT21551: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: KB45443
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB45443%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for KB45443: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: XT20747
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: GF23268
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: YD01023
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: GJ73585
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: VA37364
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA37364%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for VA37364: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: CA66668
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CA66668%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for CA66668: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: NZ98006
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NZ98006%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for NZ98006: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: MP14986
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MP14986%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for MP14986: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: YC95910
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: KU30255
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KU30255%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for KU30255: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: HE47734
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: JR52179
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: LD23223
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: LM31898
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: HL01555
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: WJ67055
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: EJ09183
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: TM08126
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TM08126%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for TM08126: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: GZ17275
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: JG89144
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG89144%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for JG89144: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: GY04691
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: WD20973
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: RN07993
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: NT23997
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NT23997%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for NT23997: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: EC99072
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: EN09392
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: DT06996
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: LX07481
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX07481%27 HTTP/1.1" 200 None
2026-03-30 07:52:45 [auto1.de] INFO: Scrape type for LX07481: 0
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: DK35136
2026-03-30 07:52:45 [auto1.de] INFO: Found listing with ID: WJ60429
2026-03-30 07:52:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:46 [auto1.de] INFO: Channel: 24h | Page: 196 | totalHits: 8422 | hits on page: 40
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: RX22328
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: XE09172
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE09172%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for XE09172: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: ST78231
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ST78231%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for ST78231: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: VE13678
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: FG48361
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: XX85358
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XX85358%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for XX85358: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: WM91088
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: NY40403
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NY40403%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for NY40403: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: JY99626
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JY99626%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for JY99626: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: CG06120
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: XX47236
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: MA20139
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MA20139%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for MA20139: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: GK17224
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GK17224%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for GK17224: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: AY24824
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: CE16613
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CE16613%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for CE16613: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: AK16963
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AK16963%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for AK16963: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: PG11291
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PG11291%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for PG11291: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: HE64708
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HE64708%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for HE64708: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: ZK51432
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZK51432%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for ZK51432: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: JR48888
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: JU28029
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JU28029%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for JU28029: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: WX17645
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: BE75867
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE75867%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for BE75867: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: FP27721
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: KV56642
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV56642%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for KV56642: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: KC60426
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: ZU41188
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU41188%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for ZU41188: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: VD40849
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VD40849%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for VD40849: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: EL78604
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: ZA94641
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZA94641%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for ZA94641: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: YL33228
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YL33228%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for YL33228: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: XU87047
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XU87047%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for XU87047: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: KP52427
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: GW71090
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GW71090%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for GW71090: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: UZ60031
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: FD59666
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FD59666%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for FD59666: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: YP26052
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: UW39915
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW39915%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for UW39915: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: GC53202
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GC53202%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for GC53202: 0
2026-03-30 07:52:46 [auto1.de] INFO: Found listing with ID: RF84100
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF84100%27 HTTP/1.1" 200 None
2026-03-30 07:52:46 [auto1.de] INFO: Scrape type for RF84100: 0
2026-03-30 07:52:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:47 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:48 [auto1.de] INFO: Channel: 24h | Page: 197 | totalHits: 8422 | hits on page: 40
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: BW84058
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW84058%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for BW84058: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: UX04638
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: WJ96014
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WJ96014%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for WJ96014: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: XT42092
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: ER27214
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: VK18000
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VK18000%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for VK18000: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: ZJ88951
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZJ88951%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for ZJ88951: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: DS51520
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS51520%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for DS51520: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: DU68074
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: AX34662
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX34662%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for AX34662: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: VP32069
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VP32069%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for VP32069: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: ZU11253
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZU11253%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for ZU11253: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: ZN38550
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: TR40985
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: BW25069
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: UH14714
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: WR70011
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: FL42692
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FL42692%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for FL42692: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: UP55636
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: EP24311
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP24311%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for EP24311: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: ZT83144
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: UY91981
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: AX05001
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX05001%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for AX05001: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: LT27218
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LT27218%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for LT27218: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: TG23617
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG23617%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for TG23617: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: DL01383
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL01383%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for DL01383: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: VR01975
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: BC68366
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC68366%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for BC68366: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: UW30616
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW30616%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for UW30616: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: RT08508
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RT08508%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for RT08508: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: HL66974
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: CJ73141
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: LT88740
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: FE36611
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: MY97693
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MY97693%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for MY97693: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: VH99628
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VH99628%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for VH99628: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: ST78057
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: PV80087
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: HD58306
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HD58306%27 HTTP/1.1" 200 None
2026-03-30 07:52:48 [auto1.de] INFO: Scrape type for HD58306: 0
2026-03-30 07:52:48 [auto1.de] INFO: Found listing with ID: KY32435
2026-03-30 07:52:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:57 [auto1.de] INFO: Channel: 24h | Page: 198 | totalHits: 8422 | hits on page: 40
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: BE46966
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE46966%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for BE46966: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: ZZ46464
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZZ46464%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for ZZ46464: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: PY07739
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: NX87227
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NX87227%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for NX87227: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: TH73061
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TH73061%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for TH73061: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: DN86096
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: YK83419
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YK83419%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for YK83419: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: RV77607
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: PS10948
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PS10948%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for PS10948: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: HF23324
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF23324%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for HF23324: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: XA19312
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XA19312%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for XA19312: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: UP26126
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: GP53136
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GP53136%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for GP53136: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: TV59519
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: XL14326
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL14326%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for XL14326: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: AC34212
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: EW67018
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: KN87388
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN87388%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for KN87388: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: MB20164
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MB20164%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for MB20164: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: HL64703
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HL64703%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for HL64703: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: YW30232
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW30232%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for YW30232: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: AL30364
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: FW19107
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: HF87037
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF87037%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for HF87037: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: SJ02125
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: GZ99340
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GZ99340%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for GZ99340: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: VL24807
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: FB16153
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FB16153%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for FB16153: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: AX69067
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AX69067%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for AX69067: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: CM63557
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CM63557%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for CM63557: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: YR62229
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR62229%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for YR62229: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: NF97550
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: AR94395
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR94395%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for AR94395: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: RF06599
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RF06599%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for RF06599: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: AD51126
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD51126%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for AD51126: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: ZA82087
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: PR51827
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: KU26816
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: LD78650
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LD78650%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for LD78650: 0
2026-03-30 07:52:57 [auto1.de] INFO: Found listing with ID: KB26549
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KB26549%27 HTTP/1.1" 200 None
2026-03-30 07:52:57 [auto1.de] INFO: Scrape type for KB26549: 0
2026-03-30 07:52:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:52:58 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:52:58 [auto1.de] INFO: Channel: 24h | Page: 199 | totalHits: 8422 | hits on page: 40
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: VL06986
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VL06986%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for VL06986: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: WB94106
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94106%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for WB94106: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: ZP72952
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP72952%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for ZP72952: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: CM42106
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: UP78086
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UP78086%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for UP78086: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: WP34859
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WP34859%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for WP34859: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: UR14680
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: JS00894
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS00894%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for JS00894: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: GZ33681
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: KE41699
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE41699%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for KE41699: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: WH78013
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WH78013%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for WH78013: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: GL25834
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GL25834%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for GL25834: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: AB16604
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AB16604%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for AB16604: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: PM83477
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PM83477%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for PM83477: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: XE10609
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE10609%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for XE10609: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: XT67395
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: XT85364
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: AU58197
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AU58197%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for AU58197: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: KJ39198
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: ED37424
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED37424%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for ED37424: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: HP09567
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HP09567%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for HP09567: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: EX55373
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: BN44220
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: YV25001
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YV25001%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for YV25001: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: DF34301
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF34301%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for DF34301: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: KT60539
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: VA98416
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VA98416%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for VA98416: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: JM65569
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: LX23482
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: RS04004
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RS04004%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for RS04004: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: KC29293
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: EP86808
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP86808%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for EP86808: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: YA04256
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YA04256%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for YA04256: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: WS15050
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WS15050%27 HTTP/1.1" 200 None
2026-03-30 07:52:58 [auto1.de] INFO: Scrape type for WS15050: 0
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: HM10485
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: GZ74020
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: HZ02763
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: KZ16493
2026-03-30 07:52:58 [auto1.de] INFO: Found listing with ID: UN41694
2026-03-30 07:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:52:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UN41694%27 HTTP/1.1" 200 None
2026-03-30 07:52:59 [auto1.de] INFO: Scrape type for UN41694: 0
2026-03-30 07:52:59 [auto1.de] INFO: Found listing with ID: DF05561
2026-03-30 07:52:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:00 [auto1.de] INFO: Channel: 24h | Page: 200 | totalHits: 8422 | hits on page: 40
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: UJ06873
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ06873%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for UJ06873: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: GK39429
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: KR32445
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KR32445%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for KR32445: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: MV07839
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: YR28195
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YR28195%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for YR28195: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: AW19440
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: DG41556
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: SR75246
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR75246%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for SR75246: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: HU15676
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: SV56483
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: ZM61762
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: SC91438
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SC91438%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for SC91438: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: LJ25581
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: LL75700
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: RG78174
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG78174%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for RG78174: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: NG57043
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: SK20247
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK20247%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for SK20247: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: KY61393
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KY61393%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for KY61393: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: XA48872
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: ZZ30319
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: HK51191
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HK51191%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for HK51191: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: FJ78997
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: NH81778
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH81778%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for NH81778: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: SC04632
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: CA87929
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: RZ32125
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RZ32125%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for RZ32125: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: GL40281
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: LC33446
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LC33446%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for LC33446: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: JA37481
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JA37481%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for JA37481: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: ZT00661
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT00661%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for ZT00661: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: WC65602
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: HF13996
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: RX58241
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: DG46200
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DG46200%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for DG46200: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: HN71880
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN71880%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for HN71880: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: BU17582
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU17582%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for BU17582: 0
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: VN03026
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: NS77188
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: GT32005
2026-03-30 07:53:00 [auto1.de] INFO: Found listing with ID: UT62888
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT62888%27 HTTP/1.1" 200 None
2026-03-30 07:53:00 [auto1.de] INFO: Scrape type for UT62888: 0
2026-03-30 07:53:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:01 [auto1.de] INFO: Channel: 24h | Page: 201 | totalHits: 8422 | hits on page: 40
2026-03-30 07:53:01 [auto1.de] INFO: Found listing with ID: CN24608
2026-03-30 07:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CN24608%27 HTTP/1.1" 200 None
2026-03-30 07:53:01 [auto1.de] INFO: Scrape type for CN24608: 0
2026-03-30 07:53:01 [auto1.de] INFO: Found listing with ID: BE39564
2026-03-30 07:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE39564%27 HTTP/1.1" 200 None
2026-03-30 07:53:01 [auto1.de] INFO: Scrape type for BE39564: 0
2026-03-30 07:53:01 [auto1.de] INFO: Found listing with ID: SF89930
2026-03-30 07:53:01 [auto1.de] INFO: Found listing with ID: FF09080
2026-03-30 07:53:01 [auto1.de] INFO: Found listing with ID: XU36975
2026-03-30 07:53:01 [auto1.de] INFO: Found listing with ID: WV82579
2026-03-30 07:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV82579%27 HTTP/1.1" 200 None
2026-03-30 07:53:01 [auto1.de] INFO: Scrape type for WV82579: 0
2026-03-30 07:53:01 [auto1.de] INFO: Found listing with ID: NF23902
2026-03-30 07:53:01 [auto1.de] INFO: Found listing with ID: ZP80469
2026-03-30 07:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZP80469%27 HTTP/1.1" 200 None
2026-03-30 07:53:01 [auto1.de] INFO: Scrape type for ZP80469: 0
2026-03-30 07:53:01 [auto1.de] INFO: Found listing with ID: TR04886
2026-03-30 07:53:01 [auto1.de] INFO: Found listing with ID: CW56448
2026-03-30 07:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW56448%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for CW56448: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: DL34972
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DL34972%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for DL34972: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: JR73784
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: TK15682
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: ZD10006
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD10006%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for ZD10006: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: FX32904
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FX32904%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for FX32904: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: DT59270
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: SD29600
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: AY51976
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: PB79978
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB79978%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for PB79978: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: KT35256
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: ZY39038
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: SX18437
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SX18437%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for SX18437: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: EA52308
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: KD45426
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: VZ43833
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: HA56884
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: FD80393
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: GF30877
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF30877%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for GF30877: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: CD84483
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CD84483%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for CD84483: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: XB41121
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: GM88868
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM88868%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for GM88868: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: AT60125
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AT60125%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for AT60125: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: WA47251
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WA47251%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for WA47251: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: DA22909
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: RC64872
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC64872%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for RC64872: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: GV73009
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV73009%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for GV73009: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: SR63291
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SR63291%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for SR63291: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: BF10429
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: EP03101
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EP03101%27 HTTP/1.1" 200 None
2026-03-30 07:53:02 [auto1.de] INFO: Scrape type for EP03101: 0
2026-03-30 07:53:02 [auto1.de] INFO: Found listing with ID: XY13632
2026-03-30 07:53:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:03 [auto1.de] INFO: Channel: 24h | Page: 202 | totalHits: 8422 | hits on page: 40
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: HA64256
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HA64256%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for HA64256: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: BH34221
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH34221%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for BH34221: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: MH64159
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: CU51280
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: PT22331
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PT22331%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for PT22331: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: TS47391
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: JD30879
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: BC15764
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC15764%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for BC15764: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: YW82863
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW82863%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for YW82863: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: AR37862
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AR37862%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for AR37862: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: XR83794
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XR83794%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for XR83794: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: DM55805
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM55805%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for DM55805: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: ZF87196
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: DK10749
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: DD00982
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: BR74031
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BR74031%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for BR74031: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: JV93942
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: RR37288
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: ZG46471
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZG46471%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for ZG46471: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: ZR61272
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZR61272%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for ZR61272: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: XL20163
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: YU16554
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YU16554%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for YU16554: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: PR78588
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PR78588%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for PR78588: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: RK30802
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RK30802%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for RK30802: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: RW03523
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: ZY17523
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: GW53776
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: UB66562
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB66562%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for UB66562: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: PH41345
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: FB79072
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: DY16606
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY16606%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for DY16606: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: DK90225
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DK90225%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for DK90225: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: MC13380
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MC13380%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for MC13380: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: KW07987
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: HC06893
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: BM85402
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: CA67550
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: ZG02351
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: TD16668
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TD16668%27 HTTP/1.1" 200 None
2026-03-30 07:53:03 [auto1.de] INFO: Scrape type for TD16668: 0
2026-03-30 07:53:03 [auto1.de] INFO: Found listing with ID: UK87241
2026-03-30 07:53:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:05 [auto1.de] INFO: Channel: 24h | Page: 203 | totalHits: 8422 | hits on page: 40
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: GF54285
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF54285%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for GF54285: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: JM74850
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM74850%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for JM74850: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: PJ27517
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: MN00804
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: CR42013
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CR42013%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for CR42013: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: GH25955
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: AF81396
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: FJ89028
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: CU69011
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CU69011%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for CU69011: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: GY71036
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: HB96226
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: GS36349
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: HA50795
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: UZ55149
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: NC03535
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: HR22131
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: YM01256
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: WD92607
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WD92607%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for WD92607: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: GM28208
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GM28208%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for GM28208: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: XE92374
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE92374%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for XE92374: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: EZ06190
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EZ06190%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for EZ06190: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: AD09354
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: RE79871
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RE79871%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for RE79871: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: YD36788
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: EY64053
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: NK14391
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: HA88960
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: CV20886
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: BF20079
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: GJ71513
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ71513%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for GJ71513: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: XT67531
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XT67531%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for XT67531: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: PB33753
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB33753%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for PB33753: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: TU57767
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU57767%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for TU57767: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: YH86831
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: GU24004
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: KR12848
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: HR78495
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR78495%27 HTTP/1.1" 200 None
2026-03-30 07:53:05 [auto1.de] INFO: Scrape type for HR78495: 0
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: RR83304
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-30 07:53:05 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-30 07:53:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:06 [scrapy.extensions.logstats] INFO: Crawled 399 pages (at 24 pages/min), scraped 1401 items (at 28 items/min)
2026-03-30 07:53:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 188MiB
2026-03-30 07:53:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:06 [auto1.de] INFO: Channel: 24h | Page: 204 | totalHits: 8424 | hits on page: 40
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: UE39516
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: GM93366
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: RU85035
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU85035%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for RU85035: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: VV13794
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: YZ93314
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: VJ45584
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VJ45584%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for VJ45584: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: ZE64138
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: FH72870
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: GR32471
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: RV36249
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: UB45344
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UB45344%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for UB45344: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: TJ69669
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: CX33153
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: XL82798
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: NF65282
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NF65282%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for NF65282: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: DE88009
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: HF51839
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: LM10522
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM10522%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for LM10522: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: VG29831
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG29831%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for VG29831: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: GX51381
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX51381%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for GX51381: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: EC79074
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: YP50016
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YP50016%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for YP50016: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: KE20907
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: XN06908
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XN06908%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for XN06908: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: SY64199
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SY64199%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for SY64199: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: ZM57049
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: KW41122
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: XV62067
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV62067%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for XV62067: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: EH91582
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EH91582%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for EH91582: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: SG58819
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SG58819%27 HTTP/1.1" 200 None
2026-03-30 07:53:06 [auto1.de] INFO: Scrape type for SG58819: 0
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: EU16330
2026-03-30 07:53:06 [auto1.de] INFO: Found listing with ID: FE70575
2026-03-30 07:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FE70575%27 HTTP/1.1" 200 None
2026-03-30 07:53:07 [auto1.de] INFO: Scrape type for FE70575: 0
2026-03-30 07:53:07 [auto1.de] INFO: Found listing with ID: TK97651
2026-03-30 07:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TK97651%27 HTTP/1.1" 200 None
2026-03-30 07:53:07 [auto1.de] INFO: Scrape type for TK97651: 0
2026-03-30 07:53:07 [auto1.de] INFO: Found listing with ID: DR88922
2026-03-30 07:53:07 [auto1.de] INFO: Found listing with ID: SL55745
2026-03-30 07:53:07 [auto1.de] INFO: Found listing with ID: WA61115
2026-03-30 07:53:07 [auto1.de] INFO: Found listing with ID: SJ49235
2026-03-30 07:53:07 [auto1.de] INFO: Found listing with ID: ER21698
2026-03-30 07:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ER21698%27 HTTP/1.1" 200 None
2026-03-30 07:53:07 [auto1.de] INFO: Scrape type for ER21698: 0
2026-03-30 07:53:07 [auto1.de] INFO: Found listing with ID: BT33018
2026-03-30 07:53:07 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-30 07:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY33691%27 HTTP/1.1" 200 None
2026-03-30 07:53:07 [auto1.de] INFO: Scrape type for DY33691: 0
2026-03-30 07:53:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:08 [auto1.de] INFO: Channel: 24h | Page: 205 | totalHits: 8425 | hits on page: 40
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: DY33691
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DY33691%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for DY33691: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: KT95165
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: WV98635
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WV98635%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for WV98635: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: JX65004
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: VG77732
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: MW16405
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: WF26983
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WF26983%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for WF26983: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: BY24352
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: CN43056
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: SV90594
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: RA08562
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: EL77757
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: MZ03639
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: BS45971
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: NT95392
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: PB01809
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PB01809%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for PB01809: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: DA97993
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DA97993%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for DA97993: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: AD84103
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AD84103%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for AD84103: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: NV43592
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV43592%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for NV43592: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: PL81843
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PL81843%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for PL81843: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: FB20065
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: YV73995
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: WW38185
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WW38185%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for WW38185: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: UW13690
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UW13690%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for UW13690: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: CW14038
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CW14038%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for CW14038: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: HS42053
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HS42053%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for HS42053: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: PY14416
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PY14416%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for PY14416: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: JX55294
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: BK93979
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: LC65511
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: DM10226
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DM10226%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for DM10226: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: NH74164
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: EE69038
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE69038%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for EE69038: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: PA12194
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA12194%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for PA12194: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: CG50140
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: HZ13405
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HZ13405%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for HZ13405: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: YL16347
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: MN41763
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: LU05124
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LU05124%27 HTTP/1.1" 200 None
2026-03-30 07:53:08 [auto1.de] INFO: Scrape type for LU05124: 0
2026-03-30 07:53:08 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-30 07:53:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:09 [auto1.de] INFO: Channel: 24h | Page: 206 | totalHits: 8426 | hits on page: 40
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: SY55071
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: TJ50371
2026-03-30 07:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ50371%27 HTTP/1.1" 200 None
2026-03-30 07:53:09 [auto1.de] INFO: Scrape type for TJ50371: 0
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: WT57840
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: BZ34179
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: PA26532
2026-03-30 07:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PA26532%27 HTTP/1.1" 200 None
2026-03-30 07:53:09 [auto1.de] INFO: Scrape type for PA26532: 0
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: CY89611
2026-03-30 07:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CY89611%27 HTTP/1.1" 200 None
2026-03-30 07:53:09 [auto1.de] INFO: Scrape type for CY89611: 0
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: GZ42240
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: DV90621
2026-03-30 07:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DV90621%27 HTTP/1.1" 200 None
2026-03-30 07:53:09 [auto1.de] INFO: Scrape type for DV90621: 0
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: DZ63249
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: MN76950
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: AG97842
2026-03-30 07:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG97842%27 HTTP/1.1" 200 None
2026-03-30 07:53:09 [auto1.de] INFO: Scrape type for AG97842: 0
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: KV46000
2026-03-30 07:53:09 [auto1.de] INFO: Found listing with ID: LA95104
2026-03-30 07:53:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LA95104%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for LA95104: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: TA12646
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: LX44847
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LX44847%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for LX44847: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: LB45550
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: VG58612
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: YC71395
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: GG20866
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GG20866%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for GG20866: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: SW39146
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: WY65265
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WY65265%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for WY65265: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: SS56268
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: HM38388
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: SA98041
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: RV78416
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RV78416%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for RV78416: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: GB67844
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GB67844%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for GB67844: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: GJ08958
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ08958%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for GJ08958: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: HS55924
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: RM27503
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: ZD45339
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZD45339%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for ZD45339: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: BU26829
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BU26829%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for BU26829: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: UL74029
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UL74029%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for UL74029: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: GB23451
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: GD85387
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: MF41650
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MF41650%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for MF41650: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: NW01608
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: NV71817
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NV71817%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for NV71817: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: TG89658
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TG89658%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for TG89658: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: GA70819
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GA70819%27 HTTP/1.1" 200 None
2026-03-30 07:53:10 [auto1.de] INFO: Scrape type for GA70819: 0
2026-03-30 07:53:10 [auto1.de] INFO: Found listing with ID: TY06085
2026-03-30 07:53:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:11 [auto1.de] INFO: Channel: 24h | Page: 207 | totalHits: 8426 | hits on page: 40
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: NU23342
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: BW55074
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BW55074%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for BW55074: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: XE90423
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE90423%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for XE90423: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: SK80695
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SK80695%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for SK80695: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: FL62048
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: DU93693
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DU93693%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for DU93693: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: XV72554
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XV72554%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for XV72554: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: RG68419
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RG68419%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for RG68419: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: NE45887
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NE45887%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for NE45887: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: VZ98908
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VZ98908%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for VZ98908: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: MG84960
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: KU56806
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: BH58500
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BH58500%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for BH58500: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: FN47599
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FN47599%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for FN47599: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: YB04799
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: JS16399
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JS16399%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for JS16399: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: ME28341
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: JP40190
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JP40190%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for JP40190: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: AU10222
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: JN77870
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JN77870%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for JN77870: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: MN75028
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: LR31578
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LR31578%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for LR31578: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: SB90605
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: HL93382
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: HU71027
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: HW93754
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: KV33816
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KV33816%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for KV33816: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: NB68023
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: BG93361
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: ZV32018
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: MV90577
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MV90577%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for MV90577: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: DF55649
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF55649%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for DF55649: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: FT64289
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: ED71538
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ED71538%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for ED71538: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: PJ47645
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PJ47645%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for PJ47645: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: UT04321
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UT04321%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for UT04321: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: KE10146
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: PN64243
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: DF72133
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DF72133%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for DF72133: 0
2026-03-30 07:53:11 [auto1.de] INFO: Found listing with ID: RL77282
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RL77282%27 HTTP/1.1" 200 None
2026-03-30 07:53:11 [auto1.de] INFO: Scrape type for RL77282: 0
2026-03-30 07:53:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:12 [auto1.de] INFO: Channel: 24h | Page: 208 | totalHits: 8426 | hits on page: 40
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: NC99241
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NC99241%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for NC99241: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: YW14341
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YW14341%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for YW14341: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: WH57282
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: SE82228
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: WB94546
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WB94546%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for WB94546: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: LV05660
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LV05660%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for LV05660: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: ZY49257
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: PG18082
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: VX47645
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: UJ37250
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UJ37250%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for UJ37250: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: BF02767
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BF02767%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for BF02767: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: HX00661
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX00661%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for HX00661: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: BV18863
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: RC95289
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RC95289%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for RC95289: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: HE38410
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: GE96927
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GE96927%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for GE96927: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: XL36309
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XL36309%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for XL36309: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: FM75567
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FM75567%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for FM75567: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: TU93300
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TU93300%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for TU93300: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: SH00876
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SH00876%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for SH00876: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: YC00182
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: AG44580
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27AG44580%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for AG44580: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: KZ11771
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: RP91666
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RP91666%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for RP91666: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: YS46144
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YS46144%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for YS46144: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: BE92832
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BE92832%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for BE92832: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: HJ16589
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: TN63274
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TN63274%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for TN63274: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: BJ75751
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BJ75751%27 HTTP/1.1" 200 None
2026-03-30 07:53:12 [auto1.de] INFO: Scrape type for BJ75751: 0
2026-03-30 07:53:12 [auto1.de] INFO: Found listing with ID: ZT80456
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZT80456%27 HTTP/1.1" 200 None
2026-03-30 07:53:13 [auto1.de] INFO: Scrape type for ZT80456: 0
2026-03-30 07:53:13 [auto1.de] INFO: Found listing with ID: VY67413
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VY67413%27 HTTP/1.1" 200 None
2026-03-30 07:53:13 [auto1.de] INFO: Scrape type for VY67413: 0
2026-03-30 07:53:13 [auto1.de] INFO: Found listing with ID: HB69209
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HB69209%27 HTTP/1.1" 200 None
2026-03-30 07:53:13 [auto1.de] INFO: Scrape type for HB69209: 0
2026-03-30 07:53:13 [auto1.de] INFO: Found listing with ID: GF17035
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GF17035%27 HTTP/1.1" 200 None
2026-03-30 07:53:13 [auto1.de] INFO: Scrape type for GF17035: 0
2026-03-30 07:53:13 [auto1.de] INFO: Found listing with ID: KM53361
2026-03-30 07:53:13 [auto1.de] INFO: Found listing with ID: ZV63958
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27ZV63958%27 HTTP/1.1" 200 None
2026-03-30 07:53:13 [auto1.de] INFO: Scrape type for ZV63958: 0
2026-03-30 07:53:13 [auto1.de] INFO: Found listing with ID: VG24913
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27VG24913%27 HTTP/1.1" 200 None
2026-03-30 07:53:13 [auto1.de] INFO: Scrape type for VG24913: 0
2026-03-30 07:53:13 [auto1.de] INFO: Found listing with ID: XE04045
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XE04045%27 HTTP/1.1" 200 None
2026-03-30 07:53:13 [auto1.de] INFO: Scrape type for XE04045: 0
2026-03-30 07:53:13 [auto1.de] INFO: Found listing with ID: UV81203
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UV81203%27 HTTP/1.1" 200 None
2026-03-30 07:53:13 [auto1.de] INFO: Scrape type for UV81203: 0
2026-03-30 07:53:13 [auto1.de] INFO: Found listing with ID: PU74458
2026-03-30 07:53:13 [auto1.de] INFO: Found listing with ID: NK23311
2026-03-30 07:53:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:14 [auto1.de] INFO: Channel: 24h | Page: 209 | totalHits: 8426 | hits on page: 40
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: HP69948
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: FK48222
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FK48222%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for FK48222: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: KE90826
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KE90826%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for KE90826: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: MN93715
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MN93715%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for MN93715: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: BS68769
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BS68769%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for BS68769: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: LJ34502
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LJ34502%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for LJ34502: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: NE48651
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: TJ68834
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27TJ68834%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for TJ68834: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: BA78869
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: NG50641
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NG50641%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for NG50641: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: DJ78015
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: SM71650
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: BA31995
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BA31995%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for BA31995: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: ZU52934
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: PW89679
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: GD61279
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: PF87793
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF87793%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for PF87793: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: KU32415
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: RR24690
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RR24690%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for RR24690: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: NG84191
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: UX99567
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: XD36777
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27XD36777%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for XD36777: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: PC48603
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC48603%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for PC48603: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: SR86923
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: GJ17699
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GJ17699%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for GJ17699: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: ZX68256
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: HF47476
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HF47476%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for HF47476: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: CZ39134
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: EU15499
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: DC48276
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DC48276%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for DC48276: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: HG48100
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: DS20438
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DS20438%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for DS20438: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: CC34542
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CC34542%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for CC34542: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: WA68058
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: RZ05971
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: WC61131
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27WC61131%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for WC61131: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: RU40839
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27RU40839%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for RU40839: 0
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: VL73605
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: TZ58013
2026-03-30 07:53:14 [auto1.de] INFO: Found listing with ID: BC10414
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27BC10414%27 HTTP/1.1" 200 None
2026-03-30 07:53:14 [auto1.de] INFO: Scrape type for BC10414: 0
2026-03-30 07:53:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:17 [auto1.de] INFO: Channel: 24h | Page: 210 | totalHits: 8426 | hits on page: 40
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: LG96250
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LG96250%27 HTTP/1.1" 200 None
2026-03-30 07:53:17 [auto1.de] INFO: Scrape type for LG96250: 0
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: MG73872
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: SB27489
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SB27489%27 HTTP/1.1" 200 None
2026-03-30 07:53:17 [auto1.de] INFO: Scrape type for SB27489: 0
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: RM35826
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: EH57829
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: GR42785
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: FG97894
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27FG97894%27 HTTP/1.1" 200 None
2026-03-30 07:53:17 [auto1.de] INFO: Scrape type for FG97894: 0
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: MM73538
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: PX49171
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PX49171%27 HTTP/1.1" 200 None
2026-03-30 07:53:17 [auto1.de] INFO: Scrape type for PX49171: 0
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: AH24505
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: SU92609
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92609%27 HTTP/1.1" 200 None
2026-03-30 07:53:17 [auto1.de] INFO: Scrape type for SU92609: 2
2026-03-30 07:53:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a21ebc93-45f3-580d-8331-a8bad93e9463 with identifier: SU92609
2026-03-30 07:53:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a21ebc93-45f3-580d-8331-a8bad93e9463 with scrape type 2
2026-03-30 07:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a21ebc93-45f3-580d-8331-a8bad93e9463 with scrape type 2
2026-03-30 07:53:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a21ebc93-45f3-580d-8331-a8bad93e9463, identifier: SU92609
2026-03-30 07:53:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a21ebc93-45f3-580d-8331-a8bad93e9463 with identifier: SU92609
2026-03-30 07:53:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a21ebc93-45f3-580d-8331-a8bad93e9463 with identifier: SU92609
2026-03-30 07:53:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a21ebc93-45f3-580d-8331-a8bad93e9463 with identifier: SU92609 to the API
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:22Z',
 'fuel_type': 'diesel',
 'id': 'a21ebc93-45f3-580d-8331-a8bad93e9463',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SU92609',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 94528,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-02',
 'seller_name': None,
 'title': 'Audi A4 35 TDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2019}
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SU92609%27 HTTP/1.1" 200 None
2026-03-30 07:53:17 [auto1.de] INFO: Saving data for SU92609: {'auction_closing_time': 1774885042.0, 'created_time': 1773945667.41653, 'last_price_update_time': 1774857197.847072}
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SU92609') HTTP/1.1" 204 0
2026-03-30 07:53:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: RF00811
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: CA70430
2026-03-30 07:53:17 [auto1.de] INFO: Found listing with ID: CG16297
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG16297%27 HTTP/1.1" 200 None
2026-03-30 07:53:17 [auto1.de] INFO: Scrape type for CG16297: 2
2026-03-30 07:53:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6a8abd7-1342-5e0e-bf05-66799f4ceebb with identifier: CG16297
2026-03-30 07:53:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a8abd7-1342-5e0e-bf05-66799f4ceebb with scrape type 2
2026-03-30 07:53:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6a8abd7-1342-5e0e-bf05-66799f4ceebb with scrape type 2
2026-03-30 07:53:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: d6a8abd7-1342-5e0e-bf05-66799f4ceebb, identifier: CG16297
2026-03-30 07:53:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: d6a8abd7-1342-5e0e-bf05-66799f4ceebb with identifier: CG16297
2026-03-30 07:53:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: d6a8abd7-1342-5e0e-bf05-66799f4ceebb with identifier: CG16297
2026-03-30 07:53:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: d6a8abd7-1342-5e0e-bf05-66799f4ceebb with identifier: CG16297 to the API
2026-03-30 07:53:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:33:02Z',
 'fuel_type': 'diesel',
 'id': 'd6a8abd7-1342-5e0e-bf05-66799f4ceebb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CG16297',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A6',
 'odometer': 249458,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-17',
 'seller_name': None,
 'title': 'Audi A6 2.0 TDI Ultra',
 'transmission': 'automatic',
 'trim': 'Ultra',
 'year': 2016}
2026-03-30 07:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27CG16297%27 HTTP/1.1" 200 None
2026-03-30 07:53:18 [auto1.de] INFO: Saving data for CG16297: {'auction_closing_time': 1774884782.0, 'created_time': 1773400526.971792, 'last_price_update_time': 1774857198.886974}
2026-03-30 07:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='CG16297') HTTP/1.1" 204 0
2026-03-30 07:53:18 [auto1.de] INFO: Found listing with ID: AZ56926
2026-03-30 07:53:18 [auto1.de] INFO: Found listing with ID: GY33643
2026-03-30 07:53:18 [auto1.de] INFO: Found listing with ID: PF97491
2026-03-30 07:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97491%27 HTTP/1.1" 200 None
2026-03-30 07:53:18 [auto1.de] INFO: Scrape type for PF97491: 2
2026-03-30 07:53:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0ad218e-4526-5197-be34-6418cdaf4398 with identifier: PF97491
2026-03-30 07:53:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0ad218e-4526-5197-be34-6418cdaf4398 with scrape type 2
2026-03-30 07:53:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0ad218e-4526-5197-be34-6418cdaf4398 with scrape type 2
2026-03-30 07:53:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: a0ad218e-4526-5197-be34-6418cdaf4398, identifier: PF97491
2026-03-30 07:53:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: a0ad218e-4526-5197-be34-6418cdaf4398 with identifier: PF97491
2026-03-30 07:53:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: a0ad218e-4526-5197-be34-6418cdaf4398 with identifier: PF97491
2026-03-30 07:53:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: a0ad218e-4526-5197-be34-6418cdaf4398 with identifier: PF97491 to the API
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:15:34Z',
 'fuel_type': 'petrol',
 'id': 'a0ad218e-4526-5197-be34-6418cdaf4398',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PF97491',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 153703,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-09-30',
 'seller_name': None,
 'title': 'Peugeot Partner 1.4 Petit Filou',
 'transmission': 'manual',
 'trim': 'Petit Filou',
 'year': 2007}
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PF97491%27 HTTP/1.1" 200 None
2026-03-30 07:53:19 [auto1.de] INFO: Saving data for PF97491: {'auction_closing_time': 1774883734.0, 'created_time': 1774089640.15404, 'last_price_update_time': 1774857199.297358}
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PF97491') HTTP/1.1" 204 0
2026-03-30 07:53:19 [auto1.de] INFO: Found listing with ID: EK48004
2026-03-30 07:53:19 [auto1.de] INFO: Found listing with ID: WJ88731
2026-03-30 07:53:19 [auto1.de] INFO: Found listing with ID: GY05092
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY05092%27 HTTP/1.1" 200 None
2026-03-30 07:53:19 [auto1.de] INFO: Scrape type for GY05092: 2
2026-03-30 07:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 109187c6-3993-5ff3-99f1-6d3e6b0b4220 with identifier: GY05092
2026-03-30 07:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 109187c6-3993-5ff3-99f1-6d3e6b0b4220 with scrape type 2
2026-03-30 07:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 109187c6-3993-5ff3-99f1-6d3e6b0b4220 with scrape type 2
2026-03-30 07:53:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 109187c6-3993-5ff3-99f1-6d3e6b0b4220, identifier: GY05092
2026-03-30 07:53:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 109187c6-3993-5ff3-99f1-6d3e6b0b4220 with identifier: GY05092
2026-03-30 07:53:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 109187c6-3993-5ff3-99f1-6d3e6b0b4220 with identifier: GY05092
2026-03-30 07:53:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 109187c6-3993-5ff3-99f1-6d3e6b0b4220 with identifier: GY05092 to the API
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:15:20Z',
 'fuel_type': 'diesel',
 'id': '109187c6-3993-5ff3-99f1-6d3e6b0b4220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY05092',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 216823,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2018}
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GY05092%27 HTTP/1.1" 200 None
2026-03-30 07:53:19 [auto1.de] INFO: Saving data for GY05092: {'auction_closing_time': 1774883720.0, 'created_time': 1774119071.104319, 'last_price_update_time': 1774857199.70614}
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GY05092') HTTP/1.1" 204 0
2026-03-30 07:53:19 [auto1.de] INFO: Found listing with ID: NH74932
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74932%27 HTTP/1.1" 200 None
2026-03-30 07:53:19 [auto1.de] INFO: Scrape type for NH74932: 2
2026-03-30 07:53:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 697be845-9967-5f60-933c-2bc7c07ea70f with identifier: NH74932
2026-03-30 07:53:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 697be845-9967-5f60-933c-2bc7c07ea70f with scrape type 2
2026-03-30 07:53:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 697be845-9967-5f60-933c-2bc7c07ea70f with scrape type 2
2026-03-30 07:53:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 697be845-9967-5f60-933c-2bc7c07ea70f, identifier: NH74932
2026-03-30 07:53:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 697be845-9967-5f60-933c-2bc7c07ea70f with identifier: NH74932
2026-03-30 07:53:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 697be845-9967-5f60-933c-2bc7c07ea70f with identifier: NH74932
2026-03-30 07:53:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 697be845-9967-5f60-933c-2bc7c07ea70f with identifier: NH74932 to the API
2026-03-30 07:53:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:52:45Z',
 'fuel_type': 'petrol',
 'id': '697be845-9967-5f60-933c-2bc7c07ea70f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NH74932',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '408',
 'odometer': 31456,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-15',
 'seller_name': None,
 'title': 'Peugeot 408 1.2 Mild-Hybrid Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2024}
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NH74932%27 HTTP/1.1" 200 None
2026-03-30 07:53:20 [auto1.de] INFO: Saving data for NH74932: {'auction_closing_time': 1774885965.0, 'created_time': 1773946978.181705, 'last_price_update_time': 1774857200.111348}
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NH74932') HTTP/1.1" 204 0
2026-03-30 07:53:20 [auto1.de] INFO: Found listing with ID: WA60872
2026-03-30 07:53:20 [auto1.de] INFO: Found listing with ID: PC86018
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86018%27 HTTP/1.1" 200 None
2026-03-30 07:53:20 [auto1.de] INFO: Scrape type for PC86018: 2
2026-03-30 07:53:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 494ea3ba-48c6-50a0-a43c-f542dbfcb993 with identifier: PC86018
2026-03-30 07:53:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 494ea3ba-48c6-50a0-a43c-f542dbfcb993 with scrape type 2
2026-03-30 07:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 494ea3ba-48c6-50a0-a43c-f542dbfcb993 with scrape type 2
2026-03-30 07:53:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 494ea3ba-48c6-50a0-a43c-f542dbfcb993, identifier: PC86018
2026-03-30 07:53:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 494ea3ba-48c6-50a0-a43c-f542dbfcb993 with identifier: PC86018
2026-03-30 07:53:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 494ea3ba-48c6-50a0-a43c-f542dbfcb993 with identifier: PC86018
2026-03-30 07:53:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 494ea3ba-48c6-50a0-a43c-f542dbfcb993 with identifier: PC86018 to the API
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:19:20Z',
 'fuel_type': 'diesel',
 'id': '494ea3ba-48c6-50a0-a43c-f542dbfcb993',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PC86018',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 147681,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-27',
 'seller_name': None,
 'title': 'Volvo XC60 2.0 D4 Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2020}
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27PC86018%27 HTTP/1.1" 200 None
2026-03-30 07:53:20 [auto1.de] INFO: Saving data for PC86018: {'auction_closing_time': 1774883960.0, 'created_time': 1773946548.675258, 'last_price_update_time': 1774857200.523958}
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='PC86018') HTTP/1.1" 204 0
2026-03-30 07:53:20 [auto1.de] INFO: Found listing with ID: EE70645
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70645%27 HTTP/1.1" 200 None
2026-03-30 07:53:20 [auto1.de] INFO: Scrape type for EE70645: 2
2026-03-30 07:53:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 863c513f-1285-5c82-9fe7-15e008aa3106 with identifier: EE70645
2026-03-30 07:53:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 863c513f-1285-5c82-9fe7-15e008aa3106 with scrape type 2
2026-03-30 07:53:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 863c513f-1285-5c82-9fe7-15e008aa3106 with scrape type 2
2026-03-30 07:53:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 863c513f-1285-5c82-9fe7-15e008aa3106, identifier: EE70645
2026-03-30 07:53:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 863c513f-1285-5c82-9fe7-15e008aa3106 with identifier: EE70645
2026-03-30 07:53:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 863c513f-1285-5c82-9fe7-15e008aa3106 with identifier: EE70645
2026-03-30 07:53:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 863c513f-1285-5c82-9fe7-15e008aa3106 with identifier: EE70645 to the API
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 272,
 'expiration_date': '2026-03-30T15:48:55Z',
 'fuel_type': 'diesel',
 'id': '863c513f-1285-5c82-9fe7-15e008aa3106',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EE70645',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q7',
 'odometer': 167329,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-29',
 'seller_name': None,
 'title': 'Audi Q7 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27EE70645%27 HTTP/1.1" 200 None
2026-03-30 07:53:21 [auto1.de] INFO: Saving data for EE70645: {'auction_closing_time': 1774885735.0, 'created_time': 1774350568.309423, 'last_price_update_time': 1774857201.053606}
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='EE70645') HTTP/1.1" 204 0
2026-03-30 07:53:21 [auto1.de] INFO: Found listing with ID: RJ17594
2026-03-30 07:53:21 [auto1.de] INFO: Found listing with ID: WC98530
2026-03-30 07:53:21 [auto1.de] INFO: Found listing with ID: ET93890
2026-03-30 07:53:21 [auto1.de] INFO: Found listing with ID: DV01854
2026-03-30 07:53:21 [auto1.de] INFO: Found listing with ID: UE23148
2026-03-30 07:53:21 [auto1.de] INFO: Found listing with ID: GV87257
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV87257%27 HTTP/1.1" 200 None
2026-03-30 07:53:21 [auto1.de] INFO: Scrape type for GV87257: 2
2026-03-30 07:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53ce481f-a9c2-5258-b431-013b942bbd60 with identifier: GV87257
2026-03-30 07:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53ce481f-a9c2-5258-b431-013b942bbd60 with scrape type 2
2026-03-30 07:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53ce481f-a9c2-5258-b431-013b942bbd60 with scrape type 2
2026-03-30 07:53:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 53ce481f-a9c2-5258-b431-013b942bbd60, identifier: GV87257
2026-03-30 07:53:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 53ce481f-a9c2-5258-b431-013b942bbd60 with identifier: GV87257
2026-03-30 07:53:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 53ce481f-a9c2-5258-b431-013b942bbd60 with identifier: GV87257
2026-03-30 07:53:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 53ce481f-a9c2-5258-b431-013b942bbd60 with identifier: GV87257 to the API
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:35:39Z',
 'fuel_type': 'diesel',
 'id': '53ce481f-a9c2-5258-b431-013b942bbd60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV87257',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 87092,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 Blue-HDi Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GV87257%27 HTTP/1.1" 200 None
2026-03-30 07:53:21 [auto1.de] INFO: Saving data for GV87257: {'auction_closing_time': 1774884939.0, 'created_time': 1774032137.819685, 'last_price_update_time': 1774857201.481374}
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GV87257') HTTP/1.1" 204 0
2026-03-30 07:53:21 [auto1.de] INFO: Found listing with ID: DW63947
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW63947%27 HTTP/1.1" 200 None
2026-03-30 07:53:21 [auto1.de] INFO: Scrape type for DW63947: 2
2026-03-30 07:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c13a764d-1a03-5190-b473-454c0c04d869 with identifier: DW63947
2026-03-30 07:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c13a764d-1a03-5190-b473-454c0c04d869 with scrape type 2
2026-03-30 07:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c13a764d-1a03-5190-b473-454c0c04d869 with scrape type 2
2026-03-30 07:53:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: c13a764d-1a03-5190-b473-454c0c04d869, identifier: DW63947
2026-03-30 07:53:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: c13a764d-1a03-5190-b473-454c0c04d869 with identifier: DW63947
2026-03-30 07:53:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: c13a764d-1a03-5190-b473-454c0c04d869 with identifier: DW63947
2026-03-30 07:53:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: c13a764d-1a03-5190-b473-454c0c04d869 with identifier: DW63947 to the API
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:19:00Z',
 'fuel_type': 'diesel',
 'id': 'c13a764d-1a03-5190-b473-454c0c04d869',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW63947',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 154436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-01',
 'seller_name': None,
 'title': 'Skoda Octavia 2.0 TDI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DW63947%27 HTTP/1.1" 200 None
2026-03-30 07:53:21 [auto1.de] INFO: Saving data for DW63947: {'auction_closing_time': 1774883940.0, 'created_time': 1773945350.713598, 'last_price_update_time': 1774857201.941133}
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DW63947') HTTP/1.1" 204 0
2026-03-30 07:53:21 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:21 [auto1.de] INFO: Found listing with ID: MR80797
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR80797%27 HTTP/1.1" 200 None
2026-03-30 07:53:21 [auto1.de] INFO: Scrape type for MR80797: 2
2026-03-30 07:53:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd9e92c7-0896-5bce-95fe-f9d59c42536b with identifier: MR80797
2026-03-30 07:53:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd9e92c7-0896-5bce-95fe-f9d59c42536b with scrape type 2
2026-03-30 07:53:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd9e92c7-0896-5bce-95fe-f9d59c42536b with scrape type 2
2026-03-30 07:53:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd9e92c7-0896-5bce-95fe-f9d59c42536b, identifier: MR80797
2026-03-30 07:53:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd9e92c7-0896-5bce-95fe-f9d59c42536b with identifier: MR80797
2026-03-30 07:53:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd9e92c7-0896-5bce-95fe-f9d59c42536b with identifier: MR80797
2026-03-30 07:53:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd9e92c7-0896-5bce-95fe-f9d59c42536b with identifier: MR80797 to the API
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:37:56Z',
 'fuel_type': 'petrol',
 'id': 'bd9e92c7-0896-5bce-95fe-f9d59c42536b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR80797',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Grand C-Max',
 'odometer': 88578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-30',
 'seller_name': None,
 'title': 'Ford Grand C-Max 1.0 EcoBoost Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2017}
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27MR80797%27 HTTP/1.1" 200 None
2026-03-30 07:53:22 [auto1.de] INFO: Saving data for MR80797: {'auction_closing_time': 1774885076.0, 'created_time': 1774089403.715845, 'last_price_update_time': 1774857202.50665}
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='MR80797') HTTP/1.1" 204 0
2026-03-30 07:53:22 [auto1.de] INFO: Found listing with ID: JG09776
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG09776%27 HTTP/1.1" 200 None
2026-03-30 07:53:22 [auto1.de] INFO: Scrape type for JG09776: 2
2026-03-30 07:53:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35053175-1423-5ddc-a847-2a39dc6d1aec with identifier: JG09776
2026-03-30 07:53:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35053175-1423-5ddc-a847-2a39dc6d1aec with scrape type 2
2026-03-30 07:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35053175-1423-5ddc-a847-2a39dc6d1aec with scrape type 2
2026-03-30 07:53:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 35053175-1423-5ddc-a847-2a39dc6d1aec, identifier: JG09776
2026-03-30 07:53:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 35053175-1423-5ddc-a847-2a39dc6d1aec with identifier: JG09776
2026-03-30 07:53:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 35053175-1423-5ddc-a847-2a39dc6d1aec with identifier: JG09776
2026-03-30 07:53:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 35053175-1423-5ddc-a847-2a39dc6d1aec with identifier: JG09776 to the API
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:16:03Z',
 'fuel_type': 'diesel',
 'id': '35053175-1423-5ddc-a847-2a39dc6d1aec',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG09776',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 199738,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-02',
 'seller_name': None,
 'title': 'Opel Astra 1.6 CDTI DPF Dynamic Start/Stop',
 'transmission': 'manual',
 'trim': 'Dynamic Start/Stop',
 'year': 2018}
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JG09776%27 HTTP/1.1" 200 None
2026-03-30 07:53:22 [auto1.de] INFO: Saving data for JG09776: {'auction_closing_time': 1774883763.0, 'created_time': 1774683341.382941, 'last_price_update_time': 1774857202.923951}
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JG09776') HTTP/1.1" 204 0
2026-03-30 07:53:22 [auto1.de] INFO: Found listing with ID: KN89851
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN89851%27 HTTP/1.1" 200 None
2026-03-30 07:53:22 [auto1.de] INFO: Scrape type for KN89851: 2
2026-03-30 07:53:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdd6d543-fbb7-5bb6-ab52-75391f440015 with identifier: KN89851
2026-03-30 07:53:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdd6d543-fbb7-5bb6-ab52-75391f440015 with scrape type 2
2026-03-30 07:53:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cdd6d543-fbb7-5bb6-ab52-75391f440015 with scrape type 2
2026-03-30 07:53:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: cdd6d543-fbb7-5bb6-ab52-75391f440015, identifier: KN89851
2026-03-30 07:53:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: cdd6d543-fbb7-5bb6-ab52-75391f440015 with identifier: KN89851
2026-03-30 07:53:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: cdd6d543-fbb7-5bb6-ab52-75391f440015 with identifier: KN89851
2026-03-30 07:53:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: cdd6d543-fbb7-5bb6-ab52-75391f440015 with identifier: KN89851 to the API
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:54:32Z',
 'fuel_type': 'petrol',
 'id': 'cdd6d543-fbb7-5bb6-ab52-75391f440015',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN89851',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 151104,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-16',
 'seller_name': None,
 'title': 'Skoda Roomster 1.4 Style Plus Edition',
 'transmission': 'manual',
 'trim': 'Style Plus Edition',
 'year': 2009}
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27KN89851%27 HTTP/1.1" 200 None
2026-03-30 07:53:23 [auto1.de] INFO: Saving data for KN89851: {'auction_closing_time': 1774886072.0, 'created_time': 1774031793.322277, 'last_price_update_time': 1774857203.392295}
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='KN89851') HTTP/1.1" 204 0
2026-03-30 07:53:23 [auto1.de] INFO: Channel: 24h | Page: 211 | totalHits: 8426 | hits on page: 26
2026-03-30 07:53:23 [auto1.de] INFO: Found listing with ID: ZS91776
2026-03-30 07:53:23 [auto1.de] INFO: Found listing with ID: VX64192
2026-03-30 07:53:23 [auto1.de] INFO: Found listing with ID: SN59057
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN59057%27 HTTP/1.1" 200 None
2026-03-30 07:53:23 [auto1.de] INFO: Scrape type for SN59057: 2
2026-03-30 07:53:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44ead293-c03e-5764-82a7-ebeb881c3ffc with identifier: SN59057
2026-03-30 07:53:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44ead293-c03e-5764-82a7-ebeb881c3ffc with scrape type 2
2026-03-30 07:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44ead293-c03e-5764-82a7-ebeb881c3ffc with scrape type 2
2026-03-30 07:53:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 44ead293-c03e-5764-82a7-ebeb881c3ffc, identifier: SN59057
2026-03-30 07:53:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 44ead293-c03e-5764-82a7-ebeb881c3ffc with identifier: SN59057
2026-03-30 07:53:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 44ead293-c03e-5764-82a7-ebeb881c3ffc with identifier: SN59057
2026-03-30 07:53:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 44ead293-c03e-5764-82a7-ebeb881c3ffc with identifier: SN59057 to the API
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:14:13Z',
 'fuel_type': 'petrol',
 'id': '44ead293-c03e-5764-82a7-ebeb881c3ffc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SN59057',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 138999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-05-19',
 'seller_name': None,
 'title': 'Volkswagen Passat 1.4 TSI Sportline BlueMotion',
 'transmission': 'manual',
 'trim': 'Sportline BlueMotion',
 'year': 2010}
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SN59057%27 HTTP/1.1" 200 None
2026-03-30 07:53:23 [auto1.de] INFO: Saving data for SN59057: {'auction_closing_time': 1774883653.0, 'created_time': 1774034591.87698, 'last_price_update_time': 1774857203.962075}
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SN59057') HTTP/1.1" 204 0
2026-03-30 07:53:23 [auto1.de] INFO: Found listing with ID: FX10664
2026-03-30 07:53:23 [auto1.de] INFO: Found listing with ID: ED17592
2026-03-30 07:53:23 [auto1.de] INFO: Found listing with ID: YS85041
2026-03-30 07:53:23 [auto1.de] INFO: Found listing with ID: SA72016
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA72016%27 HTTP/1.1" 200 None
2026-03-30 07:53:23 [auto1.de] INFO: Scrape type for SA72016: 2
2026-03-30 07:53:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bf7d4a5-abcc-529e-be75-326de41c2826 with identifier: SA72016
2026-03-30 07:53:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bf7d4a5-abcc-529e-be75-326de41c2826 with scrape type 2
2026-03-30 07:53:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bf7d4a5-abcc-529e-be75-326de41c2826 with scrape type 2
2026-03-30 07:53:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 7bf7d4a5-abcc-529e-be75-326de41c2826, identifier: SA72016
2026-03-30 07:53:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-30 07:53:24 [auto1.de] INFO: Found listing with ID: HN30713
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30713%27 HTTP/1.1" 200 None
2026-03-30 07:53:24 [auto1.de] INFO: Scrape type for HN30713: 2
2026-03-30 07:53:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc6cf8e5-e40d-531b-b1cb-f9d561db822e with identifier: HN30713
2026-03-30 07:53:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc6cf8e5-e40d-531b-b1cb-f9d561db822e with scrape type 2
2026-03-30 07:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc6cf8e5-e40d-531b-b1cb-f9d561db822e with scrape type 2
2026-03-30 07:53:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: dc6cf8e5-e40d-531b-b1cb-f9d561db822e, identifier: HN30713
2026-03-30 07:53:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 7bf7d4a5-abcc-529e-be75-326de41c2826 with identifier: SA72016
2026-03-30 07:53:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 7bf7d4a5-abcc-529e-be75-326de41c2826 with identifier: SA72016
2026-03-30 07:53:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 7bf7d4a5-abcc-529e-be75-326de41c2826 with identifier: SA72016 to the API
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:09:01Z',
 'fuel_type': 'petrol',
 'id': '7bf7d4a5-abcc-529e-be75-326de41c2826',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA72016',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Jetta',
 'odometer': 86138,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-05-01',
 'seller_name': None,
 'title': 'Volkswagen Jetta 1.4 TSI Highline',
 'transmission': 'manual',
 'trim': 'Highline',
 'year': 2012}
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27SA72016%27 HTTP/1.1" 200 None
2026-03-30 07:53:24 [auto1.de] INFO: Saving data for SA72016: {'auction_closing_time': 1774883341.0, 'created_time': 1774350062.830983, 'last_price_update_time': 1774857204.506508}
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='SA72016') HTTP/1.1" 204 0
2026-03-30 07:53:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: dc6cf8e5-e40d-531b-b1cb-f9d561db822e with identifier: HN30713
2026-03-30 07:53:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: dc6cf8e5-e40d-531b-b1cb-f9d561db822e with identifier: HN30713
2026-03-30 07:53:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: dc6cf8e5-e40d-531b-b1cb-f9d561db822e with identifier: HN30713 to the API
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:21:05Z',
 'fuel_type': 'petrol',
 'id': 'dc6cf8e5-e40d-531b-b1cb-f9d561db822e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN30713',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 163332,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-28',
 'seller_name': None,
 'title': 'BMW 1er 118i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HN30713%27 HTTP/1.1" 200 None
2026-03-30 07:53:24 [auto1.de] INFO: Saving data for HN30713: {'auction_closing_time': 1774884065.0, 'created_time': 1773428963.523591, 'last_price_update_time': 1774857204.79999}
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HN30713') HTTP/1.1" 204 0
2026-03-30 07:53:24 [auto1.de] INFO: Found listing with ID: WG54603
2026-03-30 07:53:24 [auto1.de] INFO: Found listing with ID: VV82390
2026-03-30 07:53:24 [auto1.de] INFO: Found listing with ID: SK64465
2026-03-30 07:53:24 [auto1.de] INFO: Found listing with ID: GY99851
2026-03-30 07:53:24 [auto1.de] INFO: Found listing with ID: KG73349
2026-03-30 07:53:24 [auto1.de] INFO: Found listing with ID: NR46432
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR46432%27 HTTP/1.1" 200 None
2026-03-30 07:53:24 [auto1.de] INFO: Scrape type for NR46432: 2
2026-03-30 07:53:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e4bf06a-bcc1-59a6-add9-9284baf0cd50 with identifier: NR46432
2026-03-30 07:53:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e4bf06a-bcc1-59a6-add9-9284baf0cd50 with scrape type 2
2026-03-30 07:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e4bf06a-bcc1-59a6-add9-9284baf0cd50 with scrape type 2
2026-03-30 07:53:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8e4bf06a-bcc1-59a6-add9-9284baf0cd50, identifier: NR46432
2026-03-30 07:53:24 [auto1.de] INFO: Found listing with ID: HX26034
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX26034%27 HTTP/1.1" 200 None
2026-03-30 07:53:24 [auto1.de] INFO: Scrape type for HX26034: 2
2026-03-30 07:53:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd5c3fd0-176d-5094-b136-adbbc467b1c2 with identifier: HX26034
2026-03-30 07:53:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd5c3fd0-176d-5094-b136-adbbc467b1c2 with scrape type 2
2026-03-30 07:53:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd5c3fd0-176d-5094-b136-adbbc467b1c2 with scrape type 2
2026-03-30 07:53:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: bd5c3fd0-176d-5094-b136-adbbc467b1c2, identifier: HX26034
2026-03-30 07:53:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8e4bf06a-bcc1-59a6-add9-9284baf0cd50 with identifier: NR46432
2026-03-30 07:53:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8e4bf06a-bcc1-59a6-add9-9284baf0cd50 with identifier: NR46432
2026-03-30 07:53:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8e4bf06a-bcc1-59a6-add9-9284baf0cd50 with identifier: NR46432 to the API
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:23:04Z',
 'fuel_type': 'diesel',
 'id': '8e4bf06a-bcc1-59a6-add9-9284baf0cd50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR46432',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 82261,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-08',
 'seller_name': None,
 'title': 'Audi Q3 2.0 TDI quattro Sport',
 'transmission': 'automatic',
 'trim': 'quattro Sport',
 'year': 2017}
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27NR46432%27 HTTP/1.1" 200 None
2026-03-30 07:53:25 [auto1.de] INFO: Saving data for NR46432: {'auction_closing_time': 1774884184.0, 'created_time': 1773342629.127176, 'last_price_update_time': 1774857205.326865}
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='NR46432') HTTP/1.1" 204 0
2026-03-30 07:53:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: bd5c3fd0-176d-5094-b136-adbbc467b1c2 with identifier: HX26034
2026-03-30 07:53:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: bd5c3fd0-176d-5094-b136-adbbc467b1c2 with identifier: HX26034
2026-03-30 07:53:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: bd5c3fd0-176d-5094-b136-adbbc467b1c2 with identifier: HX26034 to the API
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:15:02Z',
 'fuel_type': 'petrol',
 'id': 'bd5c3fd0-176d-5094-b136-adbbc467b1c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HX26034',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 65903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.2 TSI Kasten EcoProfi BlueMotion',
 'transmission': 'manual',
 'trim': 'Kasten EcoProfi BlueMotion',
 'year': 2017}
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HX26034%27 HTTP/1.1" 200 None
2026-03-30 07:53:25 [auto1.de] INFO: Saving data for HX26034: {'auction_closing_time': 1774883702.0, 'created_time': 1774350861.912386, 'last_price_update_time': 1774857205.702748}
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HX26034') HTTP/1.1" 204 0
2026-03-30 07:53:25 [auto1.de] INFO: Found listing with ID: GD21382
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GD21382%27 HTTP/1.1" 200 None
2026-03-30 07:53:25 [auto1.de] INFO: Scrape type for GD21382: 0
2026-03-30 07:53:25 [auto1.de] INFO: Found listing with ID: GX76510
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX76510%27 HTTP/1.1" 200 None
2026-03-30 07:53:25 [auto1.de] INFO: Scrape type for GX76510: 2
2026-03-30 07:53:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8eab25ae-a030-5d8f-a265-1885949d68e6 with identifier: GX76510
2026-03-30 07:53:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8eab25ae-a030-5d8f-a265-1885949d68e6 with scrape type 2
2026-03-30 07:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8eab25ae-a030-5d8f-a265-1885949d68e6 with scrape type 2
2026-03-30 07:53:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 8eab25ae-a030-5d8f-a265-1885949d68e6, identifier: GX76510
2026-03-30 07:53:25 [auto1.de] INFO: Found listing with ID: JM84539
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM84539%27 HTTP/1.1" 200 None
2026-03-30 07:53:25 [auto1.de] INFO: Scrape type for JM84539: 2
2026-03-30 07:53:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8c8f4db-d6a0-5ac9-831a-171337da017a with identifier: JM84539
2026-03-30 07:53:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8c8f4db-d6a0-5ac9-831a-171337da017a with scrape type 2
2026-03-30 07:53:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8c8f4db-d6a0-5ac9-831a-171337da017a with scrape type 2
2026-03-30 07:53:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: b8c8f4db-d6a0-5ac9-831a-171337da017a, identifier: JM84539
2026-03-30 07:53:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 8eab25ae-a030-5d8f-a265-1885949d68e6 with identifier: GX76510
2026-03-30 07:53:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 8eab25ae-a030-5d8f-a265-1885949d68e6 with identifier: GX76510
2026-03-30 07:53:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 8eab25ae-a030-5d8f-a265-1885949d68e6 with identifier: GX76510 to the API
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 300,
 'expiration_date': '2026-03-30T15:03:38Z',
 'fuel_type': 'petrol',
 'id': '8eab25ae-a030-5d8f-a265-1885949d68e6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX76510',
 'listing': 'auction',
 'make': 'Cupra',
 'model': 'Ateca',
 'odometer': 92634,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-14',
 'seller_name': None,
 'title': 'Cupra Ateca 2.0 TSI 4Drive',
 'transmission': 'automatic',
 'trim': '4Drive',
 'year': 2019}
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27GX76510%27 HTTP/1.1" 200 None
2026-03-30 07:53:26 [auto1.de] INFO: Saving data for GX76510: {'auction_closing_time': 1774883018.0, 'created_time': 1773429026.823259, 'last_price_update_time': 1774857206.228557}
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='GX76510') HTTP/1.1" 204 0
2026-03-30 07:53:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: b8c8f4db-d6a0-5ac9-831a-171337da017a with identifier: JM84539
2026-03-30 07:53:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: b8c8f4db-d6a0-5ac9-831a-171337da017a with identifier: JM84539
2026-03-30 07:53:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: b8c8f4db-d6a0-5ac9-831a-171337da017a with identifier: JM84539 to the API
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 65,
 'expiration_date': '2026-03-30T15:20:24Z',
 'fuel_type': 'petrol',
 'id': 'b8c8f4db-d6a0-5ac9-831a-171337da017a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM84539',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Grande Punto',
 'odometer': 60427,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-03-22',
 'seller_name': None,
 'title': 'Fiat Grande Punto 1.2 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27JM84539%27 HTTP/1.1" 200 None
2026-03-30 07:53:26 [auto1.de] INFO: Saving data for JM84539: {'auction_closing_time': 1774884024.0, 'created_time': 1773381408.864779, 'last_price_update_time': 1774857206.527414}
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='JM84539') HTTP/1.1" 204 0
2026-03-30 07:53:26 [auto1.de] INFO: Found listing with ID: DT67052
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT67052%27 HTTP/1.1" 200 None
2026-03-30 07:53:26 [auto1.de] INFO: Scrape type for DT67052: 2
2026-03-30 07:53:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f91b4c-cc4b-5682-9bce-476e2b41333d with identifier: DT67052
2026-03-30 07:53:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f91b4c-cc4b-5682-9bce-476e2b41333d with scrape type 2
2026-03-30 07:53:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15f91b4c-cc4b-5682-9bce-476e2b41333d with scrape type 2
2026-03-30 07:53:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 15f91b4c-cc4b-5682-9bce-476e2b41333d, identifier: DT67052
2026-03-30 07:53:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 15f91b4c-cc4b-5682-9bce-476e2b41333d with identifier: DT67052
2026-03-30 07:53:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 15f91b4c-cc4b-5682-9bce-476e2b41333d with identifier: DT67052
2026-03-30 07:53:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 15f91b4c-cc4b-5682-9bce-476e2b41333d with identifier: DT67052 to the API
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:39:02Z',
 'fuel_type': 'diesel',
 'id': '15f91b4c-cc4b-5682-9bce-476e2b41333d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT67052',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 346717,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'GTD BlueMotion Tech',
 'year': 2015}
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27DT67052%27 HTTP/1.1" 200 None
2026-03-30 07:53:26 [auto1.de] INFO: Saving data for DT67052: {'auction_closing_time': 1774885142.0, 'created_time': 1773428155.428278, 'last_price_update_time': 1774857206.965343}
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='DT67052') HTTP/1.1" 204 0
2026-03-30 07:53:26 [auto1.de] INFO: Found listing with ID: ZZ82496
2026-03-30 07:53:26 [auto1.de] INFO: Found listing with ID: MA81744
2026-03-30 07:53:26 [auto1.de] INFO: Found listing with ID: KG50767
2026-03-30 07:53:26 [auto1.de] INFO: Found listing with ID: AR70360
2026-03-30 07:53:26 [auto1.de] INFO: Found listing with ID: YX36608
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX36608%27 HTTP/1.1" 200 None
2026-03-30 07:53:27 [auto1.de] INFO: Scrape type for YX36608: 2
2026-03-30 07:53:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c43d8b9-c1e7-5d40-85b7-7a5284b7503c with identifier: YX36608
2026-03-30 07:53:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c43d8b9-c1e7-5d40-85b7-7a5284b7503c with scrape type 2
2026-03-30 07:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c43d8b9-c1e7-5d40-85b7-7a5284b7503c with scrape type 2
2026-03-30 07:53:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0c43d8b9-c1e7-5d40-85b7-7a5284b7503c, identifier: YX36608
2026-03-30 07:53:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0c43d8b9-c1e7-5d40-85b7-7a5284b7503c with identifier: YX36608
2026-03-30 07:53:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0c43d8b9-c1e7-5d40-85b7-7a5284b7503c with identifier: YX36608
2026-03-30 07:53:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0c43d8b9-c1e7-5d40-85b7-7a5284b7503c with identifier: YX36608 to the API
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-30T15:58:11Z',
 'fuel_type': 'diesel',
 'id': '0c43d8b9-c1e7-5d40-85b7-7a5284b7503c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YX36608',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Multivan',
 'odometer': 171461,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-10-25',
 'seller_name': None,
 'title': 'Volkswagen T5 Multivan 2.0 TDI Match',
 'transmission': 'manual',
 'trim': 'Match',
 'year': 2012}
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27YX36608%27 HTTP/1.1" 200 None
2026-03-30 07:53:27 [auto1.de] INFO: Saving data for YX36608: {'auction_closing_time': 1774886291.0, 'created_time': 1773429380.817815, 'last_price_update_time': 1774857207.356866}
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='YX36608') HTTP/1.1" 204 0
2026-03-30 07:53:27 [auto1.de] INFO: Found listing with ID: XL74124
2026-03-30 07:53:27 [auto1.de] INFO: Found listing with ID: WX78972
2026-03-30 07:53:27 [auto1.de] INFO: Found listing with ID: TW02363
2026-03-30 07:53:27 [auto1.de] INFO: Found listing with ID: HR58634
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR58634%27 HTTP/1.1" 200 None
2026-03-30 07:53:27 [auto1.de] INFO: Scrape type for HR58634: 2
2026-03-30 07:53:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0abeabca-1c9b-5f35-9e8b-a6b86387ad66 with identifier: HR58634
2026-03-30 07:53:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0abeabca-1c9b-5f35-9e8b-a6b86387ad66 with scrape type 2
2026-03-30 07:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0abeabca-1c9b-5f35-9e8b-a6b86387ad66 with scrape type 2
2026-03-30 07:53:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 0abeabca-1c9b-5f35-9e8b-a6b86387ad66, identifier: HR58634
2026-03-30 07:53:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 0abeabca-1c9b-5f35-9e8b-a6b86387ad66 with identifier: HR58634
2026-03-30 07:53:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 0abeabca-1c9b-5f35-9e8b-a6b86387ad66 with identifier: HR58634
2026-03-30 07:53:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 0abeabca-1c9b-5f35-9e8b-a6b86387ad66 with identifier: HR58634 to the API
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:48:10Z',
 'fuel_type': 'petrol',
 'id': '0abeabca-1c9b-5f35-9e8b-a6b86387ad66',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR58634',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 103229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-06',
 'seller_name': None,
 'title': 'Peugeot 207 1.4 Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2010}
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27HR58634%27 HTTP/1.1" 200 None
2026-03-30 07:53:27 [auto1.de] INFO: Saving data for HR58634: {'auction_closing_time': 1774885690.0, 'created_time': 1774089530.974053, 'last_price_update_time': 1774857207.76492}
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='HR58634') HTTP/1.1" 204 0
2026-03-30 07:53:27 [auto1.de] INFO: Found listing with ID: LM22131
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM22131%27 HTTP/1.1" 200 None
2026-03-30 07:53:27 [auto1.de] INFO: Scrape type for LM22131: 2
2026-03-30 07:53:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bae3773-5bfe-5160-833e-13c360b3aa4b with identifier: LM22131
2026-03-30 07:53:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bae3773-5bfe-5160-833e-13c360b3aa4b with scrape type 2
2026-03-30 07:53:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2bae3773-5bfe-5160-833e-13c360b3aa4b with scrape type 2
2026-03-30 07:53:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 2bae3773-5bfe-5160-833e-13c360b3aa4b, identifier: LM22131
2026-03-30 07:53:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 2bae3773-5bfe-5160-833e-13c360b3aa4b with identifier: LM22131
2026-03-30 07:53:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 2bae3773-5bfe-5160-833e-13c360b3aa4b with identifier: LM22131
2026-03-30 07:53:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 2bae3773-5bfe-5160-833e-13c360b3aa4b with identifier: LM22131 to the API
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-30T15:52:11Z',
 'fuel_type': 'petrol',
 'id': '2bae3773-5bfe-5160-833e-13c360b3aa4b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM22131',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 47362,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-06',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2019}
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27LM22131%27 HTTP/1.1" 200 None
2026-03-30 07:53:28 [auto1.de] INFO: Saving data for LM22131: {'auction_closing_time': 1774885931.0, 'created_time': 1773429561.263376, 'last_price_update_time': 1774857208.256405}
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='LM22131') HTTP/1.1" 204 0
2026-03-30 07:53:28 [auto1.de] INFO: Found listing with ID: YV43994
2026-03-30 07:53:28 [auto1.de] INFO: Found listing with ID: HY99539
2026-03-30 07:53:28 [auto1.de] INFO: Found listing with ID: UE63664
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE63664%27 HTTP/1.1" 200 None
2026-03-30 07:53:28 [auto1.de] INFO: Scrape type for UE63664: 2
2026-03-30 07:53:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c8618d-be7a-58b2-9488-aac1f029475d with identifier: UE63664
2026-03-30 07:53:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c8618d-be7a-58b2-9488-aac1f029475d with scrape type 2
2026-03-30 07:53:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77c8618d-be7a-58b2-9488-aac1f029475d with scrape type 2
2026-03-30 07:53:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.de, Processed item id: 77c8618d-be7a-58b2-9488-aac1f029475d, identifier: UE63664
2026-03-30 07:53:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.de, Translating item: 77c8618d-be7a-58b2-9488-aac1f029475d with identifier: UE63664
2026-03-30 07:53:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.de, Applying rules to item: 77c8618d-be7a-58b2-9488-aac1f029475d with identifier: UE63664
2026-03-30 07:53:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.de, Posting item: 77c8618d-be7a-58b2-9488-aac1f029475d with identifier: UE63664 to the API
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-30 07:53:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:08:14Z',
 'fuel_type': 'diesel',
 'id': '77c8618d-be7a-58b2-9488-aac1f029475d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE63664',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T6 Multivan',
 'odometer': 188246,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'DE',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-02',
 'seller_name': None,
 'title': 'Volkswagen T6 Multivan 2.0 TDI Family FWD',
 'transmission': 'automatic',
 'trim': 'Family FWD',
 'year': 2021}
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.de%27%20and%20RowKey%20eq%20%27UE63664%27 HTTP/1.1" 200 None
2026-03-30 07:53:28 [auto1.de] INFO: Saving data for UE63664: {'auction_closing_time': 1774883294.0, 'created_time': 1774550733.05855, 'last_price_update_time': 1774857208.651394}
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-30 07:53:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.de',RowKey='UE63664') HTTP/1.1" 204 0
2026-03-30 07:53:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-30 07:53:29 [auto1.de] INFO: Channel: 24h | Page: 212 | totalHits: 8427 | hits on page: 0
2026-03-30 07:53:29 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-30 07:53:29 [auto1.de] INFO: auto1.de Batch config: batch 2/2
2026-03-30 07:53:29 [auto1.de] INFO: auto1.de Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 2, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 2}
2026-03-30 07:53:29 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (1425 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.de/task_18_2026-03-30T07_35_00.jl
2026-03-30 07:53:29 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 1427017,
 'downloader/request_count': 673,
 'downloader/request_method_count/GET': 459,
 'downloader/request_method_count/POST': 214,
 'downloader/response_bytes': 126100484,
 'downloader/response_count': 673,
 'downloader/response_status_count/200': 673,
 'dupefilter/filtered': 51,
 'elapsed_time_seconds': 1102.552108,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 30, 7, 53, 29, 94912, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 1425,
 'log_count/DEBUG': 22435,
 'log_count/INFO': 26851,
 'memusage/max': 197963776,
 'memusage/startup': 147886080,
 'photo_download_count': 265,
 'request_depth_max': 215,
 'response_received_count': 408,
 'scheduler/dequeued': 673,
 'scheduler/dequeued/memory': 673,
 'scheduler/enqueued': 673,
 'scheduler/enqueued/memory': 673,
 'scrape_type/batch_skipped': 4199,
 'scrape_type/new': 96,
 'scrape_type/price_update': 1329,
 'scrape_type/skipped': 2791,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 408,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 4.7083358057847695,
 'scrapy-zyte-api/mean_response_seconds': 4.761776034985027,
 'scrapy-zyte-api/processed': 408,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 408,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 407,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 408,
 'scrapy-zyte-api/request_args/httpRequestBody': 214,
 'scrapy-zyte-api/request_args/httpRequestMethod': 214,
 'scrapy-zyte-api/request_args/httpResponseBody': 408,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 408,
 'scrapy-zyte-api/request_args/sessionContext': 408,
 'scrapy-zyte-api/request_args/url': 408,
 'scrapy-zyte-api/status_codes/200': 408,
 'scrapy-zyte-api/success': 408,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 8466,
 'source/total_available': 8427,
 'start_time': datetime.datetime(2026, 3, 30, 7, 35, 6, 542804, tzinfo=datetime.timezone.utc)}
2026-03-30 07:53:29 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-30 07:53:29 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe5d8e5e010>
2026-03-30 07:53:29 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe5d8e5e3d0>